2023-10-16T08:34:11.904 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T08:34:11.905 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933 -- /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933/orig.config.yaml 2023-10-16T08:34:11.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T08:34:12.030 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7428933' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-qa1 sha1: 75071e9ab3c3bca3308a5f42b10f82d632c58444 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-qa1 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 75071e9ab3c3bca3308a5f42b10f82d632c58444 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIDtYanxnZnQdiajc3h0gVfF4mqA/1udBJaONh8NTFWOPU1JM8j9veTPKdwjiQCKSwhOrQS6WtwZ2GAYpdCT++k= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4sMmDYQziwGjqS8rNGBmMLOo3oot4NX7CXQRSRiZOXLdDk1CTLJQklvl1jjFI2/BRSjMjrEzA6emJN69JuwT8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_06:54:33 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T08:34:12.031 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa; will attempt to use it 2023-10-16T08:34:12.032 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks 2023-10-16T08:34:12.032 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T08:34:12.034 INFO:teuthology.task.internal:Checking packages... 2023-10-16T08:34:12.059 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T08:34:12.059 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T08:34:12.060 INFO:teuthology.packaging:ref: None 2023-10-16T08:34:12.060 INFO:teuthology.packaging:tag: None 2023-10-16T08:34:12.060 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T08:34:12.061 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T08:34:12.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T08:34:12.211 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T08:34:12.212 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T08:34:12.218 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T08:34:12.218 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T08:34:12.225 INFO:teuthology.task.internal:Saving configuration 2023-10-16T08:34:12.242 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T08:34:12.249 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T08:34:12.276 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 08:29:25.678907', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIDtYanxnZnQdiajc3h0gVfF4mqA/1udBJaONh8NTFWOPU1JM8j9veTPKdwjiQCKSwhOrQS6WtwZ2GAYpdCT++k='} 2023-10-16T08:34:12.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 08:29:25.677421', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4sMmDYQziwGjqS8rNGBmMLOo3oot4NX7CXQRSRiZOXLdDk1CTLJQklvl1jjFI2/BRSjMjrEzA6emJN69JuwT8='} 2023-10-16T08:34:12.299 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T08:34:12.306 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-16T08:34:12.306 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-16T08:34:12.306 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T08:34:12.379 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf47838a60>, signals=[15]) 2023-10-16T08:34:12.380 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T08:34:12.386 INFO:teuthology.task.internal:Opening connections... 2023-10-16T08:34:12.387 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:34:12.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:34:12.480 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:34:12.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:34:12.564 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T08:34:12.571 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-10-16T08:34:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-10-16T08:34:12.589 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-16T08:34:12.642 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-16T08:34:12.643 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2023-10-16T08:34:12.643 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-16T08:34:12.643 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-16T08:34:12.643 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2023-10-16T08:34:12.643 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2023-10-16T08:34:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T08:34:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-16T08:34:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2023-10-16T08:34:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T08:34:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-16T08:34:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:34:12.645 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T08:34:12.645 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T08:34:12.646 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-16T08:34:12.669 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-10-16T08:34:12.687 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-10-16T08:34:12.688 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-10-16T08:34:12.741 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-10-16T08:34:12.742 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2023-10-16T08:34:12.742 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-10-16T08:34:12.742 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-10-16T08:34:12.742 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2023-10-16T08:34:12.743 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2023-10-16T08:34:12.743 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T08:34:12.743 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-10-16T08:34:12.743 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2023-10-16T08:34:12.743 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T08:34:12.744 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-10-16T08:34:12.744 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T08:34:12.744 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T08:34:12.744 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T08:34:12.745 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-10-16T08:34:12.819 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T08:34:12.829 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T08:34:12.861 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T08:34:12.861 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2023-10-16T08:34:12.864 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-10-16T08:34:12.881 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T08:34:12.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T08:34:12.888 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2023-10-16T08:34:12.921 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-10-16T08:34:12.944 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T08:34:13.001 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T08:34:13.022 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T08:34:13.023 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-16T08:34:13.024 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T08:34:13.025 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T08:34:13.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T08:34:13.042 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:34:13.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-16T08:34:13.042 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2023-10-16T08:34:13.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T08:34:13.044 DEBUG:teuthology.task.kernel:sha1 for mon.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:34:13.044 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-16T08:34:13.044 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-10-16T08:34:13.097 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-361.el9.x86_64 2023-10-16T08:34:13.098 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:34:13.098 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-16T08:34:13.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:34:13.103 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-361.el9.x86_64 2023-10-16T08:34:13.103 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:34:13.103 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-16T08:34:13.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:34:13.239 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum upgrade -y linux-firmware 2023-10-16T08:34:13.252 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum upgrade -y linux-firmware 2023-10-16T08:34:15.497 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - AppStream 9.6 MB/s | 6.3 MB 00:00 2023-10-16T08:34:15.516 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - AppStream 9.6 MB/s | 6.3 MB 00:00 2023-10-16T08:34:17.133 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2023-10-16T08:34:17.181 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - BaseOS 2.8 MB/s | 2.0 MB 00:00 2023-10-16T08:34:18.138 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-10-16T08:34:18.948 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 7.9 MB 00:01 2023-10-16T08:34:31.963 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 18 MB 00:12 2023-10-16T08:34:35.081 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 18 MB 00:15 2023-10-16T08:34:35.631 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.7 MB 00:00 2023-10-16T08:34:37.532 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 14 kB 00:00 2023-10-16T08:34:38.873 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.7 MB 00:00 2023-10-16T08:34:39.819 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 19 MB 00:02 2023-10-16T08:34:41.040 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 14 kB 00:01 2023-10-16T08:34:42.767 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-10-16T08:34:44.367 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-10-16T08:34:46.556 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2023-10-16T08:34:46.567 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-16T08:34:46.568 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2023-10-16T08:34:46.568 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-16T08:34:46.568 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2023-10-16T08:34:46.568 INFO:teuthology.orchestra.run.smithi094.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-16T08:34:46.569 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:34:46.569 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2023-10-16T08:34:46.569 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-16T08:34:46.569 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 1 Package 2023-10-16T08:34:46.570 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:34:46.570 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 326 M 2023-10-16T08:34:46.570 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2023-10-16T08:34:47.175 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-10-16T08:34:49.415 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-16T08:34:49.429 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-16T08:34:49.429 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-16T08:34:49.429 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-16T08:34:49.430 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-10-16T08:34:49.430 INFO:teuthology.orchestra.run.smithi130.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-16T08:34:49.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:34:49.430 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-16T08:34:49.430 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-16T08:34:49.431 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 1 Package 2023-10-16T08:34:49.431 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:34:49.431 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 326 M 2023-10-16T08:34:49.431 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-16T08:34:54.427 INFO:teuthology.orchestra.run.smithi094.stdout:linux-firmware-20230926-140.el9.noarch.rpm 41 MB/s | 326 MB 00:07 2023-10-16T08:34:54.428 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2023-10-16T08:34:54.428 INFO:teuthology.orchestra.run.smithi094.stdout:Total 41 MB/s | 326 MB 00:07 2023-10-16T08:34:54.429 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2023-10-16T08:34:54.525 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2023-10-16T08:34:54.526 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2023-10-16T08:34:56.659 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2023-10-16T08:34:56.659 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2023-10-16T08:34:58.084 INFO:teuthology.orchestra.run.smithi130.stdout:linux-firmware-20230926-140.el9.noarch.rpm 38 MB/s | 326 MB 00:08 2023-10-16T08:34:58.086 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-16T08:34:58.086 INFO:teuthology.orchestra.run.smithi130.stdout:Total 38 MB/s | 326 MB 00:08 2023-10-16T08:34:58.086 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-16T08:34:58.205 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-16T08:34:58.206 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-16T08:35:00.362 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-16T08:35:00.362 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-16T08:35:02.333 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2023-10-16T08:35:02.707 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T08:35:02.796 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T08:35:03.752 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T08:35:03.753 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T08:35:04.137 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T08:35:04.137 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:35:04.137 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2023-10-16T08:35:04.138 INFO:teuthology.orchestra.run.smithi094.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-16T08:35:04.138 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:35:04.138 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2023-10-16T08:35:04.398 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-16T08:35:04.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:35:04.619 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-16T08:35:04.620 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-16T08:35:04.624 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi094.front.sepia.ceph.com to complete... 2023-10-16T08:35:05.973 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-16T08:35:06.293 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T08:35:06.381 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T08:35:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T08:35:07.426 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T08:35:07.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T08:35:07.835 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:35:07.835 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-10-16T08:35:07.835 INFO:teuthology.orchestra.run.smithi130.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-16T08:35:07.835 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:35:07.836 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-16T08:35:08.108 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-16T08:35:08.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T08:35:08.329 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-16T08:35:08.329 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-16T08:35:08.332 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi130.front.sepia.ceph.com to complete... 2023-10-16T08:35:25.767 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16 08:35:25 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-16T08:35:25.767 INFO:teuthology.orchestra.run.smithi130.stderr:FINISHED --2023-10-16 08:35:25-- 2023-10-16T08:35:25.767 INFO:teuthology.orchestra.run.smithi130.stderr:Total wall clock time: 17s 2023-10-16T08:35:25.767 INFO:teuthology.orchestra.run.smithi130.stderr:Downloaded: 1 files, 306M in 17s (18.0 MB/s) 2023-10-16T08:35:25.768 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-16T08:35:25.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-16T08:35:26.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16 08:35:26 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-16T08:35:26.033 INFO:teuthology.orchestra.run.smithi094.stderr:FINISHED --2023-10-16 08:35:26-- 2023-10-16T08:35:26.034 INFO:teuthology.orchestra.run.smithi094.stderr:Total wall clock time: 21s 2023-10-16T08:35:26.034 INFO:teuthology.orchestra.run.smithi094.stderr:Downloaded: 1 files, 306M in 21s (14.5 MB/s) 2023-10-16T08:35:26.035 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-16T08:35:26.035 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-16T08:35:27.611 INFO:teuthology.orchestra.run.smithi130.stdout:Verifying... ######################################## 2023-10-16T08:35:27.662 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing... ######################################## 2023-10-16T08:35:27.741 INFO:teuthology.orchestra.run.smithi130.stdout:Updating / installing... 2023-10-16T08:35:27.886 INFO:teuthology.orchestra.run.smithi094.stdout:Verifying... ######################################## 2023-10-16T08:35:27.938 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing... ######################################## 2023-10-16T08:35:28.017 INFO:teuthology.orchestra.run.smithi094.stdout:Updating / installing... 2023-10-16T08:35:34.779 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-16T08:35:35.143 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-16T08:35:49.684 INFO:teuthology.orchestra.run.smithi130.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-16T08:35:50.897 INFO:teuthology.orchestra.run.smithi094.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-16T08:36:10.790 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-16T08:36:10.790 DEBUG:teuthology.orchestra.run.smithi130:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-16T08:36:10.862 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T08:36:10.862 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-16T08:36:10.863 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-16T08:36:10.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-16T08:36:10.863 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-16T08:36:10.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-16T08:36:10.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-16T08:36:10.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-16T08:36:10.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-16T08:36:10.864 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-16T08:36:10.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-16T08:36:10.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-16T08:36:10.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-16T08:36:10.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-16T08:36:10.865 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-16T08:36:10.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-16T08:36:10.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-16T08:36:10.866 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-16T08:36:10.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-16T08:36:10.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-16T08:36:10.867 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-16T08:36:10.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-16T08:36:10.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-16T08:36:10.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-16T08:36:10.868 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-16T08:36:10.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-16T08:36:10.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-16T08:36:10.869 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-16T08:36:10.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-16T08:36:10.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-16T08:36:10.870 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-16T08:36:10.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-16T08:36:10.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-16T08:36:10.871 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-16T08:36:10.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-16T08:36:10.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-16T08:36:10.872 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-16T08:36:10.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-16T08:36:10.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-16T08:36:10.873 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-16T08:36:10.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-16T08:36:10.874 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-16T08:36:10.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-16T08:36:10.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-16T08:36:10.875 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-16T08:36:10.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-16T08:36:10.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-16T08:36:10.876 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-16T08:36:10.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-16T08:36:10.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-16T08:36:10.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-16T08:36:10.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-16T08:36:10.877 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-16T08:36:10.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-16T08:36:10.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-16T08:36:10.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-16T08:36:10.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-16T08:36:10.878 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-16T08:36:10.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-16T08:36:10.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-16T08:36:10.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-16T08:36:10.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-16T08:36:10.879 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-16T08:36:10.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-16T08:36:10.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-16T08:36:10.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-16T08:36:10.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-16T08:36:10.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-16T08:36:10.880 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-16T08:36:10.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-16T08:36:10.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-16T08:36:10.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-16T08:36:10.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-16T08:36:10.881 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-16T08:36:10.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-16T08:36:10.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-16T08:36:10.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-16T08:36:10.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-16T08:36:10.882 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-16T08:36:10.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-16T08:36:10.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-16T08:36:10.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-16T08:36:10.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-16T08:36:10.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-16T08:36:10.883 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-16T08:36:10.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-16T08:36:10.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-16T08:36:10.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-16T08:36:10.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-16T08:36:10.884 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-16T08:36:10.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-16T08:36:10.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-16T08:36:10.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-16T08:36:10.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-16T08:36:10.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-16T08:36:10.885 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-16T08:36:10.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-16T08:36:10.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-16T08:36:10.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-16T08:36:10.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-16T08:36:10.886 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-16T08:36:10.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-16T08:36:10.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-16T08:36:10.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-16T08:36:10.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-16T08:36:10.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-16T08:36:10.887 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-16T08:36:10.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-16T08:36:10.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-16T08:36:10.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-16T08:36:10.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-16T08:36:10.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-16T08:36:10.888 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-16T08:36:10.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-16T08:36:10.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-16T08:36:10.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-16T08:36:10.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-16T08:36:10.889 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-16T08:36:10.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-16T08:36:10.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-16T08:36:10.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-16T08:36:10.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-16T08:36:10.890 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-16T08:36:10.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-16T08:36:10.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-16T08:36:10.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-16T08:36:10.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-16T08:36:10.891 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-16T08:36:10.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-16T08:36:10.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-16T08:36:10.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-16T08:36:10.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-16T08:36:10.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-16T08:36:10.892 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-16T08:36:10.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-16T08:36:10.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-16T08:36:10.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-16T08:36:10.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-16T08:36:10.893 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-16T08:36:10.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-16T08:36:10.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-16T08:36:10.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-16T08:36:10.894 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-16T08:36:10.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-16T08:36:10.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-16T08:36:10.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-16T08:36:10.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-16T08:36:10.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-16T08:36:10.895 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-16T08:36:10.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-16T08:36:10.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-16T08:36:10.896 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-16T08:36:10.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-16T08:36:10.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-16T08:36:10.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-16T08:36:10.897 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-16T08:36:10.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-16T08:36:10.898 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-16T08:36:10.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-16T08:36:10.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-16T08:36:10.899 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-16T08:36:10.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-16T08:36:10.900 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-16T08:36:10.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-16T08:36:10.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-16T08:36:10.901 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-16T08:36:10.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-16T08:36:10.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-16T08:36:10.902 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-16T08:36:10.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-16T08:36:10.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-16T08:36:10.903 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-16T08:36:10.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-16T08:36:10.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-16T08:36:10.904 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-16T08:36:10.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-16T08:36:10.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-16T08:36:10.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-16T08:36:10.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-16T08:36:10.905 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-16T08:36:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-16T08:36:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-16T08:36:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-16T08:36:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-16T08:36:10.906 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-16T08:36:10.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-16T08:36:10.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-16T08:36:10.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-16T08:36:10.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-16T08:36:10.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-16T08:36:10.907 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-16T08:36:10.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-16T08:36:10.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-16T08:36:10.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-16T08:36:10.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-16T08:36:10.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-16T08:36:10.908 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-16T08:36:10.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-16T08:36:10.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-16T08:36:10.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-16T08:36:10.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-16T08:36:10.909 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-16T08:36:10.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-16T08:36:10.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-16T08:36:10.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-16T08:36:10.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-16T08:36:10.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-16T08:36:10.910 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-16T08:36:10.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-16T08:36:10.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-16T08:36:10.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-16T08:36:10.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-16T08:36:10.911 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-16T08:36:10.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-16T08:36:10.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-16T08:36:10.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-16T08:36:10.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-16T08:36:10.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-16T08:36:10.912 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-16T08:36:10.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-16T08:36:10.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-16T08:36:10.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-16T08:36:10.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-16T08:36:10.913 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-16T08:36:10.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-16T08:36:10.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-16T08:36:10.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-16T08:36:10.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-16T08:36:10.914 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-16T08:36:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-16T08:36:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-16T08:36:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-16T08:36:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-16T08:36:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-16T08:36:10.915 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-16T08:36:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-16T08:36:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-16T08:36:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-16T08:36:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-16T08:36:10.916 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-16T08:36:10.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-16T08:36:10.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-16T08:36:10.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-16T08:36:10.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-16T08:36:10.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-16T08:36:10.917 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-16T08:36:10.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-16T08:36:10.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-16T08:36:10.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-16T08:36:10.918 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-16T08:36:10.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-16T08:36:10.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-16T08:36:10.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-16T08:36:10.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-16T08:36:10.919 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-16T08:36:10.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-16T08:36:10.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-16T08:36:10.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-16T08:36:10.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-16T08:36:10.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-16T08:36:10.920 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-16T08:36:10.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-16T08:36:10.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-16T08:36:10.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-16T08:36:10.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-16T08:36:10.921 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-16T08:36:10.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-16T08:36:10.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-16T08:36:10.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-16T08:36:10.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-16T08:36:10.922 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-16T08:36:10.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-16T08:36:10.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-16T08:36:10.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-16T08:36:10.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-16T08:36:10.923 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-16T08:36:10.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-16T08:36:10.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-16T08:36:10.924 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-16T08:36:10.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-16T08:36:10.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-16T08:36:10.925 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-16T08:36:10.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-16T08:36:10.926 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-16T08:36:10.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-16T08:36:10.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-16T08:36:10.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-16T08:36:10.927 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-16T08:36:10.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-16T08:36:10.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-16T08:36:10.928 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-16T08:36:10.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-16T08:36:10.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-16T08:36:10.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-16T08:36:10.929 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-16T08:36:10.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-16T08:36:10.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-16T08:36:10.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-16T08:36:10.930 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-16T08:36:10.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-16T08:36:10.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-16T08:36:10.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-16T08:36:10.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-16T08:36:10.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-16T08:36:10.931 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-16T08:36:10.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-16T08:36:10.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-16T08:36:10.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-16T08:36:10.932 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-16T08:36:10.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-16T08:36:10.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-16T08:36:10.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-16T08:36:10.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-16T08:36:10.933 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-16T08:36:10.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-16T08:36:10.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-16T08:36:10.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-16T08:36:10.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-16T08:36:10.934 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-16T08:36:10.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-16T08:36:10.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-16T08:36:10.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-16T08:36:10.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-16T08:36:10.935 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-16T08:36:10.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-16T08:36:10.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-16T08:36:10.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-16T08:36:10.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-16T08:36:10.936 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-16T08:36:10.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-16T08:36:10.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-16T08:36:10.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-16T08:36:10.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-16T08:36:10.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-16T08:36:10.937 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-16T08:36:10.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-16T08:36:10.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-16T08:36:10.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-16T08:36:10.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-16T08:36:10.938 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-16T08:36:10.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-16T08:36:10.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-16T08:36:10.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-16T08:36:10.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-16T08:36:10.939 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-16T08:36:10.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-16T08:36:10.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-16T08:36:10.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-16T08:36:10.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-16T08:36:10.940 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-16T08:36:10.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-16T08:36:10.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-16T08:36:10.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-16T08:36:10.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-16T08:36:10.941 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-16T08:36:10.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-16T08:36:10.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-16T08:36:10.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-16T08:36:10.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-16T08:36:10.942 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-16T08:36:10.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-16T08:36:10.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-16T08:36:10.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-16T08:36:10.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-16T08:36:10.943 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-16T08:36:10.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-16T08:36:10.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-16T08:36:10.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-16T08:36:10.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-16T08:36:10.944 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-16T08:36:10.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-16T08:36:10.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-16T08:36:10.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-16T08:36:10.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-16T08:36:10.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-16T08:36:10.945 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-16T08:36:10.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-16T08:36:10.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-16T08:36:10.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-16T08:36:10.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-16T08:36:10.946 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-16T08:36:10.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-16T08:36:10.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-16T08:36:10.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-16T08:36:10.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-16T08:36:10.947 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-16T08:36:10.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-16T08:36:10.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-16T08:36:10.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-16T08:36:10.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-16T08:36:10.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-16T08:36:10.948 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-16T08:36:10.949 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-16T08:36:10.949 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-16T08:36:10.949 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-16T08:36:10.949 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-16T08:36:10.949 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-16T08:36:10.949 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-16T08:36:10.950 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-16T08:36:10.950 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-16T08:36:10.950 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-16T08:36:10.950 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-16T08:36:10.951 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-16T08:36:10.951 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-16T08:36:10.951 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-16T08:36:10.951 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-16T08:36:10.951 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-16T08:36:10.951 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-16T08:36:10.952 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-16T08:36:10.952 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-16T08:36:10.952 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-16T08:36:10.952 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-16T08:36:10.952 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-16T08:36:10.953 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-16T08:36:10.953 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-16T08:36:10.953 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-16T08:36:10.953 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-16T08:36:10.953 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-16T08:36:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-16T08:36:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-16T08:36:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-16T08:36:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-16T08:36:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-16T08:36:10.955 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-16T08:36:10.955 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-16T08:36:10.955 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-16T08:36:10.955 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-16T08:36:10.955 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-16T08:36:10.956 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-16T08:36:10.956 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-16T08:36:10.956 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-16T08:36:10.956 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-16T08:36:10.956 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-16T08:36:10.956 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-16T08:36:10.957 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-16T08:36:10.957 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-16T08:36:10.957 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-16T08:36:10.957 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-16T08:36:10.957 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-16T08:36:10.958 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-16T08:36:10.958 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-16T08:36:10.958 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-16T08:36:10.958 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-16T08:36:10.958 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-16T08:36:10.959 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-16T08:36:10.959 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-16T08:36:10.959 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-16T08:36:10.959 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-16T08:36:10.959 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-16T08:36:10.960 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-16T08:36:10.960 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-16T08:36:10.960 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-16T08:36:10.960 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-16T08:36:10.960 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-16T08:36:10.960 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-16T08:36:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-16T08:36:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-16T08:36:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-16T08:36:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-16T08:36:10.961 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-16T08:36:10.962 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-16T08:36:10.962 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-16T08:36:10.962 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-16T08:36:10.962 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-16T08:36:10.962 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-16T08:36:10.963 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-16T08:36:10.963 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-16T08:36:10.963 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-16T08:36:10.963 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-16T08:36:10.963 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-16T08:36:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-16T08:36:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-16T08:36:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-16T08:36:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-16T08:36:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-16T08:36:10.964 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-16T08:36:10.965 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-16T08:36:10.965 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-16T08:36:10.965 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-16T08:36:10.965 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-16T08:36:10.965 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-16T08:36:10.966 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-16T08:36:10.966 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-16T08:36:10.966 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-16T08:36:10.966 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-16T08:36:10.966 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-16T08:36:10.967 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-16T08:36:10.967 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-16T08:36:10.967 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-16T08:36:10.967 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-16T08:36:10.967 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-16T08:36:10.968 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-16T08:36:10.968 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-16T08:36:10.968 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-16T08:36:10.968 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-16T08:36:10.968 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-16T08:36:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-16T08:36:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-16T08:36:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-16T08:36:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-16T08:36:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-16T08:36:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-16T08:36:10.970 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-16T08:36:10.970 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-16T08:36:10.970 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-16T08:36:10.970 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-16T08:36:10.970 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-16T08:36:10.971 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-16T08:36:10.971 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-16T08:36:10.971 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-16T08:36:10.971 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-16T08:36:10.971 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-16T08:36:10.972 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-16T08:36:10.972 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-16T08:36:10.972 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-16T08:36:10.972 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-16T08:36:10.972 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-16T08:36:10.972 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-16T08:36:10.973 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-16T08:36:10.973 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-16T08:36:10.973 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-16T08:36:10.973 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-16T08:36:10.973 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-16T08:36:10.974 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-16T08:36:10.974 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-16T08:36:10.974 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-16T08:36:10.974 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-16T08:36:10.974 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-16T08:36:10.975 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-16T08:36:10.975 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-16T08:36:10.975 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-16T08:36:10.975 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-16T08:36:10.975 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-16T08:36:10.976 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-16T08:36:10.976 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-16T08:36:10.976 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-16T08:36:10.976 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-16T08:36:10.976 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-16T08:36:10.976 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-16T08:36:10.977 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-16T08:36:10.977 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-16T08:36:10.977 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-16T08:36:10.977 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-16T08:36:10.977 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-16T08:36:10.978 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-16T08:36:10.978 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-16T08:36:10.978 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-16T08:36:10.978 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-16T08:36:10.978 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-16T08:36:10.979 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-16T08:36:10.979 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-16T08:36:10.979 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-16T08:36:10.979 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-16T08:36:10.979 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-16T08:36:10.980 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-16T08:36:10.980 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-16T08:36:10.980 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-16T08:36:10.980 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-16T08:36:10.980 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-16T08:36:10.980 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-16T08:36:10.981 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-16T08:36:10.981 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-16T08:36:10.981 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-16T08:36:10.981 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-16T08:36:10.981 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-16T08:36:10.982 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-16T08:36:10.982 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-16T08:36:10.982 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-16T08:36:10.982 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-16T08:36:10.982 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-16T08:36:10.983 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-16T08:36:10.983 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-16T08:36:10.983 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-16T08:36:10.983 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-16T08:36:10.983 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-16T08:36:10.984 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-16T08:36:10.984 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-16T08:36:10.984 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-16T08:36:10.984 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-16T08:36:10.984 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-16T08:36:10.985 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-16T08:36:10.985 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-16T08:36:10.985 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-16T08:36:10.985 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-16T08:36:10.985 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-16T08:36:10.986 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-16T08:36:10.986 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-16T08:36:10.986 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-16T08:36:10.986 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-16T08:36:10.986 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-16T08:36:10.987 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-16T08:36:10.987 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-16T08:36:10.987 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-16T08:36:10.987 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-16T08:36:10.987 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-16T08:36:10.987 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-16T08:36:10.988 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-16T08:36:10.988 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-16T08:36:10.988 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-16T08:36:10.988 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-16T08:36:10.988 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-16T08:36:10.988 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-16T08:36:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-16T08:36:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-16T08:36:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-16T08:36:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-16T08:36:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-16T08:36:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-16T08:36:10.990 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-16T08:36:10.990 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-16T08:36:10.990 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-16T08:36:10.990 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-16T08:36:10.990 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-16T08:36:10.991 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-16T08:36:10.991 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-16T08:36:10.991 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-16T08:36:10.991 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-16T08:36:10.991 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-16T08:36:10.992 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-16T08:36:10.992 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-16T08:36:10.992 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-16T08:36:10.992 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-16T08:36:10.992 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-16T08:36:10.992 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-16T08:36:10.993 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-16T08:36:10.993 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-16T08:36:10.993 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-16T08:36:10.993 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-16T08:36:10.993 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-16T08:36:10.994 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-16T08:36:10.994 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-16T08:36:10.994 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-16T08:36:10.994 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-16T08:36:10.994 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-16T08:36:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-16T08:36:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-16T08:36:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-16T08:36:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-16T08:36:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-16T08:36:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-16T08:36:10.996 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-16T08:36:10.996 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-16T08:36:10.996 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-16T08:36:10.996 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-16T08:36:10.996 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-16T08:36:10.996 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-16T08:36:10.997 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-16T08:36:10.997 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-16T08:36:10.997 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-16T08:36:10.997 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-16T08:36:10.997 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-16T08:36:10.998 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-16T08:36:10.998 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-16T08:36:10.998 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-16T08:36:10.998 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-16T08:36:10.999 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-16T08:36:10.999 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-16T08:36:10.999 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-16T08:36:10.999 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-16T08:36:11.000 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-16T08:36:11.000 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-16T08:36:11.000 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-16T08:36:11.001 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-16T08:36:11.001 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-16T08:36:11.001 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-16T08:36:11.001 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-16T08:36:11.002 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-16T08:36:11.002 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-16T08:36:11.003 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-16T08:36:11.003 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-16T08:36:11.003 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-16T08:36:11.004 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-16T08:36:11.004 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-16T08:36:11.004 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-16T08:36:11.005 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-16T08:36:11.005 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-16T08:36:11.005 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-16T08:36:11.006 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-16T08:36:11.006 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-16T08:36:11.006 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-16T08:36:11.007 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-16T08:36:11.007 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-16T08:36:11.007 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-16T08:36:11.008 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-16T08:36:11.008 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-16T08:36:11.008 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-16T08:36:11.009 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-16T08:36:11.009 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-16T08:36:11.009 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-16T08:36:11.009 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-16T08:36:11.010 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-16T08:36:11.010 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-16T08:36:11.010 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-16T08:36:11.010 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-16T08:36:11.011 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-16T08:36:11.011 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-16T08:36:11.011 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-16T08:36:11.011 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-16T08:36:11.011 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-16T08:36:11.011 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-16T08:36:11.012 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-16T08:36:11.012 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-16T08:36:11.012 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-16T08:36:11.012 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-16T08:36:11.012 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-16T08:36:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-16T08:36:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-16T08:36:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-16T08:36:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-16T08:36:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-16T08:36:11.013 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-16T08:36:11.014 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-16T08:36:11.014 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-16T08:36:11.014 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-16T08:36:11.014 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-16T08:36:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-16T08:36:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-16T08:36:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-16T08:36:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-16T08:36:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-16T08:36:11.015 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-16T08:36:11.016 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-16T08:36:11.016 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-16T08:36:11.016 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-16T08:36:11.016 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-16T08:36:11.016 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-16T08:36:11.017 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-16T08:36:11.017 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-16T08:36:11.017 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-16T08:36:11.017 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-16T08:36:11.017 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-16T08:36:11.017 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-16T08:36:11.018 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-16T08:36:11.018 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-16T08:36:11.018 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-16T08:36:11.018 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-16T08:36:11.019 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-16T08:36:11.019 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-16T08:36:11.019 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-16T08:36:11.019 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-16T08:36:11.020 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-16T08:36:11.020 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-16T08:36:11.020 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-16T08:36:11.020 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-16T08:36:11.020 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-16T08:36:11.021 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-16T08:36:11.021 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-16T08:36:11.021 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-16T08:36:11.021 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-16T08:36:11.021 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-16T08:36:11.022 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-16T08:36:11.022 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-16T08:36:11.022 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-16T08:36:11.022 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-16T08:36:11.022 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-16T08:36:11.023 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-16T08:36:11.023 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-16T08:36:11.023 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-16T08:36:11.023 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-16T08:36:11.023 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-16T08:36:11.024 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-16T08:36:11.024 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-16T08:36:11.024 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-16T08:36:11.024 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-16T08:36:11.024 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-16T08:36:11.025 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-16T08:36:11.025 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-16T08:36:11.025 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-16T08:36:11.025 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-16T08:36:11.025 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-16T08:36:11.026 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-16T08:36:11.026 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-16T08:36:11.026 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-16T08:36:11.026 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-16T08:36:11.026 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-16T08:36:11.027 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-16T08:36:11.027 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-16T08:36:11.027 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-16T08:36:11.027 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-16T08:36:11.027 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-16T08:36:11.028 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-16T08:36:11.028 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-16T08:36:11.028 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-16T08:36:11.028 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-16T08:36:11.029 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-16T08:36:11.029 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-16T08:36:11.029 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-16T08:36:11.030 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-16T08:36:11.030 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-16T08:36:11.030 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-16T08:36:11.031 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-16T08:36:11.031 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-16T08:36:11.031 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-16T08:36:11.031 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-16T08:36:11.032 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-16T08:36:11.032 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-16T08:36:11.032 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-16T08:36:11.033 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-16T08:36:11.033 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-16T08:36:11.033 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-16T08:36:11.033 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-16T08:36:11.033 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-16T08:36:11.034 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-16T08:36:11.034 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-16T08:36:11.034 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-16T08:36:11.034 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-16T08:36:11.034 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-16T08:36:11.035 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-16T08:36:11.035 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-16T08:36:11.035 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-16T08:36:11.035 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-16T08:36:11.035 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-16T08:36:11.036 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-16T08:36:11.036 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-16T08:36:11.036 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-16T08:36:11.036 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-16T08:36:11.036 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-16T08:36:11.037 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-16T08:36:11.037 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-16T08:36:11.037 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-16T08:36:11.037 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-16T08:36:11.037 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-16T08:36:11.037 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-16T08:36:11.038 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-16T08:36:11.038 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-16T08:36:11.038 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-16T08:36:11.038 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-16T08:36:11.038 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-16T08:36:11.039 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-16T08:36:11.039 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-16T08:36:11.039 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-16T08:36:11.039 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-16T08:36:11.039 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-16T08:36:11.039 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-16T08:36:11.040 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-16T08:36:11.040 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-16T08:36:11.040 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-16T08:36:11.040 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-16T08:36:11.040 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-16T08:36:11.040 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-16T08:36:11.041 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-16T08:36:11.041 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-16T08:36:11.041 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-16T08:36:11.041 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-16T08:36:11.041 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-16T08:36:11.041 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-16T08:36:11.042 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-16T08:36:11.042 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-16T08:36:11.042 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-16T08:36:11.042 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-16T08:36:11.042 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-16T08:36:11.043 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-16T08:36:11.043 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-16T08:36:11.043 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-16T08:36:11.043 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-16T08:36:11.043 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-16T08:36:11.044 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-16T08:36:11.044 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-16T08:36:11.044 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-16T08:36:11.044 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-16T08:36:11.044 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-16T08:36:11.044 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-16T08:36:11.045 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-16T08:36:11.045 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-16T08:36:11.045 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-16T08:36:11.045 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-16T08:36:11.045 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-16T08:36:11.046 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-16T08:36:11.046 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-16T08:36:11.046 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-16T08:36:11.046 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-16T08:36:11.046 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-16T08:36:11.046 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-16T08:36:11.047 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-16T08:36:11.047 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-16T08:36:11.047 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-16T08:36:11.047 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-16T08:36:11.047 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-16T08:36:11.047 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-16T08:36:11.048 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-16T08:36:11.048 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-16T08:36:11.048 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-16T08:36:11.048 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-16T08:36:11.048 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-16T08:36:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-16T08:36:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-16T08:36:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-16T08:36:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-16T08:36:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-16T08:36:11.049 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-16T08:36:11.050 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-16T08:36:11.050 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-16T08:36:11.050 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-16T08:36:11.050 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-16T08:36:11.050 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-16T08:36:11.051 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-16T08:36:11.051 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-16T08:36:11.051 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-16T08:36:11.051 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-16T08:36:11.051 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-16T08:36:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-16T08:36:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-16T08:36:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-16T08:36:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-16T08:36:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-16T08:36:11.052 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-16T08:36:11.053 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-16T08:36:11.053 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-16T08:36:11.053 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-16T08:36:11.053 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-16T08:36:11.053 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-16T08:36:11.054 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-16T08:36:11.054 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-16T08:36:11.054 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-16T08:36:11.054 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-16T08:36:11.054 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-16T08:36:11.055 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-16T08:36:11.055 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-16T08:36:11.055 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-16T08:36:11.055 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-16T08:36:11.055 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-16T08:36:11.055 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-16T08:36:11.056 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-16T08:36:11.056 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-16T08:36:11.056 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-16T08:36:11.056 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-16T08:36:11.056 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-16T08:36:11.056 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-16T08:36:11.057 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-16T08:36:11.057 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-16T08:36:11.057 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-16T08:36:11.057 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-16T08:36:11.057 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-16T08:36:11.058 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-16T08:36:11.058 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-16T08:36:11.058 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-16T08:36:11.058 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-16T08:36:11.058 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-16T08:36:11.059 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-16T08:36:11.059 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-16T08:36:11.059 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-16T08:36:11.059 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-16T08:36:11.059 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-16T08:36:11.059 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-16T08:36:11.060 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-16T08:36:11.060 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-16T08:36:11.060 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-16T08:36:11.060 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-16T08:36:11.060 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-16T08:36:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-16T08:36:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-16T08:36:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-16T08:36:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-16T08:36:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-16T08:36:11.061 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-16T08:36:11.062 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-16T08:36:11.062 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-16T08:36:11.062 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-16T08:36:11.062 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-16T08:36:11.062 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-16T08:36:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-16T08:36:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-16T08:36:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-16T08:36:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-16T08:36:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-16T08:36:11.064 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-16T08:36:11.064 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-16T08:36:11.064 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-16T08:36:11.064 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-16T08:36:11.064 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-16T08:36:11.064 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-16T08:36:11.065 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-16T08:36:11.065 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-16T08:36:11.065 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-16T08:36:11.065 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-16T08:36:11.065 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-16T08:36:11.066 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-16T08:36:11.066 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-16T08:36:11.066 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-16T08:36:11.066 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-16T08:36:11.066 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-16T08:36:11.066 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-16T08:36:11.067 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-16T08:36:11.067 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-16T08:36:11.067 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-16T08:36:11.067 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-16T08:36:11.067 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-16T08:36:11.068 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-16T08:36:11.068 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-16T08:36:11.068 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-16T08:36:11.068 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-16T08:36:11.068 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-16T08:36:11.068 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-16T08:36:11.069 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-16T08:36:11.069 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-16T08:36:11.069 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-16T08:36:11.069 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-16T08:36:11.069 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-16T08:36:11.069 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-16T08:36:11.070 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-16T08:36:11.070 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-16T08:36:11.070 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-16T08:36:11.070 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-16T08:36:11.070 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-16T08:36:11.071 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-16T08:36:11.071 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-16T08:36:11.071 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-16T08:36:11.071 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-16T08:36:11.071 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-16T08:36:11.071 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-16T08:36:11.072 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-16T08:36:11.072 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-16T08:36:11.072 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-16T08:36:11.072 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-16T08:36:11.072 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-16T08:36:11.072 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-16T08:36:11.073 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-16T08:36:11.073 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-16T08:36:11.073 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-16T08:36:11.073 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-16T08:36:11.073 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-16T08:36:11.073 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-16T08:36:11.074 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-16T08:36:11.074 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-16T08:36:11.074 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-16T08:36:11.074 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-16T08:36:11.074 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-16T08:36:11.075 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-16T08:36:11.075 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-16T08:36:11.075 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-16T08:36:11.075 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-16T08:36:11.075 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-16T08:36:11.076 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-16T08:36:11.076 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-16T08:36:11.076 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-16T08:36:11.076 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-16T08:36:11.076 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-16T08:36:11.076 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-16T08:36:11.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-16T08:36:11.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-16T08:36:11.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-16T08:36:11.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-16T08:36:11.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-16T08:36:11.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-16T08:36:11.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-16T08:36:11.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-16T08:36:11.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-16T08:36:11.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-16T08:36:11.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-16T08:36:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-16T08:36:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-16T08:36:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-16T08:36:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-16T08:36:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-16T08:36:11.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-16T08:36:11.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-16T08:36:11.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-16T08:36:11.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-16T08:36:11.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-16T08:36:11.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-16T08:36:11.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-16T08:36:11.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-16T08:36:11.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-16T08:36:11.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-16T08:36:11.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-16T08:36:11.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-16T08:36:11.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-16T08:36:11.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-16T08:36:11.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-16T08:36:11.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-16T08:36:11.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-16T08:36:11.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-16T08:36:11.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-16T08:36:11.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-16T08:36:11.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-16T08:36:11.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-16T08:36:11.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-16T08:36:11.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-16T08:36:11.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-16T08:36:11.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-16T08:36:11.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-16T08:36:11.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-16T08:36:11.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-16T08:36:11.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-16T08:36:11.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-16T08:36:11.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-16T08:36:11.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-16T08:36:11.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-16T08:36:11.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-16T08:36:11.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-16T08:36:11.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-16T08:36:11.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-16T08:36:11.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-16T08:36:11.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-16T08:36:11.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-16T08:36:11.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-16T08:36:11.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-16T08:36:11.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-16T08:36:11.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-16T08:36:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-16T08:36:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-16T08:36:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-16T08:36:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-16T08:36:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-16T08:36:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-16T08:36:11.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-16T08:36:11.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-16T08:36:11.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-16T08:36:11.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-16T08:36:11.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-16T08:36:11.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-16T08:36:11.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-16T08:36:11.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-16T08:36:11.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-16T08:36:11.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-16T08:36:11.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-16T08:36:11.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-16T08:36:11.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-16T08:36:11.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-16T08:36:11.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-16T08:36:11.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-16T08:36:11.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-16T08:36:11.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-16T08:36:11.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-16T08:36:11.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-16T08:36:11.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-16T08:36:11.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-16T08:36:11.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-16T08:36:11.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-16T08:36:11.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-16T08:36:11.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-16T08:36:11.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-16T08:36:11.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-16T08:36:11.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-16T08:36:11.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-16T08:36:11.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-16T08:36:11.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-16T08:36:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-16T08:36:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-16T08:36:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-16T08:36:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-16T08:36:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-16T08:36:11.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-16T08:36:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-16T08:36:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-16T08:36:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-16T08:36:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-16T08:36:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-16T08:36:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-16T08:36:11.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-16T08:36:11.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-16T08:36:11.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-16T08:36:11.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-16T08:36:11.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-16T08:36:11.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-16T08:36:11.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-16T08:36:11.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-16T08:36:11.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-16T08:36:11.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-16T08:36:11.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-16T08:36:11.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-16T08:36:11.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-16T08:36:11.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-16T08:36:11.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-16T08:36:11.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-16T08:36:11.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-16T08:36:11.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-16T08:36:11.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-16T08:36:11.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-16T08:36:11.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-16T08:36:11.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-16T08:36:11.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-16T08:36:11.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-16T08:36:11.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-16T08:36:11.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-16T08:36:11.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-16T08:36:11.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-16T08:36:11.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-16T08:36:11.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-16T08:36:11.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-16T08:36:11.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-16T08:36:11.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-16T08:36:11.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-16T08:36:11.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-16T08:36:11.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-16T08:36:11.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-16T08:36:11.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-16T08:36:11.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-16T08:36:11.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-16T08:36:11.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-16T08:36:11.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-16T08:36:11.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-16T08:36:11.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-16T08:36:11.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-16T08:36:11.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-16T08:36:11.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-16T08:36:11.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-16T08:36:11.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-16T08:36:11.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-16T08:36:11.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-16T08:36:11.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-16T08:36:11.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-16T08:36:11.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-16T08:36:11.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-16T08:36:11.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-16T08:36:11.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-16T08:36:11.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-16T08:36:11.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-16T08:36:11.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-16T08:36:11.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-16T08:36:11.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-16T08:36:11.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-16T08:36:11.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-16T08:36:11.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-16T08:36:11.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-16T08:36:11.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-16T08:36:11.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-16T08:36:11.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-16T08:36:11.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-16T08:36:11.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-16T08:36:11.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-16T08:36:11.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-16T08:36:11.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-16T08:36:11.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-16T08:36:11.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-16T08:36:11.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-16T08:36:11.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-16T08:36:11.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-16T08:36:11.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-16T08:36:11.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-16T08:36:11.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-16T08:36:11.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-16T08:36:11.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-16T08:36:11.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-16T08:36:11.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-16T08:36:11.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-16T08:36:11.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-16T08:36:11.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-16T08:36:11.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-16T08:36:11.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-16T08:36:11.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-16T08:36:11.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-16T08:36:11.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-16T08:36:11.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-16T08:36:11.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-16T08:36:11.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-16T08:36:11.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-16T08:36:11.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-16T08:36:11.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-16T08:36:11.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-16T08:36:11.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-16T08:36:11.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-16T08:36:11.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-16T08:36:11.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-16T08:36:11.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-16T08:36:11.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-16T08:36:11.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-16T08:36:11.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-16T08:36:11.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-16T08:36:11.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-16T08:36:11.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-16T08:36:11.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-16T08:36:11.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-16T08:36:11.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-16T08:36:11.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-16T08:36:11.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-16T08:36:11.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-16T08:36:11.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-16T08:36:11.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-16T08:36:11.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-16T08:36:11.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-16T08:36:11.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-16T08:36:11.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-16T08:36:11.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-16T08:36:11.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-16T08:36:11.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-16T08:36:11.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-16T08:36:11.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-16T08:36:11.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-16T08:36:11.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-16T08:36:11.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-16T08:36:11.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-16T08:36:11.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-16T08:36:11.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-16T08:36:11.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-16T08:36:11.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-16T08:36:11.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-16T08:36:11.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-16T08:36:11.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-16T08:36:11.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-16T08:36:11.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-16T08:36:11.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-16T08:36:11.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-16T08:36:11.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-16T08:36:11.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-16T08:36:11.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-16T08:36:11.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-16T08:36:11.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-16T08:36:11.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-16T08:36:11.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-16T08:36:11.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-16T08:36:11.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-16T08:36:11.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-16T08:36:11.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-16T08:36:11.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-16T08:36:11.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-16T08:36:11.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-16T08:36:11.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-16T08:36:11.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-16T08:36:11.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-16T08:36:11.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-16T08:36:11.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-16T08:36:11.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-16T08:36:11.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-16T08:36:11.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-16T08:36:11.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-16T08:36:11.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-16T08:36:11.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-16T08:36:11.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-16T08:36:11.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-16T08:36:11.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-16T08:36:11.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-16T08:36:11.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-16T08:36:11.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-16T08:36:11.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-16T08:36:11.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-16T08:36:11.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-16T08:36:11.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-16T08:36:11.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-16T08:36:11.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-16T08:36:11.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-16T08:36:11.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-16T08:36:11.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-16T08:36:11.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-16T08:36:11.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-16T08:36:11.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-16T08:36:11.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-16T08:36:11.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-16T08:36:11.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-16T08:36:11.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-16T08:36:11.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-16T08:36:11.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-16T08:36:11.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-16T08:36:11.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-16T08:36:11.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-16T08:36:11.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-16T08:36:11.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-16T08:36:11.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-16T08:36:11.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-16T08:36:11.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-16T08:36:11.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-16T08:36:11.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-16T08:36:11.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-16T08:36:11.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-16T08:36:11.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-16T08:36:11.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-16T08:36:11.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-16T08:36:11.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-16T08:36:11.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-16T08:36:11.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-16T08:36:11.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-16T08:36:11.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-16T08:36:11.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-16T08:36:11.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-16T08:36:11.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-16T08:36:11.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-16T08:36:11.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-16T08:36:11.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-16T08:36:11.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-16T08:36:11.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-16T08:36:11.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-16T08:36:11.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-16T08:36:11.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-16T08:36:11.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-16T08:36:11.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-16T08:36:11.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-16T08:36:11.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-16T08:36:11.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-16T08:36:11.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-16T08:36:11.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-16T08:36:11.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-16T08:36:11.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-16T08:36:11.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-16T08:36:11.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-16T08:36:11.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-16T08:36:11.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-16T08:36:11.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-16T08:36:11.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-16T08:36:11.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-16T08:36:11.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-16T08:36:11.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-16T08:36:11.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-16T08:36:11.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-16T08:36:11.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-16T08:36:11.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-16T08:36:11.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-16T08:36:11.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-16T08:36:11.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-16T08:36:11.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-16T08:36:11.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-16T08:36:11.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-16T08:36:11.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-16T08:36:11.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-16T08:36:11.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-16T08:36:11.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-16T08:36:11.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-16T08:36:11.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-16T08:36:11.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-16T08:36:11.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-16T08:36:11.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-16T08:36:11.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-16T08:36:11.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-16T08:36:11.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-16T08:36:11.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-16T08:36:11.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-16T08:36:11.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-16T08:36:11.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-16T08:36:11.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-16T08:36:11.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-16T08:36:11.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-16T08:36:11.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-16T08:36:11.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-16T08:36:11.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-16T08:36:11.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-16T08:36:11.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-16T08:36:11.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-16T08:36:11.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-16T08:36:11.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-16T08:36:11.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-16T08:36:11.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-16T08:36:11.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-16T08:36:11.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-16T08:36:11.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-16T08:36:11.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-16T08:36:11.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-16T08:36:11.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-16T08:36:11.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-16T08:36:11.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-16T08:36:11.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-16T08:36:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-16T08:36:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-16T08:36:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-16T08:36:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-16T08:36:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-16T08:36:11.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-16T08:36:11.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-16T08:36:11.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-16T08:36:11.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-16T08:36:11.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-16T08:36:11.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-16T08:36:11.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-16T08:36:11.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-16T08:36:11.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-16T08:36:11.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-16T08:36:11.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-16T08:36:11.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-16T08:36:11.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-16T08:36:11.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-16T08:36:11.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-16T08:36:11.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-16T08:36:11.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-16T08:36:11.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-16T08:36:11.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-16T08:36:11.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-16T08:36:11.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-16T08:36:11.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-16T08:36:11.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-16T08:36:11.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-16T08:36:11.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-16T08:36:11.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-16T08:36:11.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-16T08:36:11.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-16T08:36:11.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-16T08:36:11.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-16T08:36:11.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-16T08:36:11.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-16T08:36:11.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-16T08:36:11.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-16T08:36:11.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-16T08:36:11.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-16T08:36:11.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-16T08:36:11.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-16T08:36:11.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-16T08:36:11.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-16T08:36:11.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-16T08:36:11.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-16T08:36:11.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-16T08:36:11.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-16T08:36:11.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-16T08:36:11.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-16T08:36:11.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-16T08:36:11.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-16T08:36:11.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-16T08:36:11.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-16T08:36:11.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-16T08:36:11.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-16T08:36:11.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-16T08:36:11.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-16T08:36:11.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-16T08:36:11.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-16T08:36:11.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-16T08:36:11.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-16T08:36:11.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-16T08:36:11.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-16T08:36:11.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-16T08:36:11.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-16T08:36:11.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-16T08:36:11.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-16T08:36:11.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-16T08:36:11.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-16T08:36:11.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-16T08:36:11.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-16T08:36:11.188 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-16T08:36:11.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-16T08:36:11.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-16T08:36:11.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-16T08:36:11.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-16T08:36:11.189 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-16T08:36:11.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-16T08:36:11.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-16T08:36:11.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-16T08:36:11.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-16T08:36:11.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-16T08:36:11.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-16T08:36:11.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-16T08:36:11.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-16T08:36:11.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-16T08:36:11.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-16T08:36:11.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-16T08:36:11.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-16T08:36:11.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-16T08:36:11.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-16T08:36:11.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-16T08:36:11.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-16T08:36:11.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-16T08:36:11.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-16T08:36:11.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-16T08:36:11.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-16T08:36:11.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-16T08:36:11.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-16T08:36:11.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-16T08:36:11.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-16T08:36:11.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-16T08:36:11.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-16T08:36:11.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-16T08:36:11.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-16T08:36:11.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-16T08:36:11.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-16T08:36:11.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-16T08:36:11.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-16T08:36:11.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-16T08:36:11.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-16T08:36:11.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-16T08:36:11.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-16T08:36:11.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-16T08:36:11.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-16T08:36:11.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-16T08:36:11.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-16T08:36:11.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-16T08:36:11.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-16T08:36:11.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-16T08:36:11.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-16T08:36:11.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-16T08:36:11.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-16T08:36:11.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-16T08:36:11.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-16T08:36:11.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-16T08:36:11.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-16T08:36:11.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-16T08:36:11.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-16T08:36:11.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-16T08:36:11.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-16T08:36:11.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-16T08:36:11.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-16T08:36:11.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-16T08:36:11.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-16T08:36:11.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-16T08:36:11.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-16T08:36:11.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-16T08:36:11.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-16T08:36:11.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-16T08:36:11.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-16T08:36:11.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-16T08:36:11.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-16T08:36:11.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-16T08:36:11.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-16T08:36:11.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-16T08:36:11.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-16T08:36:11.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-16T08:36:11.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-16T08:36:11.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-16T08:36:11.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-16T08:36:11.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-16T08:36:11.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-16T08:36:11.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-16T08:36:11.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-16T08:36:11.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-16T08:36:11.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-16T08:36:11.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-16T08:36:11.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-16T08:36:11.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-16T08:36:11.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-16T08:36:11.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-16T08:36:11.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-16T08:36:11.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-16T08:36:11.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-16T08:36:11.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-16T08:36:11.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-16T08:36:11.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-16T08:36:11.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-16T08:36:11.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-16T08:36:11.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-16T08:36:11.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-16T08:36:11.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-16T08:36:11.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-16T08:36:11.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-16T08:36:11.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-16T08:36:11.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-16T08:36:11.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-16T08:36:11.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-16T08:36:11.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-16T08:36:11.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-16T08:36:11.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-16T08:36:11.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-16T08:36:11.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-16T08:36:11.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-16T08:36:11.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-16T08:36:11.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-16T08:36:11.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-16T08:36:11.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-16T08:36:11.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-16T08:36:11.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-16T08:36:11.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-16T08:36:11.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-16T08:36:11.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-16T08:36:11.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-16T08:36:11.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-16T08:36:11.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-16T08:36:11.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-16T08:36:11.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-16T08:36:11.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-16T08:36:11.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-16T08:36:11.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-16T08:36:11.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-16T08:36:11.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-16T08:36:11.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-16T08:36:11.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-16T08:36:11.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-16T08:36:11.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-16T08:36:11.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-16T08:36:11.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-16T08:36:11.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-16T08:36:11.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-16T08:36:11.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-16T08:36:11.219 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-16T08:36:11.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-16T08:36:11.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-16T08:36:11.220 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-16T08:36:11.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-16T08:36:11.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-16T08:36:11.221 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-16T08:36:11.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-16T08:36:11.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-16T08:36:11.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-16T08:36:11.222 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-16T08:36:11.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-16T08:36:11.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-16T08:36:11.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-16T08:36:11.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-16T08:36:11.223 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-16T08:36:11.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-16T08:36:11.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-16T08:36:11.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-16T08:36:11.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-16T08:36:11.224 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-16T08:36:11.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-16T08:36:11.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-16T08:36:11.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-16T08:36:11.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-16T08:36:11.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-16T08:36:11.225 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-16T08:36:11.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-16T08:36:11.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-16T08:36:11.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-16T08:36:11.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-16T08:36:11.226 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-16T08:36:11.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-16T08:36:11.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-16T08:36:11.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-16T08:36:11.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-16T08:36:11.227 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-16T08:36:11.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-16T08:36:11.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-16T08:36:11.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-16T08:36:11.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-16T08:36:11.228 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-16T08:36:11.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-16T08:36:11.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-16T08:36:11.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-16T08:36:11.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-16T08:36:11.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-16T08:36:11.229 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-16T08:36:11.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-16T08:36:11.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-16T08:36:11.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-16T08:36:11.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-16T08:36:11.230 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-16T08:36:11.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-16T08:36:11.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-16T08:36:11.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-16T08:36:11.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-16T08:36:11.231 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-16T08:36:11.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-16T08:36:11.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-16T08:36:11.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-16T08:36:11.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-16T08:36:11.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-16T08:36:11.232 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-16T08:36:11.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-16T08:36:11.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-16T08:36:11.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-16T08:36:11.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-16T08:36:11.233 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-16T08:36:11.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-16T08:36:11.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-16T08:36:11.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-16T08:36:11.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-16T08:36:11.234 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-16T08:36:11.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-16T08:36:11.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-16T08:36:11.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-16T08:36:11.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-16T08:36:11.235 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-16T08:36:11.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-16T08:36:11.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-16T08:36:11.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-16T08:36:11.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-16T08:36:11.236 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-16T08:36:11.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-16T08:36:11.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-16T08:36:11.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-16T08:36:11.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-16T08:36:11.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-16T08:36:11.237 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-16T08:36:11.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-16T08:36:11.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-16T08:36:11.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-16T08:36:11.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-16T08:36:11.238 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-16T08:36:11.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-16T08:36:11.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-16T08:36:11.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-16T08:36:11.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-16T08:36:11.239 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-16T08:36:11.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-16T08:36:11.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-16T08:36:11.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-16T08:36:11.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-16T08:36:11.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-16T08:36:11.240 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-16T08:36:11.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-16T08:36:11.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-16T08:36:11.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-16T08:36:11.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-16T08:36:11.241 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-16T08:36:11.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-16T08:36:11.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-16T08:36:11.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-16T08:36:11.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-16T08:36:11.242 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-16T08:36:11.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-16T08:36:11.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-16T08:36:11.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-16T08:36:11.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-16T08:36:11.243 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-16T08:36:11.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-16T08:36:11.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-16T08:36:11.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-16T08:36:11.244 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-16T08:36:11.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-16T08:36:11.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-16T08:36:11.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-16T08:36:11.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-16T08:36:11.245 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-16T08:36:11.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-16T08:36:11.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-16T08:36:11.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-16T08:36:11.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-16T08:36:11.246 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-16T08:36:11.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-16T08:36:11.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-16T08:36:11.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-16T08:36:11.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-16T08:36:11.247 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-16T08:36:11.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-16T08:36:11.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-16T08:36:11.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-16T08:36:11.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-16T08:36:11.248 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-16T08:36:11.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-16T08:36:11.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-16T08:36:11.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-16T08:36:11.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-16T08:36:11.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-16T08:36:11.249 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-16T08:36:11.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-16T08:36:11.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-16T08:36:11.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-16T08:36:11.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-16T08:36:11.250 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-16T08:36:11.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-16T08:36:11.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-16T08:36:11.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-16T08:36:11.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-16T08:36:11.251 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-16T08:36:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-16T08:36:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-16T08:36:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-16T08:36:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-16T08:36:11.252 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-16T08:36:11.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-16T08:36:11.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-16T08:36:11.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-16T08:36:11.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-16T08:36:11.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-16T08:36:11.253 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-16T08:36:11.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-16T08:36:11.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-16T08:36:11.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-16T08:36:11.254 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-16T08:36:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-16T08:36:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-16T08:36:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-16T08:36:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-16T08:36:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-16T08:36:11.255 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-16T08:36:11.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-16T08:36:11.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-16T08:36:11.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-16T08:36:11.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-16T08:36:11.256 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-16T08:36:11.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-16T08:36:11.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-16T08:36:11.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-16T08:36:11.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-16T08:36:11.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-16T08:36:11.257 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-16T08:36:11.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-16T08:36:11.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-16T08:36:11.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-16T08:36:11.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-16T08:36:11.258 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-16T08:36:11.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-16T08:36:11.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-16T08:36:11.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-16T08:36:11.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-16T08:36:11.259 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-16T08:36:11.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-16T08:36:11.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-16T08:36:11.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-16T08:36:11.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-16T08:36:11.260 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-16T08:36:11.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-16T08:36:11.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-16T08:36:11.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-16T08:36:11.261 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-16T08:36:11.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-16T08:36:11.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-16T08:36:11.262 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-16T08:36:11.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-16T08:36:11.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-16T08:36:11.263 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-16T08:36:11.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-16T08:36:11.264 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-16T08:36:11.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-16T08:36:11.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-16T08:36:11.265 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-16T08:36:11.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-16T08:36:11.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-16T08:36:11.266 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-16T08:36:11.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-16T08:36:11.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-16T08:36:11.267 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-16T08:36:11.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-16T08:36:11.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-16T08:36:11.268 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-16T08:36:11.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-16T08:36:11.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-16T08:36:11.269 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-16T08:36:11.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-16T08:36:11.270 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-16T08:36:11.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-16T08:36:11.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-16T08:36:11.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-16T08:36:11.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-16T08:36:11.271 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-16T08:36:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-16T08:36:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-16T08:36:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-16T08:36:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-16T08:36:11.272 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-16T08:36:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-16T08:36:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-16T08:36:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-16T08:36:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-16T08:36:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-16T08:36:11.273 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-16T08:36:11.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-16T08:36:11.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-16T08:36:11.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-16T08:36:11.274 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-16T08:36:11.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-16T08:36:11.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-16T08:36:11.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-16T08:36:11.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-16T08:36:11.275 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-16T08:36:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-16T08:36:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-16T08:36:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-16T08:36:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-16T08:36:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-16T08:36:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-16T08:36:11.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-16T08:36:11.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-16T08:36:11.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-16T08:36:11.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-16T08:36:11.277 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-16T08:36:11.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-16T08:36:11.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-16T08:36:11.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-16T08:36:11.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-16T08:36:11.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-16T08:36:11.278 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-16T08:36:11.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-16T08:36:11.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-16T08:36:11.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-16T08:36:11.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-16T08:36:11.279 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-16T08:36:11.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-16T08:36:11.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-16T08:36:11.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-16T08:36:11.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-16T08:36:11.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-16T08:36:11.280 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-16T08:36:11.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-16T08:36:11.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-16T08:36:11.281 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-16T08:36:11.282 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-16T08:36:11.282 DEBUG:teuthology.orchestra.run.smithi130:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-16T08:36:11.305 INFO:teuthology.orchestra.run.smithi130.stdout:postinstall scriptlet (using /bin/sh): 2023-10-16T08:36:11.305 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-16T08:36:11.306 INFO:teuthology.orchestra.run.smithi130.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:11.306 INFO:teuthology.orchestra.run.smithi130.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:11.306 INFO:teuthology.orchestra.run.smithi130.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T08:36:11.306 INFO:teuthology.orchestra.run.smithi130.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:11.307 INFO:teuthology.orchestra.run.smithi130.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:11.307 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2023-10-16T08:36:11.307 INFO:teuthology.orchestra.run.smithi130.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-16T08:36:11.307 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-16T08:36:11.307 INFO:teuthology.orchestra.run.smithi130.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-16T08:36:11.308 INFO:teuthology.orchestra.run.smithi130.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-16T08:36:11.308 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-16T08:36:11.308 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2023-10-16T08:36:11.308 INFO:teuthology.orchestra.run.smithi130.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-16T08:36:11.308 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-16T08:36:11.309 INFO:teuthology.orchestra.run.smithi130.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-16T08:36:11.309 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2023-10-16T08:36:11.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2023-10-16T08:36:11.385 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2023-10-16T08:36:11.386 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2023-10-16T08:36:11.386 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2023-10-16T08:36:11.386 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 68.el9 2023-10-16T08:36:11.386 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2023-10-16T08:36:11.386 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-16T08:36:11.387 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2023-10-16T08:36:11.387 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8264254 2023-10-16T08:36:11.387 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2023-10-16T08:36:11.387 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-16T08:36:11.387 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-16T08:36:11.388 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-16T08:36:11.388 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-16T08:36:11.388 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2023-10-16T08:36:11.388 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2023-10-16T08:36:11.388 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-16T08:36:11.388 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2023-10-16T08:36:11.389 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2023-10-16T08:36:11.389 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:36:11.389 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-16T08:36:11.389 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-16T08:36:11.389 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-16T08:36:11.389 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2023-10-16T08:36:11.390 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:36:11.390 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2023-10-16T08:36:11.391 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-16T08:36:11.391 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 6.6.0-rc5-g47672119149b 2023-10-16T08:36:11.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-16T08:36:12.007 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-10-16T08:36:12.178 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-16T08:36:12.179 DEBUG:teuthology.orchestra.run.smithi094:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-16T08:36:12.243 INFO:teuthology.orchestra.run.smithi094.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.244 INFO:teuthology.orchestra.run.smithi094.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.244 INFO:teuthology.orchestra.run.smithi094.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.244 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.244 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-16T08:36:12.244 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-16T08:36:12.245 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-16T08:36:12.245 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-16T08:36:12.245 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-16T08:36:12.245 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-16T08:36:12.245 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-16T08:36:12.246 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-16T08:36:12.246 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-16T08:36:12.246 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-16T08:36:12.246 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-16T08:36:12.246 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-16T08:36:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-16T08:36:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-16T08:36:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-16T08:36:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-16T08:36:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-16T08:36:12.247 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-16T08:36:12.248 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-16T08:36:12.248 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-16T08:36:12.248 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-16T08:36:12.248 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-16T08:36:12.248 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-16T08:36:12.249 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-16T08:36:12.249 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-16T08:36:12.249 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-16T08:36:12.249 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-16T08:36:12.249 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-16T08:36:12.250 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-16T08:36:12.250 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-16T08:36:12.250 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-16T08:36:12.250 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-16T08:36:12.250 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-16T08:36:12.251 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-16T08:36:12.251 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-16T08:36:12.251 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-16T08:36:12.251 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-16T08:36:12.251 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-16T08:36:12.252 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-16T08:36:12.252 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-16T08:36:12.252 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-16T08:36:12.252 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-16T08:36:12.252 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-16T08:36:12.253 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-16T08:36:12.253 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-16T08:36:12.253 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-16T08:36:12.253 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-16T08:36:12.253 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-16T08:36:12.253 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-16T08:36:12.254 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-16T08:36:12.254 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-16T08:36:12.254 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-16T08:36:12.254 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-16T08:36:12.254 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-16T08:36:12.255 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-16T08:36:12.255 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-16T08:36:12.255 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-16T08:36:12.255 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-16T08:36:12.255 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-16T08:36:12.256 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-16T08:36:12.256 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-16T08:36:12.256 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-16T08:36:12.256 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-16T08:36:12.256 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-16T08:36:12.257 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-16T08:36:12.257 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-16T08:36:12.257 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-16T08:36:12.257 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-16T08:36:12.257 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-16T08:36:12.257 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-16T08:36:12.258 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-16T08:36:12.258 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-16T08:36:12.258 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-16T08:36:12.258 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-16T08:36:12.258 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-16T08:36:12.259 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-16T08:36:12.259 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-16T08:36:12.259 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-16T08:36:12.259 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-16T08:36:12.259 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-16T08:36:12.260 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-16T08:36:12.260 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-16T08:36:12.260 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-16T08:36:12.260 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-16T08:36:12.260 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-16T08:36:12.261 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-16T08:36:12.261 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-16T08:36:12.261 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-16T08:36:12.261 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-16T08:36:12.261 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-16T08:36:12.261 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-16T08:36:12.262 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-16T08:36:12.262 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-16T08:36:12.262 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-16T08:36:12.262 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-16T08:36:12.262 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-16T08:36:12.263 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-16T08:36:12.263 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-16T08:36:12.263 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-16T08:36:12.263 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-16T08:36:12.263 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-16T08:36:12.264 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-16T08:36:12.264 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-16T08:36:12.264 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-16T08:36:12.264 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-16T08:36:12.264 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-16T08:36:12.264 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-16T08:36:12.265 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-16T08:36:12.265 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-16T08:36:12.265 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-16T08:36:12.265 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-16T08:36:12.265 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-16T08:36:12.266 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-16T08:36:12.266 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-16T08:36:12.266 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-16T08:36:12.266 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-16T08:36:12.266 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-16T08:36:12.267 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-16T08:36:12.267 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-16T08:36:12.267 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-16T08:36:12.267 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-16T08:36:12.267 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-16T08:36:12.268 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-16T08:36:12.268 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-16T08:36:12.268 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-16T08:36:12.268 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-16T08:36:12.268 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-16T08:36:12.268 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-16T08:36:12.269 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-16T08:36:12.269 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-16T08:36:12.269 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-16T08:36:12.269 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-16T08:36:12.269 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-16T08:36:12.269 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-16T08:36:12.270 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-16T08:36:12.270 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-16T08:36:12.270 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-16T08:36:12.270 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-16T08:36:12.270 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-16T08:36:12.271 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-16T08:36:12.271 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-16T08:36:12.271 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-16T08:36:12.271 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-16T08:36:12.271 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-16T08:36:12.271 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-16T08:36:12.272 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-16T08:36:12.272 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-16T08:36:12.272 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-16T08:36:12.272 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-16T08:36:12.272 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-16T08:36:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-16T08:36:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-16T08:36:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-16T08:36:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-16T08:36:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-16T08:36:12.274 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-16T08:36:12.274 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-16T08:36:12.274 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-16T08:36:12.274 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-16T08:36:12.274 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-16T08:36:12.274 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-16T08:36:12.275 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-16T08:36:12.275 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-16T08:36:12.275 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-16T08:36:12.275 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-16T08:36:12.275 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-16T08:36:12.276 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-16T08:36:12.276 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-16T08:36:12.276 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-16T08:36:12.276 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-16T08:36:12.276 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-16T08:36:12.277 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-16T08:36:12.277 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-16T08:36:12.277 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-16T08:36:12.277 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-16T08:36:12.277 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-16T08:36:12.277 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-16T08:36:12.278 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-16T08:36:12.278 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-16T08:36:12.278 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-16T08:36:12.278 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-16T08:36:12.278 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-16T08:36:12.279 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-16T08:36:12.279 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-16T08:36:12.279 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-16T08:36:12.279 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-16T08:36:12.279 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-16T08:36:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-16T08:36:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-16T08:36:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-16T08:36:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-16T08:36:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-16T08:36:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-16T08:36:12.281 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-16T08:36:12.281 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-16T08:36:12.281 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-16T08:36:12.281 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-16T08:36:12.281 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-16T08:36:12.282 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-16T08:36:12.282 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-16T08:36:12.282 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-16T08:36:12.282 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-16T08:36:12.282 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-16T08:36:12.282 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-16T08:36:12.283 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-16T08:36:12.283 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-16T08:36:12.283 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-16T08:36:12.283 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-16T08:36:12.283 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-16T08:36:12.284 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-16T08:36:12.284 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-16T08:36:12.284 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-16T08:36:12.284 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-16T08:36:12.284 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-16T08:36:12.285 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-16T08:36:12.285 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-16T08:36:12.285 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-16T08:36:12.285 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-16T08:36:12.285 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-16T08:36:12.286 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-16T08:36:12.286 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-16T08:36:12.286 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-16T08:36:12.286 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-16T08:36:12.286 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-16T08:36:12.287 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-16T08:36:12.287 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-16T08:36:12.287 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-16T08:36:12.287 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-16T08:36:12.287 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-16T08:36:12.287 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-16T08:36:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-16T08:36:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-16T08:36:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-16T08:36:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-16T08:36:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-16T08:36:12.288 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-16T08:36:12.289 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-16T08:36:12.289 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-16T08:36:12.289 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-16T08:36:12.289 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-16T08:36:12.289 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-16T08:36:12.289 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-16T08:36:12.290 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-16T08:36:12.290 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-16T08:36:12.290 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-16T08:36:12.290 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-16T08:36:12.290 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-16T08:36:12.291 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-16T08:36:12.291 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-16T08:36:12.291 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-16T08:36:12.291 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-16T08:36:12.291 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-16T08:36:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-16T08:36:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-16T08:36:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-16T08:36:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-16T08:36:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-16T08:36:12.292 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-16T08:36:12.293 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-16T08:36:12.293 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-16T08:36:12.293 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-16T08:36:12.293 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-16T08:36:12.293 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-16T08:36:12.293 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-16T08:36:12.294 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-16T08:36:12.294 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-16T08:36:12.294 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-16T08:36:12.294 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-16T08:36:12.294 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-16T08:36:12.295 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-16T08:36:12.295 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-16T08:36:12.295 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-16T08:36:12.295 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-16T08:36:12.295 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-16T08:36:12.296 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-16T08:36:12.296 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-16T08:36:12.296 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-16T08:36:12.296 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-16T08:36:12.296 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-16T08:36:12.296 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-16T08:36:12.297 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-16T08:36:12.297 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-16T08:36:12.297 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-16T08:36:12.297 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-16T08:36:12.297 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-16T08:36:12.298 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-16T08:36:12.298 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-16T08:36:12.298 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-16T08:36:12.298 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-16T08:36:12.298 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-16T08:36:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-16T08:36:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-16T08:36:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-16T08:36:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-16T08:36:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-16T08:36:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-16T08:36:12.300 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-16T08:36:12.300 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-16T08:36:12.300 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-16T08:36:12.300 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-16T08:36:12.300 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-16T08:36:12.301 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-16T08:36:12.301 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-16T08:36:12.301 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-16T08:36:12.301 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-16T08:36:12.301 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-16T08:36:12.302 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-16T08:36:12.302 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-16T08:36:12.302 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-16T08:36:12.302 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-16T08:36:12.302 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-16T08:36:12.303 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-16T08:36:12.303 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-16T08:36:12.303 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-16T08:36:12.303 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-16T08:36:12.303 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-16T08:36:12.304 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-16T08:36:12.304 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-16T08:36:12.304 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-16T08:36:12.304 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-16T08:36:12.304 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-16T08:36:12.304 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-16T08:36:12.305 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-16T08:36:12.305 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-16T08:36:12.305 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-16T08:36:12.305 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-16T08:36:12.305 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-16T08:36:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-16T08:36:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-16T08:36:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-16T08:36:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-16T08:36:12.306 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-16T08:36:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-16T08:36:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-16T08:36:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-16T08:36:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-16T08:36:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-16T08:36:12.307 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-16T08:36:12.308 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-16T08:36:12.308 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-16T08:36:12.308 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-16T08:36:12.308 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-16T08:36:12.308 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-16T08:36:12.309 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-16T08:36:12.309 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-16T08:36:12.309 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-16T08:36:12.309 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-16T08:36:12.309 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-16T08:36:12.310 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-16T08:36:12.310 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-16T08:36:12.310 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-16T08:36:12.310 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-16T08:36:12.310 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-16T08:36:12.310 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-16T08:36:12.311 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-16T08:36:12.311 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-16T08:36:12.311 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-16T08:36:12.311 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-16T08:36:12.311 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-16T08:36:12.312 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-16T08:36:12.312 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-16T08:36:12.312 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-16T08:36:12.312 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-16T08:36:12.312 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-16T08:36:12.313 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-16T08:36:12.313 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-16T08:36:12.313 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-16T08:36:12.313 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-16T08:36:12.313 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-16T08:36:12.313 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-16T08:36:12.314 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-16T08:36:12.314 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-16T08:36:12.314 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-16T08:36:12.314 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-16T08:36:12.315 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-16T08:36:12.315 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-16T08:36:12.315 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-16T08:36:12.315 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-16T08:36:12.315 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-16T08:36:12.315 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-16T08:36:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-16T08:36:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-16T08:36:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-16T08:36:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-16T08:36:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-16T08:36:12.317 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-16T08:36:12.317 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-16T08:36:12.317 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-16T08:36:12.317 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-16T08:36:12.317 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-16T08:36:12.317 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-16T08:36:12.318 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-16T08:36:12.318 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-16T08:36:12.318 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-16T08:36:12.318 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-16T08:36:12.318 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-16T08:36:12.319 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-16T08:36:12.319 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-16T08:36:12.319 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-16T08:36:12.319 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-16T08:36:12.319 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-16T08:36:12.319 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-16T08:36:12.320 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-16T08:36:12.320 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-16T08:36:12.320 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-16T08:36:12.320 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-16T08:36:12.320 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-16T08:36:12.321 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-16T08:36:12.321 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-16T08:36:12.321 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-16T08:36:12.321 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-16T08:36:12.321 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-16T08:36:12.321 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-16T08:36:12.322 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-16T08:36:12.322 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-16T08:36:12.322 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-16T08:36:12.322 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-16T08:36:12.322 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-16T08:36:12.323 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-16T08:36:12.323 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-16T08:36:12.323 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-16T08:36:12.323 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-16T08:36:12.323 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-16T08:36:12.323 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-16T08:36:12.324 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-16T08:36:12.324 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-16T08:36:12.324 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-16T08:36:12.324 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-16T08:36:12.324 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-16T08:36:12.325 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-16T08:36:12.325 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-16T08:36:12.325 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-16T08:36:12.325 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-16T08:36:12.325 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-16T08:36:12.325 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-16T08:36:12.326 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-16T08:36:12.326 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-16T08:36:12.326 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-16T08:36:12.326 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-16T08:36:12.326 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-16T08:36:12.327 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-16T08:36:12.327 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-16T08:36:12.327 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-16T08:36:12.327 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-16T08:36:12.327 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-16T08:36:12.328 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-16T08:36:12.328 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-16T08:36:12.328 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-16T08:36:12.328 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-16T08:36:12.328 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-16T08:36:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-16T08:36:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-16T08:36:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-16T08:36:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-16T08:36:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-16T08:36:12.329 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-16T08:36:12.330 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-16T08:36:12.330 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-16T08:36:12.330 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-16T08:36:12.330 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-16T08:36:12.330 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-16T08:36:12.331 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-16T08:36:12.331 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-16T08:36:12.331 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-16T08:36:12.331 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-16T08:36:12.331 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-16T08:36:12.331 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-16T08:36:12.332 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-16T08:36:12.332 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-16T08:36:12.332 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-16T08:36:12.332 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-16T08:36:12.332 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-16T08:36:12.333 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-16T08:36:12.333 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-16T08:36:12.333 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-16T08:36:12.333 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-16T08:36:12.333 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-16T08:36:12.334 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-16T08:36:12.334 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-16T08:36:12.334 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-16T08:36:12.334 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-16T08:36:12.334 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-16T08:36:12.334 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-16T08:36:12.335 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-16T08:36:12.335 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-16T08:36:12.335 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-16T08:36:12.335 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-16T08:36:12.335 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-16T08:36:12.336 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-16T08:36:12.336 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-16T08:36:12.336 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-16T08:36:12.336 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-16T08:36:12.336 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-16T08:36:12.337 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-16T08:36:12.337 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-16T08:36:12.337 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-16T08:36:12.337 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-16T08:36:12.337 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-16T08:36:12.337 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-16T08:36:12.338 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-16T08:36:12.338 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-16T08:36:12.338 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-16T08:36:12.338 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-16T08:36:12.338 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-16T08:36:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-16T08:36:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-16T08:36:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-16T08:36:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-16T08:36:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-16T08:36:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-16T08:36:12.340 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-16T08:36:12.340 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-16T08:36:12.340 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-16T08:36:12.340 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-16T08:36:12.340 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-16T08:36:12.341 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-16T08:36:12.341 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-16T08:36:12.341 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-16T08:36:12.341 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-16T08:36:12.341 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-16T08:36:12.342 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-16T08:36:12.342 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-16T08:36:12.342 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-16T08:36:12.342 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-16T08:36:12.343 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-16T08:36:12.343 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-16T08:36:12.343 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-16T08:36:12.343 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-16T08:36:12.343 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-16T08:36:12.343 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-16T08:36:12.344 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-16T08:36:12.344 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-16T08:36:12.344 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-16T08:36:12.344 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-16T08:36:12.344 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-16T08:36:12.345 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-16T08:36:12.345 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-16T08:36:12.345 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-16T08:36:12.345 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-16T08:36:12.345 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-16T08:36:12.346 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-16T08:36:12.346 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-16T08:36:12.346 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-16T08:36:12.346 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-16T08:36:12.346 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-16T08:36:12.347 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-16T08:36:12.347 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-16T08:36:12.347 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-16T08:36:12.347 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-16T08:36:12.347 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-16T08:36:12.347 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-16T08:36:12.348 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-16T08:36:12.348 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-16T08:36:12.348 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-16T08:36:12.348 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-16T08:36:12.348 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-16T08:36:12.348 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-16T08:36:12.349 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-16T08:36:12.349 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-16T08:36:12.349 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-16T08:36:12.349 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-16T08:36:12.350 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-16T08:36:12.350 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-16T08:36:12.350 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-16T08:36:12.350 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-16T08:36:12.350 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-16T08:36:12.351 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-16T08:36:12.351 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-16T08:36:12.351 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-16T08:36:12.351 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-16T08:36:12.351 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-16T08:36:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-16T08:36:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-16T08:36:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-16T08:36:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-16T08:36:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-16T08:36:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-16T08:36:12.353 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-16T08:36:12.353 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-16T08:36:12.353 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-16T08:36:12.353 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-16T08:36:12.353 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-16T08:36:12.354 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-16T08:36:12.354 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-16T08:36:12.354 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-16T08:36:12.354 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-16T08:36:12.354 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-16T08:36:12.355 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-16T08:36:12.355 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-16T08:36:12.355 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-16T08:36:12.355 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-16T08:36:12.355 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-16T08:36:12.355 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-16T08:36:12.356 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-16T08:36:12.356 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-16T08:36:12.356 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-16T08:36:12.356 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-16T08:36:12.356 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-16T08:36:12.357 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-16T08:36:12.357 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-16T08:36:12.357 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-16T08:36:12.357 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-16T08:36:12.357 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-16T08:36:12.357 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-16T08:36:12.358 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-16T08:36:12.358 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-16T08:36:12.358 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-16T08:36:12.358 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-16T08:36:12.358 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-16T08:36:12.358 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-16T08:36:12.359 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-16T08:36:12.359 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-16T08:36:12.359 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-16T08:36:12.359 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-16T08:36:12.359 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-16T08:36:12.360 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-16T08:36:12.360 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-16T08:36:12.360 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-16T08:36:12.360 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-16T08:36:12.360 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-16T08:36:12.361 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-16T08:36:12.361 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-16T08:36:12.361 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-16T08:36:12.361 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-16T08:36:12.361 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-16T08:36:12.362 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-16T08:36:12.362 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-16T08:36:12.362 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-16T08:36:12.362 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-16T08:36:12.362 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-16T08:36:12.363 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-16T08:36:12.363 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-16T08:36:12.363 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-16T08:36:12.363 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-16T08:36:12.363 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-16T08:36:12.364 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-16T08:36:12.364 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-16T08:36:12.364 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-16T08:36:12.364 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-16T08:36:12.364 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-16T08:36:12.365 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-16T08:36:12.365 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-16T08:36:12.365 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-16T08:36:12.365 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-16T08:36:12.365 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-16T08:36:12.365 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-16T08:36:12.366 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-16T08:36:12.366 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-16T08:36:12.366 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-16T08:36:12.366 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-16T08:36:12.366 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-16T08:36:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-16T08:36:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-16T08:36:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-16T08:36:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-16T08:36:12.367 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-16T08:36:12.368 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-16T08:36:12.368 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-16T08:36:12.368 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-16T08:36:12.368 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-16T08:36:12.368 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-16T08:36:12.369 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-16T08:36:12.369 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-16T08:36:12.369 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-16T08:36:12.369 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-16T08:36:12.369 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-16T08:36:12.369 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-16T08:36:12.370 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-16T08:36:12.370 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-16T08:36:12.370 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-16T08:36:12.370 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-16T08:36:12.370 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-16T08:36:12.371 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-16T08:36:12.371 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-16T08:36:12.371 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-16T08:36:12.371 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-16T08:36:12.371 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-16T08:36:12.372 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-16T08:36:12.372 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-16T08:36:12.372 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-16T08:36:12.372 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-16T08:36:12.372 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-16T08:36:12.373 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-16T08:36:12.373 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-16T08:36:12.373 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-16T08:36:12.373 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-16T08:36:12.373 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-16T08:36:12.373 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-16T08:36:12.374 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-16T08:36:12.374 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-16T08:36:12.374 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-16T08:36:12.374 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-16T08:36:12.375 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-16T08:36:12.375 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-16T08:36:12.375 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-16T08:36:12.375 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-16T08:36:12.375 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-16T08:36:12.376 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-16T08:36:12.376 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-16T08:36:12.376 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-16T08:36:12.376 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-16T08:36:12.376 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-16T08:36:12.377 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-16T08:36:12.377 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-16T08:36:12.377 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-16T08:36:12.377 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-16T08:36:12.377 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-16T08:36:12.378 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-16T08:36:12.378 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-16T08:36:12.378 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-16T08:36:12.378 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-16T08:36:12.378 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-16T08:36:12.379 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-16T08:36:12.379 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-16T08:36:12.379 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-16T08:36:12.379 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-16T08:36:12.379 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-16T08:36:12.379 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-16T08:36:12.380 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-16T08:36:12.380 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-16T08:36:12.380 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-16T08:36:12.380 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-16T08:36:12.380 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-16T08:36:12.381 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-16T08:36:12.381 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-16T08:36:12.381 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-16T08:36:12.381 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-16T08:36:12.381 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-16T08:36:12.381 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-16T08:36:12.382 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-16T08:36:12.382 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-16T08:36:12.382 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-16T08:36:12.382 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-16T08:36:12.382 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-16T08:36:12.383 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-16T08:36:12.383 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-16T08:36:12.383 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-16T08:36:12.383 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-16T08:36:12.383 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-16T08:36:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-16T08:36:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-16T08:36:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-16T08:36:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-16T08:36:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-16T08:36:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-16T08:36:12.385 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-16T08:36:12.385 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-16T08:36:12.385 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-16T08:36:12.385 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-16T08:36:12.385 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-16T08:36:12.386 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-16T08:36:12.386 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-16T08:36:12.386 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-16T08:36:12.386 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-16T08:36:12.386 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-16T08:36:12.387 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-16T08:36:12.387 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-16T08:36:12.387 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-16T08:36:12.387 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-16T08:36:12.387 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-16T08:36:12.387 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-16T08:36:12.388 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-16T08:36:12.388 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-16T08:36:12.388 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-16T08:36:12.388 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-16T08:36:12.388 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-16T08:36:12.388 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-16T08:36:12.389 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-16T08:36:12.389 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-16T08:36:12.389 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-16T08:36:12.389 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-16T08:36:12.390 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-16T08:36:12.390 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-16T08:36:12.390 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-16T08:36:12.390 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-16T08:36:12.390 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-16T08:36:12.391 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-16T08:36:12.391 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-16T08:36:12.391 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-16T08:36:12.391 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-16T08:36:12.391 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-16T08:36:12.391 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-16T08:36:12.392 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-16T08:36:12.392 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-16T08:36:12.392 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-16T08:36:12.392 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-16T08:36:12.392 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-16T08:36:12.392 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-16T08:36:12.393 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-16T08:36:12.393 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-16T08:36:12.393 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-16T08:36:12.393 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-16T08:36:12.393 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-16T08:36:12.394 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-16T08:36:12.394 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-16T08:36:12.394 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-16T08:36:12.394 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-16T08:36:12.394 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-16T08:36:12.395 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-16T08:36:12.395 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-16T08:36:12.395 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-16T08:36:12.395 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-16T08:36:12.395 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-16T08:36:12.396 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-16T08:36:12.396 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-16T08:36:12.396 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-16T08:36:12.396 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-16T08:36:12.396 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-16T08:36:12.396 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-16T08:36:12.397 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-16T08:36:12.397 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-16T08:36:12.397 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-16T08:36:12.397 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-16T08:36:12.397 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-16T08:36:12.397 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-16T08:36:12.398 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-16T08:36:12.398 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-16T08:36:12.398 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-16T08:36:12.398 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-16T08:36:12.398 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-16T08:36:12.399 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-16T08:36:12.399 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-16T08:36:12.399 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-16T08:36:12.399 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-16T08:36:12.399 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-16T08:36:12.400 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-16T08:36:12.400 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-16T08:36:12.400 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-16T08:36:12.400 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-16T08:36:12.400 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-16T08:36:12.401 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-16T08:36:12.401 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-16T08:36:12.401 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-16T08:36:12.401 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-16T08:36:12.401 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-16T08:36:12.401 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-16T08:36:12.402 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-16T08:36:12.402 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-16T08:36:12.402 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-16T08:36:12.402 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-16T08:36:12.402 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-16T08:36:12.403 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-16T08:36:12.403 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-16T08:36:12.403 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-16T08:36:12.403 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-16T08:36:12.403 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-16T08:36:12.403 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-16T08:36:12.404 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-16T08:36:12.404 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-16T08:36:12.404 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-16T08:36:12.404 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-16T08:36:12.404 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-16T08:36:12.405 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-16T08:36:12.405 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-16T08:36:12.405 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-16T08:36:12.405 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-16T08:36:12.405 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-16T08:36:12.406 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-16T08:36:12.406 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-16T08:36:12.406 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-16T08:36:12.406 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-16T08:36:12.406 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-16T08:36:12.406 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-16T08:36:12.407 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-16T08:36:12.407 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-16T08:36:12.407 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-16T08:36:12.407 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-16T08:36:12.407 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-16T08:36:12.409 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-16T08:36:12.409 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-16T08:36:12.409 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-16T08:36:12.409 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-16T08:36:12.410 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-16T08:36:12.410 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-16T08:36:12.410 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-16T08:36:12.410 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-16T08:36:12.410 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-16T08:36:12.411 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-16T08:36:12.411 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-16T08:36:12.411 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-16T08:36:12.411 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-16T08:36:12.411 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-16T08:36:12.412 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-16T08:36:12.412 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-16T08:36:12.412 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-16T08:36:12.412 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-16T08:36:12.412 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-16T08:36:12.412 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-16T08:36:12.413 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-16T08:36:12.413 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-16T08:36:12.413 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-16T08:36:12.413 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-16T08:36:12.413 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-16T08:36:12.414 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-16T08:36:12.414 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-16T08:36:12.414 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-16T08:36:12.414 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-16T08:36:12.414 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-16T08:36:12.414 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-16T08:36:12.415 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-16T08:36:12.415 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-16T08:36:12.415 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-16T08:36:12.415 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-16T08:36:12.415 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-16T08:36:12.416 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-16T08:36:12.416 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-16T08:36:12.416 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-16T08:36:12.416 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-16T08:36:12.416 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-16T08:36:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-16T08:36:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-16T08:36:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-16T08:36:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-16T08:36:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-16T08:36:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-16T08:36:12.418 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-16T08:36:12.418 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-16T08:36:12.418 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-16T08:36:12.418 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-16T08:36:12.419 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-16T08:36:12.419 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-16T08:36:12.419 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-16T08:36:12.419 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-16T08:36:12.419 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-16T08:36:12.420 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-16T08:36:12.420 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-16T08:36:12.420 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-16T08:36:12.420 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-16T08:36:12.420 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-16T08:36:12.421 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-16T08:36:12.421 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-16T08:36:12.421 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-16T08:36:12.421 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-16T08:36:12.421 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-16T08:36:12.422 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-16T08:36:12.422 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-16T08:36:12.422 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-16T08:36:12.422 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-16T08:36:12.422 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-16T08:36:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-16T08:36:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-16T08:36:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-16T08:36:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-16T08:36:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-16T08:36:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-16T08:36:12.424 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-16T08:36:12.424 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-16T08:36:12.424 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-16T08:36:12.425 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-16T08:36:12.425 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-16T08:36:12.425 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-16T08:36:12.425 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-16T08:36:12.425 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-16T08:36:12.426 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-16T08:36:12.426 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-16T08:36:12.426 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-16T08:36:12.426 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-16T08:36:12.426 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-16T08:36:12.427 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-16T08:36:12.427 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-16T08:36:12.427 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-16T08:36:12.427 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-16T08:36:12.427 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-16T08:36:12.428 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-16T08:36:12.428 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-16T08:36:12.428 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-16T08:36:12.428 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-16T08:36:12.428 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-16T08:36:12.429 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-16T08:36:12.429 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-16T08:36:12.429 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-16T08:36:12.429 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-16T08:36:12.429 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-16T08:36:12.429 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-16T08:36:12.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-16T08:36:12.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-16T08:36:12.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-16T08:36:12.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-16T08:36:12.430 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-16T08:36:12.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-16T08:36:12.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-16T08:36:12.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-16T08:36:12.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-16T08:36:12.431 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-16T08:36:12.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-16T08:36:12.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-16T08:36:12.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-16T08:36:12.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-16T08:36:12.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-16T08:36:12.432 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-16T08:36:12.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-16T08:36:12.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-16T08:36:12.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-16T08:36:12.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-16T08:36:12.433 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-16T08:36:12.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-16T08:36:12.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-16T08:36:12.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-16T08:36:12.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-16T08:36:12.434 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-16T08:36:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-16T08:36:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-16T08:36:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-16T08:36:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-16T08:36:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-16T08:36:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-16T08:36:12.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-16T08:36:12.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-16T08:36:12.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-16T08:36:12.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-16T08:36:12.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-16T08:36:12.436 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-16T08:36:12.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-16T08:36:12.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-16T08:36:12.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-16T08:36:12.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-16T08:36:12.437 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-16T08:36:12.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-16T08:36:12.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-16T08:36:12.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-16T08:36:12.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-16T08:36:12.438 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-16T08:36:12.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-16T08:36:12.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-16T08:36:12.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-16T08:36:12.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-16T08:36:12.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-16T08:36:12.439 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-16T08:36:12.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-16T08:36:12.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-16T08:36:12.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-16T08:36:12.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-16T08:36:12.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-16T08:36:12.440 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-16T08:36:12.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-16T08:36:12.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-16T08:36:12.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-16T08:36:12.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-16T08:36:12.441 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-16T08:36:12.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-16T08:36:12.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-16T08:36:12.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-16T08:36:12.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-16T08:36:12.442 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-16T08:36:12.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-16T08:36:12.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-16T08:36:12.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-16T08:36:12.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-16T08:36:12.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-16T08:36:12.443 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-16T08:36:12.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-16T08:36:12.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-16T08:36:12.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-16T08:36:12.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-16T08:36:12.444 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-16T08:36:12.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-16T08:36:12.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-16T08:36:12.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-16T08:36:12.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-16T08:36:12.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-16T08:36:12.445 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-16T08:36:12.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-16T08:36:12.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-16T08:36:12.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-16T08:36:12.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-16T08:36:12.446 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-16T08:36:12.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-16T08:36:12.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-16T08:36:12.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-16T08:36:12.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-16T08:36:12.447 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-16T08:36:12.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-16T08:36:12.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-16T08:36:12.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-16T08:36:12.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-16T08:36:12.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-16T08:36:12.448 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-16T08:36:12.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-16T08:36:12.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-16T08:36:12.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-16T08:36:12.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-16T08:36:12.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-16T08:36:12.449 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-16T08:36:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-16T08:36:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-16T08:36:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-16T08:36:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-16T08:36:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-16T08:36:12.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-16T08:36:12.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-16T08:36:12.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-16T08:36:12.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-16T08:36:12.451 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-16T08:36:12.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-16T08:36:12.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-16T08:36:12.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-16T08:36:12.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-16T08:36:12.452 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-16T08:36:12.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-16T08:36:12.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-16T08:36:12.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-16T08:36:12.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-16T08:36:12.453 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-16T08:36:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-16T08:36:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-16T08:36:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-16T08:36:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-16T08:36:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-16T08:36:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-16T08:36:12.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-16T08:36:12.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-16T08:36:12.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-16T08:36:12.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-16T08:36:12.455 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-16T08:36:12.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-16T08:36:12.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-16T08:36:12.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-16T08:36:12.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-16T08:36:12.456 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-16T08:36:12.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-16T08:36:12.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-16T08:36:12.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-16T08:36:12.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-16T08:36:12.457 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-16T08:36:12.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-16T08:36:12.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-16T08:36:12.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-16T08:36:12.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-16T08:36:12.458 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-16T08:36:12.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-16T08:36:12.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-16T08:36:12.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-16T08:36:12.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-16T08:36:12.459 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-16T08:36:12.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-16T08:36:12.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-16T08:36:12.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-16T08:36:12.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-16T08:36:12.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-16T08:36:12.460 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-16T08:36:12.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-16T08:36:12.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-16T08:36:12.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-16T08:36:12.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-16T08:36:12.461 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-16T08:36:12.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-16T08:36:12.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-16T08:36:12.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-16T08:36:12.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-16T08:36:12.462 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-16T08:36:12.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-16T08:36:12.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-16T08:36:12.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-16T08:36:12.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-16T08:36:12.463 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-16T08:36:12.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-16T08:36:12.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-16T08:36:12.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-16T08:36:12.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-16T08:36:12.464 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-16T08:36:12.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-16T08:36:12.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-16T08:36:12.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-16T08:36:12.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-16T08:36:12.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-16T08:36:12.465 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-16T08:36:12.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-16T08:36:12.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-16T08:36:12.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-16T08:36:12.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-16T08:36:12.466 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-16T08:36:12.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-16T08:36:12.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-16T08:36:12.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-16T08:36:12.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-16T08:36:12.467 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-16T08:36:12.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-16T08:36:12.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-16T08:36:12.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-16T08:36:12.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-16T08:36:12.468 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-16T08:36:12.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-16T08:36:12.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-16T08:36:12.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-16T08:36:12.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-16T08:36:12.469 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-16T08:36:12.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-16T08:36:12.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-16T08:36:12.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-16T08:36:12.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-16T08:36:12.470 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-16T08:36:12.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-16T08:36:12.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-16T08:36:12.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-16T08:36:12.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-16T08:36:12.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-16T08:36:12.471 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-16T08:36:12.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-16T08:36:12.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-16T08:36:12.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-16T08:36:12.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-16T08:36:12.472 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-16T08:36:12.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-16T08:36:12.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-16T08:36:12.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-16T08:36:12.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-16T08:36:12.473 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-16T08:36:12.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-16T08:36:12.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-16T08:36:12.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-16T08:36:12.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-16T08:36:12.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-16T08:36:12.474 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-16T08:36:12.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-16T08:36:12.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-16T08:36:12.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-16T08:36:12.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-16T08:36:12.475 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-16T08:36:12.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-16T08:36:12.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-16T08:36:12.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-16T08:36:12.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-16T08:36:12.476 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-16T08:36:12.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-16T08:36:12.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-16T08:36:12.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-16T08:36:12.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-16T08:36:12.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-16T08:36:12.477 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-16T08:36:12.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-16T08:36:12.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-16T08:36:12.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-16T08:36:12.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-16T08:36:12.478 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-16T08:36:12.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-16T08:36:12.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-16T08:36:12.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-16T08:36:12.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-16T08:36:12.479 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-16T08:36:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-16T08:36:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-16T08:36:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-16T08:36:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-16T08:36:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-16T08:36:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-16T08:36:12.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-16T08:36:12.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-16T08:36:12.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-16T08:36:12.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-16T08:36:12.481 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-16T08:36:12.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-16T08:36:12.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-16T08:36:12.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-16T08:36:12.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-16T08:36:12.482 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-16T08:36:12.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-16T08:36:12.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-16T08:36:12.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-16T08:36:12.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-16T08:36:12.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-16T08:36:12.483 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-16T08:36:12.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-16T08:36:12.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-16T08:36:12.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-16T08:36:12.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-16T08:36:12.484 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-16T08:36:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-16T08:36:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-16T08:36:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-16T08:36:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-16T08:36:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-16T08:36:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-16T08:36:12.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-16T08:36:12.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-16T08:36:12.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-16T08:36:12.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-16T08:36:12.486 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-16T08:36:12.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-16T08:36:12.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-16T08:36:12.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-16T08:36:12.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-16T08:36:12.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-16T08:36:12.487 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-16T08:36:12.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-16T08:36:12.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-16T08:36:12.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-16T08:36:12.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-16T08:36:12.488 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-16T08:36:12.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-16T08:36:12.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-16T08:36:12.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-16T08:36:12.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-16T08:36:12.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-16T08:36:12.489 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-16T08:36:12.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-16T08:36:12.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-16T08:36:12.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-16T08:36:12.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-16T08:36:12.490 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-16T08:36:12.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-16T08:36:12.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-16T08:36:12.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-16T08:36:12.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-16T08:36:12.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-16T08:36:12.491 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-16T08:36:12.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-16T08:36:12.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-16T08:36:12.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-16T08:36:12.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-16T08:36:12.492 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-16T08:36:12.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-16T08:36:12.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-16T08:36:12.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-16T08:36:12.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-16T08:36:12.493 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-16T08:36:12.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-16T08:36:12.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-16T08:36:12.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-16T08:36:12.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-16T08:36:12.494 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-16T08:36:12.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-16T08:36:12.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-16T08:36:12.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-16T08:36:12.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-16T08:36:12.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-16T08:36:12.495 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-16T08:36:12.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-16T08:36:12.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-16T08:36:12.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-16T08:36:12.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-16T08:36:12.496 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-16T08:36:12.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-16T08:36:12.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-16T08:36:12.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-16T08:36:12.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-16T08:36:12.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-16T08:36:12.497 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-16T08:36:12.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-16T08:36:12.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-16T08:36:12.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-16T08:36:12.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-16T08:36:12.498 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-16T08:36:12.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-16T08:36:12.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-16T08:36:12.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-16T08:36:12.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-16T08:36:12.499 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-16T08:36:12.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-16T08:36:12.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-16T08:36:12.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-16T08:36:12.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-16T08:36:12.500 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-16T08:36:12.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-16T08:36:12.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-16T08:36:12.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-16T08:36:12.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-16T08:36:12.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-16T08:36:12.501 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-16T08:36:12.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-16T08:36:12.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-16T08:36:12.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-16T08:36:12.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-16T08:36:12.502 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-16T08:36:12.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-16T08:36:12.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-16T08:36:12.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-16T08:36:12.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-16T08:36:12.503 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-16T08:36:12.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-16T08:36:12.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-16T08:36:12.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-16T08:36:12.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-16T08:36:12.504 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-16T08:36:12.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-16T08:36:12.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-16T08:36:12.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-16T08:36:12.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-16T08:36:12.505 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-16T08:36:12.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-16T08:36:12.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-16T08:36:12.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-16T08:36:12.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-16T08:36:12.506 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-16T08:36:12.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-16T08:36:12.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-16T08:36:12.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-16T08:36:12.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-16T08:36:12.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-16T08:36:12.507 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-16T08:36:12.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-16T08:36:12.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-16T08:36:12.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-16T08:36:12.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-16T08:36:12.508 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-16T08:36:12.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-16T08:36:12.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-16T08:36:12.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-16T08:36:12.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-16T08:36:12.509 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-16T08:36:12.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-16T08:36:12.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-16T08:36:12.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-16T08:36:12.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-16T08:36:12.510 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-16T08:36:12.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-16T08:36:12.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-16T08:36:12.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-16T08:36:12.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-16T08:36:12.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-16T08:36:12.511 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-16T08:36:12.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-16T08:36:12.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-16T08:36:12.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-16T08:36:12.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-16T08:36:12.512 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-16T08:36:12.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-16T08:36:12.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-16T08:36:12.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-16T08:36:12.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-16T08:36:12.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-16T08:36:12.513 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-16T08:36:12.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-16T08:36:12.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-16T08:36:12.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-16T08:36:12.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-16T08:36:12.514 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-16T08:36:12.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-16T08:36:12.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-16T08:36:12.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-16T08:36:12.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-16T08:36:12.515 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-16T08:36:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-16T08:36:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-16T08:36:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-16T08:36:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-16T08:36:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-16T08:36:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-16T08:36:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-16T08:36:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-16T08:36:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-16T08:36:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-16T08:36:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-16T08:36:12.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-16T08:36:12.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-16T08:36:12.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-16T08:36:12.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-16T08:36:12.518 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-16T08:36:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-16T08:36:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-16T08:36:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-16T08:36:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-16T08:36:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-16T08:36:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-16T08:36:12.520 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-16T08:36:12.520 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-16T08:36:12.520 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-16T08:36:12.520 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-16T08:36:12.520 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-16T08:36:12.521 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-16T08:36:12.521 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-16T08:36:12.521 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-16T08:36:12.521 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-16T08:36:12.521 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-16T08:36:12.521 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-16T08:36:12.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-16T08:36:12.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-16T08:36:12.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-16T08:36:12.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-16T08:36:12.522 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-16T08:36:12.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-16T08:36:12.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-16T08:36:12.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-16T08:36:12.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-16T08:36:12.523 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-16T08:36:12.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-16T08:36:12.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-16T08:36:12.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-16T08:36:12.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-16T08:36:12.524 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-16T08:36:12.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-16T08:36:12.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-16T08:36:12.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-16T08:36:12.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-16T08:36:12.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-16T08:36:12.525 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-16T08:36:12.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-16T08:36:12.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-16T08:36:12.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-16T08:36:12.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-16T08:36:12.526 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-16T08:36:12.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-16T08:36:12.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-16T08:36:12.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-16T08:36:12.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-16T08:36:12.527 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-16T08:36:12.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-16T08:36:12.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-16T08:36:12.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-16T08:36:12.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-16T08:36:12.528 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-16T08:36:12.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-16T08:36:12.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-16T08:36:12.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-16T08:36:12.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-16T08:36:12.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-16T08:36:12.529 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-16T08:36:12.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-16T08:36:12.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-16T08:36:12.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-16T08:36:12.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-16T08:36:12.530 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-16T08:36:12.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-16T08:36:12.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-16T08:36:12.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-16T08:36:12.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-16T08:36:12.531 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-16T08:36:12.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-16T08:36:12.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-16T08:36:12.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-16T08:36:12.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-16T08:36:12.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-16T08:36:12.532 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-16T08:36:12.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-16T08:36:12.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-16T08:36:12.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-16T08:36:12.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-16T08:36:12.533 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-16T08:36:12.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-16T08:36:12.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-16T08:36:12.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-16T08:36:12.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-16T08:36:12.534 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-16T08:36:12.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-16T08:36:12.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-16T08:36:12.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-16T08:36:12.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-16T08:36:12.535 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-16T08:36:12.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-16T08:36:12.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-16T08:36:12.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-16T08:36:12.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-16T08:36:12.536 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-16T08:36:12.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-16T08:36:12.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-16T08:36:12.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-16T08:36:12.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-16T08:36:12.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-16T08:36:12.537 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-16T08:36:12.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-16T08:36:12.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-16T08:36:12.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-16T08:36:12.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-16T08:36:12.538 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-16T08:36:12.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-16T08:36:12.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-16T08:36:12.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-16T08:36:12.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-16T08:36:12.539 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-16T08:36:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-16T08:36:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-16T08:36:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-16T08:36:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-16T08:36:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-16T08:36:12.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-16T08:36:12.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-16T08:36:12.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-16T08:36:12.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-16T08:36:12.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-16T08:36:12.541 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-16T08:36:12.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-16T08:36:12.542 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-16T08:36:12.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-16T08:36:12.543 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-16T08:36:12.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-16T08:36:12.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-16T08:36:12.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-16T08:36:12.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-16T08:36:12.544 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-16T08:36:12.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-16T08:36:12.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-16T08:36:12.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-16T08:36:12.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-16T08:36:12.545 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-16T08:36:12.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-16T08:36:12.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-16T08:36:12.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-16T08:36:12.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-16T08:36:12.546 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-16T08:36:12.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-16T08:36:12.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-16T08:36:12.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-16T08:36:12.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-16T08:36:12.547 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-16T08:36:12.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-16T08:36:12.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-16T08:36:12.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-16T08:36:12.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-16T08:36:12.548 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-16T08:36:12.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-16T08:36:12.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-16T08:36:12.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-16T08:36:12.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-16T08:36:12.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-16T08:36:12.549 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-16T08:36:12.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-16T08:36:12.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-16T08:36:12.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-16T08:36:12.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-16T08:36:12.550 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-16T08:36:12.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-16T08:36:12.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-16T08:36:12.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-16T08:36:12.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-16T08:36:12.551 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-16T08:36:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-16T08:36:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-16T08:36:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-16T08:36:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-16T08:36:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-16T08:36:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-16T08:36:12.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-16T08:36:12.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-16T08:36:12.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-16T08:36:12.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-16T08:36:12.553 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-16T08:36:12.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-16T08:36:12.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-16T08:36:12.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-16T08:36:12.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-16T08:36:12.554 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-16T08:36:12.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-16T08:36:12.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-16T08:36:12.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-16T08:36:12.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-16T08:36:12.555 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-16T08:36:12.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-16T08:36:12.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-16T08:36:12.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-16T08:36:12.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-16T08:36:12.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-16T08:36:12.556 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-16T08:36:12.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-16T08:36:12.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-16T08:36:12.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-16T08:36:12.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-16T08:36:12.557 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-16T08:36:12.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-16T08:36:12.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-16T08:36:12.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-16T08:36:12.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-16T08:36:12.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-16T08:36:12.558 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-16T08:36:12.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-16T08:36:12.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-16T08:36:12.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-16T08:36:12.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-16T08:36:12.559 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-16T08:36:12.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-16T08:36:12.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-16T08:36:12.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-16T08:36:12.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-16T08:36:12.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-16T08:36:12.560 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-16T08:36:12.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-16T08:36:12.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-16T08:36:12.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-16T08:36:12.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-16T08:36:12.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-16T08:36:12.561 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-16T08:36:12.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-16T08:36:12.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-16T08:36:12.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-16T08:36:12.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-16T08:36:12.562 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-16T08:36:12.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-16T08:36:12.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-16T08:36:12.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-16T08:36:12.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-16T08:36:12.563 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-16T08:36:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-16T08:36:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-16T08:36:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-16T08:36:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-16T08:36:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-16T08:36:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-16T08:36:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-16T08:36:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-16T08:36:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-16T08:36:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-16T08:36:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-16T08:36:12.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-16T08:36:12.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-16T08:36:12.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-16T08:36:12.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-16T08:36:12.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-16T08:36:12.566 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-16T08:36:12.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-16T08:36:12.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-16T08:36:12.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-16T08:36:12.567 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-16T08:36:12.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-16T08:36:12.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-16T08:36:12.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-16T08:36:12.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-16T08:36:12.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-16T08:36:12.568 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-16T08:36:12.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-16T08:36:12.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-16T08:36:12.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-16T08:36:12.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-16T08:36:12.569 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-16T08:36:12.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-16T08:36:12.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-16T08:36:12.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-16T08:36:12.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-16T08:36:12.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-16T08:36:12.570 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-16T08:36:12.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-16T08:36:12.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-16T08:36:12.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-16T08:36:12.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-16T08:36:12.571 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-16T08:36:12.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-16T08:36:12.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-16T08:36:12.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-16T08:36:12.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-16T08:36:12.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-16T08:36:12.572 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-16T08:36:12.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-16T08:36:12.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-16T08:36:12.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-16T08:36:12.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-16T08:36:12.573 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-16T08:36:12.574 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-16T08:36:12.575 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-16T08:36:12.575 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-16T08:36:12.575 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-16T08:36:12.575 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-16T08:36:12.576 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-16T08:36:12.576 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-16T08:36:12.576 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-16T08:36:12.576 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-16T08:36:12.576 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-16T08:36:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-16T08:36:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-16T08:36:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-16T08:36:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-16T08:36:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-16T08:36:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-16T08:36:12.578 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-16T08:36:12.578 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-16T08:36:12.578 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-16T08:36:12.578 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-16T08:36:12.578 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-16T08:36:12.579 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-16T08:36:12.579 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-16T08:36:12.579 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-16T08:36:12.579 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-16T08:36:12.579 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-16T08:36:12.580 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-16T08:36:12.580 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-16T08:36:12.580 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-16T08:36:12.580 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-16T08:36:12.580 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-16T08:36:12.580 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-16T08:36:12.581 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-16T08:36:12.581 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-16T08:36:12.581 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-16T08:36:12.581 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-16T08:36:12.581 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-16T08:36:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-16T08:36:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-16T08:36:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-16T08:36:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-16T08:36:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-16T08:36:12.583 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-16T08:36:12.583 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-16T08:36:12.583 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-16T08:36:12.583 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-16T08:36:12.583 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-16T08:36:12.583 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-16T08:36:12.584 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-16T08:36:12.584 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-16T08:36:12.584 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-16T08:36:12.584 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-16T08:36:12.584 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-16T08:36:12.585 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-16T08:36:12.585 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-16T08:36:12.585 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-16T08:36:12.585 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-16T08:36:12.585 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-16T08:36:12.586 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-16T08:36:12.586 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-16T08:36:12.586 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-16T08:36:12.586 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-16T08:36:12.586 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-16T08:36:12.586 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-16T08:36:12.587 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-16T08:36:12.587 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-16T08:36:12.587 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-16T08:36:12.587 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-16T08:36:12.587 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-16T08:36:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-16T08:36:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-16T08:36:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-16T08:36:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-16T08:36:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-16T08:36:12.588 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-16T08:36:12.589 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-16T08:36:12.589 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-16T08:36:12.589 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-16T08:36:12.589 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-16T08:36:12.589 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-16T08:36:12.590 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-16T08:36:12.590 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-16T08:36:12.590 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-16T08:36:12.590 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-16T08:36:12.590 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-16T08:36:12.591 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-16T08:36:12.591 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-16T08:36:12.591 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-16T08:36:12.591 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-16T08:36:12.591 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-16T08:36:12.591 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-16T08:36:12.592 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-16T08:36:12.592 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-16T08:36:12.592 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-16T08:36:12.592 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-16T08:36:12.592 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-16T08:36:12.593 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-16T08:36:12.593 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-16T08:36:12.593 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-16T08:36:12.593 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-16T08:36:12.593 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-16T08:36:12.593 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-16T08:36:12.594 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-16T08:36:12.594 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-16T08:36:12.594 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-16T08:36:12.594 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-16T08:36:12.594 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-16T08:36:12.595 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-16T08:36:12.595 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-16T08:36:12.595 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-16T08:36:12.595 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-16T08:36:12.595 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-16T08:36:12.596 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-16T08:36:12.596 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-16T08:36:12.596 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-16T08:36:12.596 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-16T08:36:12.596 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-16T08:36:12.596 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-16T08:36:12.597 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-16T08:36:12.597 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-16T08:36:12.597 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-16T08:36:12.597 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-16T08:36:12.597 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-16T08:36:12.598 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-16T08:36:12.598 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-16T08:36:12.598 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-16T08:36:12.598 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-16T08:36:12.598 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-16T08:36:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-16T08:36:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-16T08:36:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-16T08:36:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-16T08:36:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-16T08:36:12.599 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-16T08:36:12.600 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-16T08:36:12.600 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-16T08:36:12.600 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-16T08:36:12.600 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-16T08:36:12.600 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-16T08:36:12.601 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-16T08:36:12.601 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-16T08:36:12.601 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-16T08:36:12.601 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-16T08:36:12.601 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-16T08:36:12.601 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-16T08:36:12.602 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-16T08:36:12.602 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-16T08:36:12.602 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-16T08:36:12.602 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-16T08:36:12.602 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-16T08:36:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-16T08:36:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-16T08:36:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-16T08:36:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-16T08:36:12.603 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-16T08:36:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-16T08:36:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-16T08:36:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-16T08:36:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-16T08:36:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-16T08:36:12.604 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-16T08:36:12.605 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-16T08:36:12.605 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-16T08:36:12.605 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-16T08:36:12.605 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-16T08:36:12.605 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-16T08:36:12.605 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-16T08:36:12.606 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-16T08:36:12.606 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-16T08:36:12.606 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-16T08:36:12.606 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-16T08:36:12.606 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-16T08:36:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-16T08:36:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-16T08:36:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-16T08:36:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-16T08:36:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-16T08:36:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-16T08:36:12.608 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-16T08:36:12.608 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-16T08:36:12.608 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-16T08:36:12.608 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-16T08:36:12.608 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-16T08:36:12.608 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-16T08:36:12.609 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-16T08:36:12.609 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-16T08:36:12.609 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-16T08:36:12.609 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-16T08:36:12.609 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-16T08:36:12.610 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-16T08:36:12.610 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-16T08:36:12.610 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-16T08:36:12.610 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-16T08:36:12.610 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-16T08:36:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-16T08:36:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-16T08:36:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-16T08:36:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-16T08:36:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-16T08:36:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-16T08:36:12.612 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-16T08:36:12.612 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-16T08:36:12.612 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-16T08:36:12.612 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-16T08:36:12.612 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-16T08:36:12.613 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-16T08:36:12.613 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-16T08:36:12.613 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-16T08:36:12.613 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-16T08:36:12.613 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-16T08:36:12.613 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-16T08:36:12.614 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-16T08:36:12.614 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-16T08:36:12.614 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.615 DEBUG:teuthology.orchestra.run.smithi094:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-16T08:36:12.639 INFO:teuthology.orchestra.run.smithi094.stdout:postinstall scriptlet (using /bin/sh): 2023-10-16T08:36:12.639 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-16T08:36:12.639 INFO:teuthology.orchestra.run.smithi094.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:12.640 INFO:teuthology.orchestra.run.smithi094.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:12.640 INFO:teuthology.orchestra.run.smithi094.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.640 INFO:teuthology.orchestra.run.smithi094.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:12.640 INFO:teuthology.orchestra.run.smithi094.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T08:36:12.640 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2023-10-16T08:36:12.641 INFO:teuthology.orchestra.run.smithi094.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-16T08:36:12.641 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-16T08:36:12.641 INFO:teuthology.orchestra.run.smithi094.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-16T08:36:12.641 INFO:teuthology.orchestra.run.smithi094.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-16T08:36:12.641 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.641 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2023-10-16T08:36:12.642 INFO:teuthology.orchestra.run.smithi094.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-16T08:36:12.642 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-16T08:36:12.642 INFO:teuthology.orchestra.run.smithi094.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.642 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2023-10-16T08:36:12.643 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2023-10-16T08:36:12.718 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2023-10-16T08:36:12.718 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2023-10-16T08:36:12.719 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.06 2023-10-16T08:36:12.719 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 68.el9 2023-10-16T08:36:12.719 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2023-10-16T08:36:12.719 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-16T08:36:12.719 INFO:teuthology.orchestra.run.smithi094.stdout:Group : Unspecified 2023-10-16T08:36:12.720 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 8264254 2023-10-16T08:36:12.720 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2023-10-16T08:36:12.720 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-16T08:36:12.720 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-16T08:36:12.720 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-16T08:36:12.720 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-16T08:36:12.721 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : builder@centos.org 2023-10-16T08:36:12.721 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2023-10-16T08:36:12.721 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-16T08:36:12.721 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2023-10-16T08:36:12.721 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2023-10-16T08:36:12.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:36:12.722 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-16T08:36:12.722 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-16T08:36:12.722 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-16T08:36:12.722 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2023-10-16T08:36:12.723 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:36:12.723 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2023-10-16T08:36:12.724 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-16T08:36:12.724 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 6.6.0-rc5-g47672119149b 2023-10-16T08:36:12.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-16T08:36:13.344 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2023-10-16T08:36:13.467 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-16T08:36:13.485 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-10-16T08:36:13.495 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-10-16T08:36:13.511 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.rmocl2N4Ds 2023-10-16T08:36:13.512 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rmocl2N4Ds 2023-10-16T08:36:13.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.rmocl2N4Ds 2023-10-16T08:36:13.719 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.rmocl2N4Ds is 6KB 2023-10-16T08:36:13.768 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.rmocl2N4Ds 2023-10-16T08:36:13.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2023-10-16T08:36:13.847 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-16T08:36:13.887 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-16T08:36:13.887 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-16T08:36:13.887 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-16T08:36:13.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-16T08:36:14.050 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2023-10-16T08:36:14.730 INFO:teuthology.orchestra.run.smithi094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-16T08:36:14.780 INFO:teuthology.orchestra.run.smithi094.stderr:done 2023-10-16T08:36:14.782 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2023-10-16T08:36:14.798 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.ZZpXRQdC1d 2023-10-16T08:36:14.798 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZZpXRQdC1d 2023-10-16T08:36:14.875 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.ZZpXRQdC1d 2023-10-16T08:36:15.015 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.ZZpXRQdC1d is 6KB 2023-10-16T08:36:15.035 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.ZZpXRQdC1d 2023-10-16T08:36:15.048 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2023-10-16T08:36:15.113 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-16T08:36:15.113 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-16T08:36:15.114 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-16T08:36:15.114 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-16T08:36:15.115 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-16T08:36:15.281 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2023-10-16T08:36:44.082 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-16T08:36:44.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T08:36:44.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:36:45.284 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-16T08:36:45.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T08:36:45.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:44.142 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T08:37:45.289 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T08:37:53.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T08:37:53.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:54.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T08:37:54.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:37:56.652 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-16T08:37:57.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T08:37:57.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g47672119149b"... 2023-10-16T08:37:57.352 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-10-16T08:37:57.370 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-16T08:37:57.403 INFO:teuthology.orchestra.run.smithi130.stdout:6.6.0-rc5-g47672119149b 2023-10-16T08:37:57.404 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-16T08:37:57.404 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T08:37:57.404 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-16T08:37:58.406 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-16T08:37:58.407 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T08:37:58.531 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2023-10-16T08:37:58.579 DEBUG:teuthology.parallel:result is None 2023-10-16T08:38:09.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T08:38:09.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:38:09.742 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-16T08:38:10.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T08:38:10.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-16T08:38:10.358 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2023-10-16T08:38:10.397 INFO:teuthology.orchestra.run.smithi094.stdout:6.6.0-rc5-g47672119149b 2023-10-16T08:38:10.397 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-16T08:38:10.397 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T08:38:10.398 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-16T08:38:11.400 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-16T08:38:11.400 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T08:38:11.517 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2023-10-16T08:38:11.568 DEBUG:teuthology.parallel:result is None 2023-10-16T08:38:11.568 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T08:38:11.583 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T08:38:11.584 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T08:38:11.589 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T08:38:11.681 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T08:38:11.688 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T08:38:11.696 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T08:38:11.696 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T08:38:11.705 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T08:38:11.798 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T08:38:11.805 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T08:38:11.806 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T08:38:11.811 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T08:38:11.881 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T08:38:11.914 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T08:38:11.958 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T08:38:12.026 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T08:38:12.032 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T08:38:12.039 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T08:38:12.040 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T08:38:12.048 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T08:38:12.191 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T08:38:12.199 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T08:38:12.200 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T08:38:12.208 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T08:38:12.295 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T08:38:12.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T08:38:12.467 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T08:38:12.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T08:38:12.621 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:38:12.621 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T08:38:12.698 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T08:38:12.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T08:38:12.857 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T08:38:12.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T08:38:13.025 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:38:13.025 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T08:38:13.097 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2023-10-16T08:38:13.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-10-16T08:38:13.201 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T08:38:13.270 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T08:38:13.648 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T08:38:13.656 INFO:teuthology.task.internal:Starting timer... 2023-10-16T08:38:13.657 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T08:38:13.667 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T08:38:13.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2023-10-16T08:38:13.863 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2023-10-16T08:38:13.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2023-10-16T08:38:14.004 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2023-10-16T08:38:14.011 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T08:38:14.011 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2023-10-16T08:38:14.104 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2023-10-16T08:38:14.104 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2023-10-16T08:38:14.160 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2023-10-16T08:38:14.160 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2023-10-16T08:38:14.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T08:38:14.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T08:38:14.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T08:38:14.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T08:38:14.389 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T08:38:14.390 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2023-10-16T08:38:14.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2023-10-16T08:38:14.793 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T08:38:14.803 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T08:38:14.809 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T08:38:14.930 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T08:38:14.946 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T08:38:14.947 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T08:48:03.839 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2023-10-16T08:48:03.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T08:48:03.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:48:03.979 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-16T08:48:04.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T08:48:04.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T08:48:04.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T08:48:04.273 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-16T08:48:04.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T08:48:04.426 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T08:48:04.439 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T08:48:04.439 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T08:48:04.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T08:48:04.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T08:48:04.449 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T08:48:04.550 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T08:48:04.550 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T08:48:04.601 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T08:48:04.602 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T08:48:04.692 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2023-10-16T08:48:04.693 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2023-10-16T08:48:04.733 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2023-10-16T08:48:04.733 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2023-10-16T08:48:04.779 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T08:48:04.780 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T08:48:04.827 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T08:48:04.829 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T08:48:04.947 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2023-10-16T08:48:04.956 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T08:48:04.956 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2023-10-16T08:48:04.957 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.957 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.957 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.957 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.970 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2023-10-16T08:48:04.977 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T08:48:04.977 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-10-16T08:48:04.978 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.978 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.978 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.978 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T08:48:04.979 INFO:teuthology.run_tasks:Running task install... 2023-10-16T08:48:04.988 DEBUG:teuthology.task.install:project ceph 2023-10-16T08:48:04.989 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T08:48:04.989 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T08:48:04.989 INFO:teuthology.task.install:Using flavor: default 2023-10-16T08:48:04.995 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T08:48:04.996 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T08:48:04.997 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T08:48:04.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T08:48:04.999 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T08:48:05.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T08:48:05.160 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-16T08:48:05.160 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T08:48:05.228 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-16T08:48:05.229 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T08:48:05.333 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T08:48:05.333 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:48:05.334 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T08:48:05.336 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T08:48:05.337 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:48:05.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T08:48:05.442 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T08:48:05.442 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T08:48:05.443 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T08:48:05.444 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T08:48:05.584 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T08:48:05.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T08:48:05.714 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T08:48:05.718 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T08:48:05.805 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2023-10-16T08:48:05.809 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2023-10-16T08:48:05.810 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2023-10-16T08:48:05.813 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2023-10-16T08:48:06.154 INFO:teuthology.orchestra.run.smithi130.stdout:72 files removed 2023-10-16T08:48:06.163 INFO:teuthology.orchestra.run.smithi094.stdout:72 files removed 2023-10-16T08:48:06.193 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T08:48:06.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T08:48:07.171 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 167 kB/s | 78 kB 00:00 2023-10-16T08:48:07.247 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 146 kB/s | 78 kB 00:00 2023-10-16T08:48:07.677 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2023-10-16T08:48:07.796 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 21 kB/s | 9.4 kB 00:00 2023-10-16T08:48:08.186 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2023-10-16T08:48:08.364 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-10-16T08:48:08.774 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-10-16T08:48:09.060 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - AppStream 10 MB/s | 6.3 MB 00:00 2023-10-16T08:48:10.306 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-10-16T08:48:10.644 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2023-10-16T08:48:11.403 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-10-16T08:48:11.789 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-10-16T08:48:14.866 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 18 MB 00:01 2023-10-16T08:48:20.100 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.7 MB 00:01 2023-10-16T08:48:21.834 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 14 kB 00:00 2023-10-16T08:48:26.903 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 18 MB 00:14 2023-10-16T08:48:27.949 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 19 MB 00:05 2023-10-16T08:48:31.878 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.7 MB 00:01 2023-10-16T08:48:33.069 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-10-16T08:48:33.354 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 14 kB 00:00 2023-10-16T08:48:34.323 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 24 MB/s | 19 MB 00:00 2023-10-16T08:48:35.693 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T08:48:35.695 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T08:48:35.717 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-16T08:48:35.718 INFO:teuthology.orchestra.run.smithi094.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-16T08:48:35.720 INFO:teuthology.orchestra.run.smithi094.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T08:48:35.721 INFO:teuthology.orchestra.run.smithi094.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-16T08:48:35.724 INFO:teuthology.orchestra.run.smithi094.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T08:48:35.728 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-16T08:48:35.729 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T08:48:35.807 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2023-10-16T08:48:35.828 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================================ 2023-10-16T08:48:35.828 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2023-10-16T08:48:35.829 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================================ 2023-10-16T08:48:35.829 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2023-10-16T08:48:35.829 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-16T08:48:35.829 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-16T08:48:35.829 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-16T08:48:35.830 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-16T08:48:35.830 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-16T08:48:35.830 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-16T08:48:35.830 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-16T08:48:35.831 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-16T08:48:35.831 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-16T08:48:35.833 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-16T08:48:35.833 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-16T08:48:35.833 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-16T08:48:35.834 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-16T08:48:35.834 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-16T08:48:35.834 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-16T08:48:35.834 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-16T08:48:35.834 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-16T08:48:35.835 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-16T08:48:35.835 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-16T08:48:35.835 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-16T08:48:35.836 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-16T08:48:35.836 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T08:48:35.836 INFO:teuthology.orchestra.run.smithi094.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-16T08:48:35.836 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-16T08:48:35.836 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-16T08:48:35.837 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-16T08:48:35.837 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-16T08:48:35.837 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-16T08:48:35.837 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-16T08:48:35.837 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-16T08:48:35.838 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-16T08:48:35.838 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-16T08:48:35.838 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-16T08:48:35.838 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T08:48:35.838 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-16T08:48:35.839 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-16T08:48:35.839 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2023-10-16T08:48:35.839 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-16T08:48:35.839 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-16T08:48:35.839 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-16T08:48:35.840 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-16T08:48:35.840 INFO:teuthology.orchestra.run.smithi094.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-16T08:48:35.840 INFO:teuthology.orchestra.run.smithi094.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-16T08:48:35.840 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-16T08:48:35.840 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-16T08:48:35.840 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T08:48:35.841 INFO:teuthology.orchestra.run.smithi094.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-16T08:48:35.841 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2023-10-16T08:48:35.841 INFO:teuthology.orchestra.run.smithi094.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-16T08:48:35.841 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-16T08:48:35.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T08:48:35.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-16T08:48:35.842 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-16T08:48:35.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-16T08:48:35.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-16T08:48:35.843 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-16T08:48:35.844 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-16T08:48:35.844 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-16T08:48:35.845 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-16T08:48:35.845 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-16T08:48:35.845 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-16T08:48:35.846 INFO:teuthology.orchestra.run.smithi094.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-16T08:48:35.846 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-16T08:48:35.846 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-16T08:48:35.847 INFO:teuthology.orchestra.run.smithi094.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-16T08:48:35.847 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-16T08:48:35.847 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-16T08:48:35.848 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-16T08:48:35.848 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-16T08:48:35.848 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-16T08:48:35.849 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-16T08:48:35.849 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-16T08:48:35.849 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-16T08:48:35.850 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-16T08:48:35.850 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-16T08:48:35.851 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-16T08:48:35.851 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-16T08:48:35.851 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-16T08:48:35.852 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-16T08:48:35.852 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-16T08:48:35.852 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-16T08:48:35.853 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-16T08:48:35.853 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-16T08:48:35.853 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-16T08:48:35.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-16T08:48:35.853 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-16T08:48:35.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-16T08:48:35.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-16T08:48:35.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-16T08:48:35.854 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T08:48:35.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-16T08:48:35.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-16T08:48:35.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-16T08:48:35.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-16T08:48:35.855 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-16T08:48:35.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-16T08:48:35.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-16T08:48:35.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-16T08:48:35.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-16T08:48:35.856 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-16T08:48:35.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-16T08:48:35.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-16T08:48:35.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-16T08:48:35.857 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-16T08:48:35.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-16T08:48:35.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-16T08:48:35.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-16T08:48:35.858 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-16T08:48:35.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-16T08:48:35.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-16T08:48:35.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-16T08:48:35.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-16T08:48:35.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-16T08:48:35.859 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-16T08:48:35.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-16T08:48:35.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-16T08:48:35.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-16T08:48:35.860 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-16T08:48:35.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-16T08:48:35.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-16T08:48:35.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-16T08:48:35.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-16T08:48:35.861 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-16T08:48:35.862 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-16T08:48:35.862 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-16T08:48:35.862 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-16T08:48:35.862 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-16T08:48:35.862 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-16T08:48:35.863 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-16T08:48:35.863 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-16T08:48:35.863 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-16T08:48:35.864 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-16T08:48:35.864 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-16T08:48:35.864 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-16T08:48:35.865 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-16T08:48:35.865 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-16T08:48:35.865 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-16T08:48:35.866 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-16T08:48:35.866 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-16T08:48:35.866 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-16T08:48:35.867 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-16T08:48:35.867 INFO:teuthology.orchestra.run.smithi094.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-16T08:48:35.867 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-16T08:48:35.867 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-16T08:48:35.868 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2023-10-16T08:48:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-16T08:48:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:48:35.869 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2023-10-16T08:48:35.869 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================================ 2023-10-16T08:48:35.869 INFO:teuthology.orchestra.run.smithi094.stdout:Install 133 Packages 2023-10-16T08:48:35.869 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 10 Packages 2023-10-16T08:48:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:48:35.871 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 199 M 2023-10-16T08:48:35.871 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2023-10-16T08:48:36.478 INFO:teuthology.orchestra.run.smithi094.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 21 kB/s | 6.5 kB 00:00 2023-10-16T08:48:37.312 INFO:teuthology.orchestra.run.smithi094.stdout:(2/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 4.5 MB/s | 5.2 MB 00:01 2023-10-16T08:48:37.387 INFO:teuthology.orchestra.run.smithi094.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 1.9 MB/s | 141 kB 00:00 2023-10-16T08:48:37.579 INFO:teuthology.orchestra.run.smithi094.stdout:(4/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 778 kB/s | 855 kB 00:01 2023-10-16T08:48:37.738 INFO:teuthology.orchestra.run.smithi094.stdout:(5/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 6.0 MB/s | 2.1 MB 00:00 2023-10-16T08:48:38.225 INFO:teuthology.orchestra.run.smithi094.stdout:(6/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 9.0 MB/s | 4.4 MB 00:00 2023-10-16T08:48:38.593 INFO:teuthology.orchestra.run.smithi094.stdout:(7/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 1.4 MB/s | 1.5 MB 00:01 2023-10-16T08:48:39.472 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-16T08:48:39.501 INFO:teuthology.orchestra.run.smithi094.stdout:(8/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x86 14 MB/s | 18 MB 00:01 2023-10-16T08:48:39.601 INFO:teuthology.orchestra.run.smithi094.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 242 kB/s | 24 kB 00:00 2023-10-16T08:48:40.718 INFO:teuthology.orchestra.run.smithi094.stdout:(10/143): ceph-common-18.0.0-6730.g4ba8a190.el9 4.2 MB/s | 19 MB 00:04 2023-10-16T08:48:40.869 INFO:teuthology.orchestra.run.smithi094.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.4 MB/s | 218 kB 00:00 2023-10-16T08:48:41.081 INFO:teuthology.orchestra.run.smithi094.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 147 kB/s | 31 kB 00:00 2023-10-16T08:48:41.262 INFO:teuthology.orchestra.run.smithi094.stdout:(13/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 3.2 MB/s | 8.6 MB 00:02 2023-10-16T08:48:41.345 INFO:teuthology.orchestra.run.smithi094.stdout:(14/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 2.7 MB/s | 715 kB 00:00 2023-10-16T08:48:41.378 INFO:teuthology.orchestra.run.smithi094.stdout:(15/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.4 MB/s | 163 kB 00:00 2023-10-16T08:48:41.487 INFO:teuthology.orchestra.run.smithi094.stdout:(16/143): librados-devel-18.0.0-6730.g4ba8a190. 898 kB/s | 127 kB 00:00 2023-10-16T08:48:41.612 INFO:teuthology.orchestra.run.smithi094.stdout:(17/143): libradosstriper1-18.0.0-6730.g4ba8a19 2.0 MB/s | 472 kB 00:00 2023-10-16T08:48:41.738 INFO:teuthology.orchestra.run.smithi094.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 363 kB/s | 45 kB 00:00 2023-10-16T08:48:41.888 INFO:teuthology.orchestra.run.smithi094.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 849 kB/s | 127 kB 00:00 2023-10-16T08:48:41.981 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T08:48:41.982 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T08:48:42.004 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-16T08:48:42.005 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-16T08:48:42.007 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T08:48:42.008 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-16T08:48:42.011 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T08:48:42.014 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-16T08:48:42.016 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T08:48:42.038 INFO:teuthology.orchestra.run.smithi094.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 1.1 MB/s | 162 kB 00:00 2023-10-16T08:48:42.091 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-16T08:48:42.111 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================ 2023-10-16T08:48:42.111 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-16T08:48:42.111 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================ 2023-10-16T08:48:42.111 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-16T08:48:42.112 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-16T08:48:42.112 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-16T08:48:42.112 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-16T08:48:42.112 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-16T08:48:42.112 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-16T08:48:42.113 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-16T08:48:42.113 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-16T08:48:42.113 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-16T08:48:42.113 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-16T08:48:42.113 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-16T08:48:42.114 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-16T08:48:42.114 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-16T08:48:42.114 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-16T08:48:42.114 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-16T08:48:42.115 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-16T08:48:42.115 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-16T08:48:42.115 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-16T08:48:42.115 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-16T08:48:42.115 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-16T08:48:42.116 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-16T08:48:42.116 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-16T08:48:42.116 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T08:48:42.116 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-16T08:48:42.116 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-16T08:48:42.117 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-16T08:48:42.117 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-16T08:48:42.117 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-16T08:48:42.117 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-16T08:48:42.118 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-16T08:48:42.118 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-16T08:48:42.118 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-16T08:48:42.118 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-16T08:48:42.119 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-16T08:48:42.119 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T08:48:42.119 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-16T08:48:42.119 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-16T08:48:42.119 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-10-16T08:48:42.120 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-16T08:48:42.120 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-16T08:48:42.120 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-16T08:48:42.120 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-16T08:48:42.120 INFO:teuthology.orchestra.run.smithi130.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-16T08:48:42.121 INFO:teuthology.orchestra.run.smithi130.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-16T08:48:42.121 INFO:teuthology.orchestra.run.smithi130.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-16T08:48:42.121 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-16T08:48:42.121 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T08:48:42.122 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-16T08:48:42.122 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-16T08:48:42.122 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-16T08:48:42.122 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-16T08:48:42.122 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T08:48:42.123 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-16T08:48:42.123 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-16T08:48:42.123 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-16T08:48:42.123 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-16T08:48:42.123 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-16T08:48:42.124 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-16T08:48:42.124 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-16T08:48:42.124 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-16T08:48:42.124 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-16T08:48:42.125 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-16T08:48:42.125 INFO:teuthology.orchestra.run.smithi130.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-16T08:48:42.125 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-16T08:48:42.125 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-16T08:48:42.125 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-16T08:48:42.125 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-16T08:48:42.126 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-16T08:48:42.126 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-16T08:48:42.126 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-16T08:48:42.126 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-16T08:48:42.127 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-16T08:48:42.127 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-16T08:48:42.127 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-16T08:48:42.127 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-16T08:48:42.127 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-16T08:48:42.128 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-16T08:48:42.128 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-16T08:48:42.128 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-16T08:48:42.128 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-16T08:48:42.128 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-16T08:48:42.129 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-16T08:48:42.129 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-16T08:48:42.129 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-16T08:48:42.129 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-16T08:48:42.129 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-16T08:48:42.130 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-16T08:48:42.130 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-16T08:48:42.130 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-16T08:48:42.130 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-16T08:48:42.131 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T08:48:42.131 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-16T08:48:42.131 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-16T08:48:42.131 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-16T08:48:42.132 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-16T08:48:42.132 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-16T08:48:42.132 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-16T08:48:42.132 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-16T08:48:42.132 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-16T08:48:42.133 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-16T08:48:42.133 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-16T08:48:42.133 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-16T08:48:42.133 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-16T08:48:42.133 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-16T08:48:42.134 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-16T08:48:42.134 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-16T08:48:42.134 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-16T08:48:42.134 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-16T08:48:42.135 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-16T08:48:42.135 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-16T08:48:42.135 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-16T08:48:42.135 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-16T08:48:42.135 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-16T08:48:42.136 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-16T08:48:42.136 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-16T08:48:42.136 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-16T08:48:42.136 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-16T08:48:42.137 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-16T08:48:42.137 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-16T08:48:42.137 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-16T08:48:42.137 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-16T08:48:42.137 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-16T08:48:42.138 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-16T08:48:42.138 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-16T08:48:42.138 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-16T08:48:42.139 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-16T08:48:42.139 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-16T08:48:42.139 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-16T08:48:42.139 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-16T08:48:42.139 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-16T08:48:42.140 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-16T08:48:42.140 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-16T08:48:42.140 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-16T08:48:42.140 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-16T08:48:42.141 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-16T08:48:42.141 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-16T08:48:42.141 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-16T08:48:42.141 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-16T08:48:42.142 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-16T08:48:42.142 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-16T08:48:42.142 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-16T08:48:42.142 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-16T08:48:42.143 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-16T08:48:42.143 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-16T08:48:42.143 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-16T08:48:42.143 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2023-10-16T08:48:42.143 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-16T08:48:42.144 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:48:42.144 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-16T08:48:42.144 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================ 2023-10-16T08:48:42.144 INFO:teuthology.orchestra.run.smithi130.stdout:Install 133 Packages 2023-10-16T08:48:42.145 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 10 Packages 2023-10-16T08:48:42.145 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:48:42.145 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 199 M 2023-10-16T08:48:42.146 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-16T08:48:42.163 INFO:teuthology.orchestra.run.smithi094.stdout:(21/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 7.1 MB/s | 4.8 MB 00:00 2023-10-16T08:48:42.205 INFO:teuthology.orchestra.run.smithi094.stdout:(22/143): python3-rados-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 321 kB 00:00 2023-10-16T08:48:42.306 INFO:teuthology.orchestra.run.smithi094.stdout:(23/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 2.1 MB/s | 298 kB 00:00 2023-10-16T08:48:42.331 INFO:teuthology.orchestra.run.smithi094.stdout:(24/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 798 kB/s | 99 kB 00:00 2023-10-16T08:48:42.448 INFO:teuthology.orchestra.run.smithi094.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 600 kB/s | 85 kB 00:00 2023-10-16T08:48:43.032 INFO:teuthology.orchestra.run.smithi094.stdout:(26/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 12 MB/s | 41 MB 00:03 2023-10-16T08:48:43.065 INFO:teuthology.orchestra.run.smithi094.stdout:(27/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 274 kB/s | 169 kB 00:00 2023-10-16T08:48:43.116 INFO:teuthology.orchestra.run.smithi130.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 12 kB/s | 6.5 kB 00:00 2023-10-16T08:48:43.174 INFO:teuthology.orchestra.run.smithi094.stdout:(28/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 3.6 MB/s | 3.0 MB 00:00 2023-10-16T08:48:43.199 INFO:teuthology.orchestra.run.smithi094.stdout:(29/143): ceph-grafana-dashboards-18.0.0-6730.g 139 kB/s | 23 kB 00:00 2023-10-16T08:48:43.224 INFO:teuthology.orchestra.run.smithi094.stdout:(30/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 837 kB/s | 132 kB 00:00 2023-10-16T08:48:43.358 INFO:teuthology.orchestra.run.smithi094.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 1.8 MB/s | 242 kB 00:00 2023-10-16T08:48:43.475 INFO:teuthology.orchestra.run.smithi094.stdout:(32/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 409 kB/s | 47 kB 00:00 2023-10-16T08:48:43.559 INFO:teuthology.orchestra.run.smithi094.stdout:(33/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.6 MB/s | 1.8 MB 00:00 2023-10-16T08:48:43.617 INFO:teuthology.orchestra.run.smithi094.stdout:(34/143): ceph-prometheus-alerts-18.0.0-6730.g4 107 kB/s | 15 kB 00:00 2023-10-16T08:48:43.701 INFO:teuthology.orchestra.run.smithi094.stdout:(35/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 1.8 MB/s | 262 kB 00:00 2023-10-16T08:48:43.826 INFO:teuthology.orchestra.run.smithi094.stdout:(36/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 147 kB/s | 18 kB 00:00 2023-10-16T08:48:43.900 INFO:teuthology.orchestra.run.smithi130.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.1 MB/s | 855 kB 00:00 2023-10-16T08:48:44.027 INFO:teuthology.orchestra.run.smithi094.stdout:(37/143): ceph-mgr-diskprediction-local-18.0.0- 9.0 MB/s | 7.4 MB 00:00 2023-10-16T08:48:44.033 INFO:teuthology.orchestra.run.smithi130.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 1.0 MB/s | 141 kB 00:00 2023-10-16T08:48:44.227 INFO:teuthology.orchestra.run.smithi094.stdout:(38/143): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 920 kB 00:00 2023-10-16T08:48:44.252 INFO:teuthology.orchestra.run.smithi094.stdout:(39/143): boost-program-options-1.75.0-8.el9.x8 472 kB/s | 106 kB 00:00 2023-10-16T08:48:44.311 INFO:teuthology.orchestra.run.smithi094.stdout:(40/143): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2023-10-16T08:48:44.336 INFO:teuthology.orchestra.run.smithi094.stdout:(41/143): flexiblas-3.0.4-8.el9.x86_64.rpm 382 kB/s | 32 kB 00:00 2023-10-16T08:48:44.453 INFO:teuthology.orchestra.run.smithi094.stdout:(42/143): flexiblas-openblas-openmp-3.0.4-8.el9 149 kB/s | 17 kB 00:00 2023-10-16T08:48:44.483 INFO:teuthology.orchestra.run.smithi130.stdout:(4/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 2.7 MB/s | 5.2 MB 00:01 2023-10-16T08:48:44.596 INFO:teuthology.orchestra.run.smithi094.stdout:(43/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2023-10-16T08:48:44.620 INFO:teuthology.orchestra.run.smithi094.stdout:(44/143): libaio-devel-0.3.111-13.el9.x86_64.rp 62 kB/s | 10 kB 00:00 2023-10-16T08:48:44.662 INFO:teuthology.orchestra.run.smithi094.stdout:(45/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 258 kB/s | 269 kB 00:01 2023-10-16T08:48:44.696 INFO:teuthology.orchestra.run.smithi094.stdout:(46/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-10-16T08:48:44.730 INFO:teuthology.orchestra.run.smithi094.stdout:(47/143): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2023-10-16T08:48:44.780 INFO:teuthology.orchestra.run.smithi094.stdout:(48/143): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2023-10-16T08:48:44.805 INFO:teuthology.orchestra.run.smithi094.stdout:(49/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 668 kB/s | 46 kB 00:00 2023-10-16T08:48:44.830 INFO:teuthology.orchestra.run.smithi094.stdout:(50/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 282 kB 00:00 2023-10-16T08:48:44.864 INFO:teuthology.orchestra.run.smithi094.stdout:(51/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2023-10-16T08:48:44.889 INFO:teuthology.orchestra.run.smithi094.stdout:(52/143): openblas-0.3.21-2.el9.x86_64.rpm 613 kB/s | 34 kB 00:00 2023-10-16T08:48:44.925 INFO:teuthology.orchestra.run.smithi130.stdout:(5/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 3.3 MB/s | 1.5 MB 00:00 2023-10-16T08:48:44.985 INFO:teuthology.orchestra.run.smithi130.stdout:(6/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 2.2 MB/s | 2.1 MB 00:00 2023-10-16T08:48:45.081 INFO:teuthology.orchestra.run.smithi094.stdout:(53/143): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2023-10-16T08:48:45.148 INFO:teuthology.orchestra.run.smithi094.stdout:(54/143): postgresql-13.11-1.el9.x86_64.rpm 5.4 MB/s | 1.5 MB 00:00 2023-10-16T08:48:45.182 INFO:teuthology.orchestra.run.smithi094.stdout:(55/143): postgresql-contrib-13.11-1.el9.x86_64 2.8 MB/s | 811 kB 00:00 2023-10-16T08:48:45.207 INFO:teuthology.orchestra.run.smithi094.stdout:(56/143): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 134 kB 00:00 2023-10-16T08:48:45.394 INFO:teuthology.orchestra.run.smithi130.stdout:(7/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 9.4 MB/s | 4.4 MB 00:00 2023-10-16T08:48:45.432 INFO:teuthology.orchestra.run.smithi094.stdout:(57/143): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-10-16T08:48:45.533 INFO:teuthology.orchestra.run.smithi094.stdout:(58/143): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2023-10-16T08:48:45.558 INFO:teuthology.orchestra.run.smithi094.stdout:(59/143): python3-devel-3.9.17-2.el9.x86_64.rpm 587 kB/s | 205 kB 00:00 2023-10-16T08:48:45.591 INFO:teuthology.orchestra.run.smithi094.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-10-16T08:48:45.617 INFO:teuthology.orchestra.run.smithi094.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 24 kB 00:00 2023-10-16T08:48:45.642 INFO:teuthology.orchestra.run.smithi094.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 224 kB/s | 18 kB 00:00 2023-10-16T08:48:45.676 INFO:teuthology.orchestra.run.smithi094.stdout:(63/143): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-10-16T08:48:45.717 INFO:teuthology.orchestra.run.smithi094.stdout:(64/143): python3-markupsafe-1.1.1-12.el9.x86_6 432 kB/s | 32 kB 00:00 2023-10-16T08:48:45.834 INFO:teuthology.orchestra.run.smithi094.stdout:(65/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-10-16T08:48:45.860 INFO:teuthology.orchestra.run.smithi094.stdout:(66/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-10-16T08:48:45.885 INFO:teuthology.orchestra.run.smithi094.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-10-16T08:48:45.927 INFO:teuthology.orchestra.run.smithi094.stdout:(68/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-10-16T08:48:45.952 INFO:teuthology.orchestra.run.smithi094.stdout:(69/143): python3-prettytable-0.7.2-27.el9.noar 625 kB/s | 41 kB 00:00 2023-10-16T08:48:45.978 INFO:teuthology.orchestra.run.smithi094.stdout:(70/143): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-10-16T08:48:46.003 INFO:teuthology.orchestra.run.smithi094.stdout:(71/143): python3-requests-oauthlib-1.3.0-12.el 587 kB/s | 43 kB 00:00 2023-10-16T08:48:46.028 INFO:teuthology.orchestra.run.smithi094.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 797 kB/s | 39 kB 00:00 2023-10-16T08:48:46.244 INFO:teuthology.orchestra.run.smithi130.stdout:(8/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 5.2 MB/s | 19 MB 00:03 2023-10-16T08:48:46.245 INFO:teuthology.orchestra.run.smithi094.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-10-16T08:48:46.463 INFO:teuthology.orchestra.run.smithi094.stdout:(74/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2023-10-16T08:48:46.469 INFO:teuthology.orchestra.run.smithi130.stdout:(9/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el9 8.0 MB/s | 8.6 MB 00:01 2023-10-16T08:48:46.486 INFO:teuthology.orchestra.run.smithi130.stdout:(10/143): ceph-selinux-18.0.0-6730.g4ba8a190.el 100 kB/s | 24 kB 00:00 2023-10-16T08:48:46.487 INFO:teuthology.orchestra.run.smithi094.stdout:(75/143): uuid-1.6.2-55.el9.x86_64.rpm 127 kB/s | 56 kB 00:00 2023-10-16T08:48:46.513 INFO:teuthology.orchestra.run.smithi094.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 244 kB/s | 63 kB 00:00 2023-10-16T08:48:46.546 INFO:teuthology.orchestra.run.smithi094.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-10-16T08:48:46.553 INFO:teuthology.orchestra.run.smithi130.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.2 MB/s | 218 kB 00:00 2023-10-16T08:48:46.580 INFO:teuthology.orchestra.run.smithi094.stdout:(78/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 803 kB 00:00 2023-10-16T08:48:46.613 INFO:teuthology.orchestra.run.smithi094.stdout:(79/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2023-10-16T08:48:46.628 INFO:teuthology.orchestra.run.smithi130.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 420 kB/s | 31 kB 00:00 2023-10-16T08:48:46.647 INFO:teuthology.orchestra.run.smithi094.stdout:(80/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-10-16T08:48:46.672 INFO:teuthology.orchestra.run.smithi094.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2023-10-16T08:48:46.697 INFO:teuthology.orchestra.run.smithi094.stdout:(82/143): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-10-16T08:48:46.731 INFO:teuthology.orchestra.run.smithi094.stdout:(83/143): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-10-16T08:48:46.756 INFO:teuthology.orchestra.run.smithi094.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 2.3 MB/s | 188 kB 00:00 2023-10-16T08:48:46.770 INFO:teuthology.orchestra.run.smithi130.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 5.0 MB/s | 715 kB 00:00 2023-10-16T08:48:46.854 INFO:teuthology.orchestra.run.smithi130.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 163 kB 00:00 2023-10-16T08:48:46.857 INFO:teuthology.orchestra.run.smithi094.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 226 kB/s | 22 kB 00:00 2023-10-16T08:48:46.938 INFO:teuthology.orchestra.run.smithi130.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 1.5 MB/s | 127 kB 00:00 2023-10-16T08:48:46.965 INFO:teuthology.orchestra.run.smithi094.stdout:(86/143): jq-1.6-15.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-10-16T08:48:47.038 INFO:teuthology.orchestra.run.smithi130.stdout:(16/143): libradosstriper1-18.0.0-6730.g4ba8a19 4.7 MB/s | 472 kB 00:00 2023-10-16T08:48:47.040 INFO:teuthology.orchestra.run.smithi094.stdout:(87/143): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2023-10-16T08:48:47.066 INFO:teuthology.orchestra.run.smithi094.stdout:(88/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 455 kB/s | 45 kB 00:00 2023-10-16T08:48:47.116 INFO:teuthology.orchestra.run.smithi094.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 523 kB/s | 26 kB 00:00 2023-10-16T08:48:47.183 INFO:teuthology.orchestra.run.smithi094.stdout:(90/143): python3-pytz-2021.1-5.el9.noarch.rpm 774 kB/s | 51 kB 00:00 2023-10-16T08:48:47.258 INFO:teuthology.orchestra.run.smithi094.stdout:(91/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.1 MB/s | 86 kB 00:00 2023-10-16T08:48:47.350 INFO:teuthology.orchestra.run.smithi094.stdout:(92/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 15 MB/s | 4.1 MB 00:00 2023-10-16T08:48:47.401 INFO:teuthology.orchestra.run.smithi094.stdout:(93/143): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2023-10-16T08:48:47.426 INFO:teuthology.orchestra.run.smithi094.stdout:(94/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2023-10-16T08:48:47.630 INFO:teuthology.orchestra.run.smithi130.stdout:(17/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 8.1 MB/s | 4.8 MB 00:00 2023-10-16T08:48:47.705 INFO:teuthology.orchestra.run.smithi130.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 610 kB/s | 45 kB 00:00 2023-10-16T08:48:47.789 INFO:teuthology.orchestra.run.smithi130.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 1.5 MB/s | 127 kB 00:00 2023-10-16T08:48:47.881 INFO:teuthology.orchestra.run.smithi130.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 1.7 MB/s | 162 kB 00:00 2023-10-16T08:48:48.131 INFO:teuthology.orchestra.run.smithi130.stdout:(21/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 5.6 MB/s | 18 MB 00:03 2023-10-16T08:48:48.173 INFO:teuthology.orchestra.run.smithi130.stdout:(22/143): python3-rados-18.0.0-6730.g4ba8a190.e 1.1 MB/s | 321 kB 00:00 2023-10-16T08:48:48.248 INFO:teuthology.orchestra.run.smithi130.stdout:(23/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 1.3 MB/s | 99 kB 00:00 2023-10-16T08:48:48.290 INFO:teuthology.orchestra.run.smithi130.stdout:(24/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 1.8 MB/s | 298 kB 00:00 2023-10-16T08:48:48.324 INFO:teuthology.orchestra.run.smithi130.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.1 MB/s | 85 kB 00:00 2023-10-16T08:48:48.399 INFO:teuthology.orchestra.run.smithi130.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.2 MB/s | 169 kB 00:00 2023-10-16T08:48:48.475 INFO:teuthology.orchestra.run.smithi130.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 312 kB/s | 23 kB 00:00 2023-10-16T08:48:48.541 INFO:teuthology.orchestra.run.smithi130.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.0 MB/s | 132 kB 00:00 2023-10-16T08:48:48.801 INFO:teuthology.orchestra.run.smithi094.stdout:(95/143): fmt-8.1.1-5.el9.x86_64.rpm 76 kB/s | 111 kB 00:01 2023-10-16T08:48:48.850 INFO:teuthology.orchestra.run.smithi130.stdout:(29/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 5.4 MB/s | 3.0 MB 00:00 2023-10-16T08:48:48.901 INFO:teuthology.orchestra.run.smithi130.stdout:(30/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.9 MB/s | 1.8 MB 00:00 2023-10-16T08:48:49.010 INFO:teuthology.orchestra.run.smithi094.stdout:(96/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 192 kB/s | 309 kB 00:01 2023-10-16T08:48:49.024 INFO:teuthology.orchestra.run.smithi130.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 1.9 MB/s | 242 kB 00:00 2023-10-16T08:48:49.101 INFO:teuthology.orchestra.run.smithi130.stdout:(32/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 631 kB/s | 47 kB 00:00 2023-10-16T08:48:49.102 INFO:teuthology.orchestra.run.smithi094.stdout:(97/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 81 kB/s | 24 kB 00:00 2023-10-16T08:48:49.185 INFO:teuthology.orchestra.run.smithi130.stdout:(33/143): ceph-prometheus-alerts-18.0.0-6730.g4 183 kB/s | 15 kB 00:00 2023-10-16T08:48:49.277 INFO:teuthology.orchestra.run.smithi130.stdout:(34/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 2.8 MB/s | 262 kB 00:00 2023-10-16T08:48:49.335 INFO:teuthology.orchestra.run.smithi094.stdout:(98/143): liboath-2.6.7-2.el9.x86_64.rpm 149 kB/s | 49 kB 00:00 2023-10-16T08:48:49.368 INFO:teuthology.orchestra.run.smithi130.stdout:(35/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 2.9 MB/s | 269 kB 00:00 2023-10-16T08:48:49.436 INFO:teuthology.orchestra.run.smithi094.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 202 kB/s | 67 kB 00:00 2023-10-16T08:48:49.444 INFO:teuthology.orchestra.run.smithi130.stdout:(36/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 246 kB/s | 18 kB 00:00 2023-10-16T08:48:49.928 INFO:teuthology.orchestra.run.smithi130.stdout:(37/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 12 MB/s | 41 MB 00:03 2023-10-16T08:48:49.928 INFO:teuthology.orchestra.run.smithi094.stdout:(100/143): libarrow-9.0.0-9.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2023-10-16T08:48:50.186 INFO:teuthology.orchestra.run.smithi094.stdout:(101/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 987 kB/s | 837 kB 00:00 2023-10-16T08:48:50.194 INFO:teuthology.orchestra.run.smithi130.stdout:(38/143): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-10-16T08:48:50.245 INFO:teuthology.orchestra.run.smithi130.stdout:(39/143): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 920 kB 00:00 2023-10-16T08:48:50.270 INFO:teuthology.orchestra.run.smithi130.stdout:(40/143): boost-program-options-1.75.0-8.el9.x8 311 kB/s | 106 kB 00:00 2023-10-16T08:48:50.304 INFO:teuthology.orchestra.run.smithi130.stdout:(41/143): flex-2.6.4-9.el9.x86_64.rpm 2.9 MB/s | 307 kB 00:00 2023-10-16T08:48:50.328 INFO:teuthology.orchestra.run.smithi094.stdout:(102/143): python3-asyncssh-2.13.2-3.el9.noarch 616 kB/s | 548 kB 00:00 2023-10-16T08:48:50.337 INFO:teuthology.orchestra.run.smithi130.stdout:(42/143): flexiblas-3.0.4-8.el9.x86_64.rpm 499 kB/s | 32 kB 00:00 2023-10-16T08:48:50.353 INFO:teuthology.orchestra.run.smithi094.stdout:(103/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 102 kB/s | 43 kB 00:00 2023-10-16T08:48:50.429 INFO:teuthology.orchestra.run.smithi130.stdout:(43/143): flexiblas-openblas-openmp-3.0.4-8.el9 138 kB/s | 17 kB 00:00 2023-10-16T08:48:50.454 INFO:teuthology.orchestra.run.smithi094.stdout:(104/143): python3-cachetools-4.2.4-1.el9.noarc 121 kB/s | 32 kB 00:00 2023-10-16T08:48:50.529 INFO:teuthology.orchestra.run.smithi130.stdout:(44/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2023-10-16T08:48:50.555 INFO:teuthology.orchestra.run.smithi130.stdout:(45/143): libaio-devel-0.3.111-13.el9.x86_64.rp 47 kB/s | 10 kB 00:00 2023-10-16T08:48:50.580 INFO:teuthology.orchestra.run.smithi130.stdout:(46/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-10-16T08:48:50.604 INFO:teuthology.orchestra.run.smithi094.stdout:(105/143): python3-certifi-2021.10.8-2.el9.noar 55 kB/s | 15 kB 00:00 2023-10-16T08:48:50.622 INFO:teuthology.orchestra.run.smithi130.stdout:(47/143): librdkafka-1.6.1-102.el9.x86_64.rpm 7.2 MB/s | 661 kB 00:00 2023-10-16T08:48:50.647 INFO:teuthology.orchestra.run.smithi130.stdout:(48/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 771 kB/s | 46 kB 00:00 2023-10-16T08:48:50.663 INFO:teuthology.orchestra.run.smithi094.stdout:(106/143): python3-cheroot-8.6.0-4.el9.noarch.r 557 kB/s | 172 kB 00:00 2023-10-16T08:48:50.689 INFO:teuthology.orchestra.run.smithi130.stdout:(49/143): libtool-2.4.6-45.el9.x86_64.rpm 5.5 MB/s | 578 kB 00:00 2023-10-16T08:48:50.714 INFO:teuthology.orchestra.run.smithi130.stdout:(50/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2023-10-16T08:48:50.748 INFO:teuthology.orchestra.run.smithi130.stdout:(51/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2023-10-16T08:48:50.771 INFO:teuthology.orchestra.run.smithi094.stdout:(107/143): python3-cherrypy-18.6.1-2.el9.noarch 1.1 MB/s | 358 kB 00:00 2023-10-16T08:48:50.781 INFO:teuthology.orchestra.run.smithi130.stdout:(52/143): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 34 kB 00:00 2023-10-16T08:48:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:(108/143): python3-google-auth-2.23.2-1.el9.noa 761 kB/s | 196 kB 00:00 2023-10-16T08:48:50.922 INFO:teuthology.orchestra.run.smithi094.stdout:(109/143): python3-jaraco-8.2.1-3.el9.noarch.rp 41 kB/s | 11 kB 00:00 2023-10-16T08:48:50.982 INFO:teuthology.orchestra.run.smithi130.stdout:(53/143): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2023-10-16T08:48:51.031 INFO:teuthology.orchestra.run.smithi094.stdout:(110/143): python3-jaraco-classes-3.2.1-5.el9.n 68 kB/s | 18 kB 00:00 2023-10-16T08:48:51.049 INFO:teuthology.orchestra.run.smithi130.stdout:(54/143): postgresql-13.11-1.el9.x86_64.rpm 5.1 MB/s | 1.5 MB 00:00 2023-10-16T08:48:51.091 INFO:teuthology.orchestra.run.smithi130.stdout:(55/143): postgresql-contrib-13.11-1.el9.x86_64 2.6 MB/s | 811 kB 00:00 2023-10-16T08:48:51.116 INFO:teuthology.orchestra.run.smithi130.stdout:(56/143): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-10-16T08:48:51.131 INFO:teuthology.orchestra.run.smithi094.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2023-10-16T08:48:51.190 INFO:teuthology.orchestra.run.smithi094.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2023-10-16T08:48:51.366 INFO:teuthology.orchestra.run.smithi130.stdout:(57/143): postgresql-server-13.11-1.el9.x86_64. 21 MB/s | 5.7 MB 00:00 2023-10-16T08:48:51.457 INFO:teuthology.orchestra.run.smithi094.stdout:(113/143): python3-jaraco-text-3.2.0-6.el9.noar 46 kB/s | 20 kB 00:00 2023-10-16T08:48:51.475 INFO:teuthology.orchestra.run.smithi130.stdout:(58/143): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2023-10-16T08:48:51.482 INFO:teuthology.orchestra.run.smithi094.stdout:(114/143): python3-jwt+crypto-2.4.0-1.el9.noarc 26 kB/s | 9.0 kB 00:00 2023-10-16T08:48:51.500 INFO:teuthology.orchestra.run.smithi130.stdout:(59/143): python3-devel-3.9.17-2.el9.x86_64.rpm 536 kB/s | 205 kB 00:00 2023-10-16T08:48:51.507 INFO:teuthology.orchestra.run.smithi094.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 129 kB/s | 41 kB 00:00 2023-10-16T08:48:51.534 INFO:teuthology.orchestra.run.smithi130.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-10-16T08:48:51.559 INFO:teuthology.orchestra.run.smithi130.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 24 kB 00:00 2023-10-16T08:48:51.584 INFO:teuthology.orchestra.run.smithi130.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 224 kB/s | 18 kB 00:00 2023-10-16T08:48:51.609 INFO:teuthology.orchestra.run.smithi130.stdout:(63/143): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-10-16T08:48:51.651 INFO:teuthology.orchestra.run.smithi130.stdout:(64/143): python3-markupsafe-1.1.1-12.el9.x86_6 488 kB/s | 32 kB 00:00 2023-10-16T08:48:51.777 INFO:teuthology.orchestra.run.smithi130.stdout:(65/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-10-16T08:48:51.802 INFO:teuthology.orchestra.run.smithi130.stdout:(66/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-10-16T08:48:51.827 INFO:teuthology.orchestra.run.smithi130.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-10-16T08:48:51.841 INFO:teuthology.orchestra.run.smithi094.stdout:(116/143): python3-logutils-0.3.5-21.el9.noarch 139 kB/s | 46 kB 00:00 2023-10-16T08:48:51.869 INFO:teuthology.orchestra.run.smithi130.stdout:(68/143): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-10-16T08:48:51.903 INFO:teuthology.orchestra.run.smithi130.stdout:(69/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2023-10-16T08:48:51.910 INFO:teuthology.orchestra.run.smithi094.stdout:(117/143): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2023-10-16T08:48:51.928 INFO:teuthology.orchestra.run.smithi130.stdout:(70/143): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2023-10-16T08:48:51.932 INFO:teuthology.orchestra.run.smithi094.stdout:(118/143): python3-more-itertools-8.12.0-2.el9. 186 kB/s | 79 kB 00:00 2023-10-16T08:48:51.953 INFO:teuthology.orchestra.run.smithi130.stdout:(71/143): python3-requests-oauthlib-1.3.0-12.el 531 kB/s | 43 kB 00:00 2023-10-16T08:48:51.978 INFO:teuthology.orchestra.run.smithi130.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 796 kB/s | 39 kB 00:00 2023-10-16T08:48:52.133 INFO:teuthology.orchestra.run.smithi094.stdout:(119/143): python3-natsort-7.1.1-5.el9.noarch.r 198 kB/s | 58 kB 00:00 2023-10-16T08:48:52.187 INFO:teuthology.orchestra.run.smithi130.stdout:(73/143): uuid-1.6.2-55.el9.x86_64.rpm 299 kB/s | 56 kB 00:00 2023-10-16T08:48:52.217 INFO:teuthology.orchestra.run.smithi094.stdout:(120/143): python3-portend-3.1.0-2.el9.noarch.r 58 kB/s | 16 kB 00:00 2023-10-16T08:48:52.220 INFO:teuthology.orchestra.run.smithi130.stdout:(74/143): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-10-16T08:48:52.267 INFO:teuthology.orchestra.run.smithi094.stdout:(121/143): python3-pecan-1.4.2-3.el9.noarch.rpm 817 kB/s | 272 kB 00:00 2023-10-16T08:48:52.429 INFO:teuthology.orchestra.run.smithi130.stdout:(75/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2023-10-16T08:48:52.434 INFO:teuthology.orchestra.run.smithi094.stdout:(122/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 300 kB/s | 90 kB 00:00 2023-10-16T08:48:52.477 INFO:teuthology.orchestra.run.smithi130.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 217 kB/s | 63 kB 00:00 2023-10-16T08:48:52.505 INFO:teuthology.orchestra.run.smithi130.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 287 kB/s | 79 kB 00:00 2023-10-16T08:48:52.509 INFO:teuthology.orchestra.run.smithi094.stdout:(123/143): python3-repoze-lru-0.7-16.el9.noarch 106 kB/s | 31 kB 00:00 2023-10-16T08:48:52.538 INFO:teuthology.orchestra.run.smithi130.stdout:(78/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-10-16T08:48:52.580 INFO:teuthology.orchestra.run.smithi130.stdout:(79/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.8 MB/s | 803 kB 00:00 2023-10-16T08:48:52.593 INFO:teuthology.orchestra.run.smithi094.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 580 kB/s | 188 kB 00:00 2023-10-16T08:48:52.605 INFO:teuthology.orchestra.run.smithi130.stdout:(80/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-10-16T08:48:52.631 INFO:teuthology.orchestra.run.smithi130.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-10-16T08:48:52.672 INFO:teuthology.orchestra.run.smithi130.stdout:(82/143): python3-pycparser-2.20-6.el9.noarch.r 1.9 MB/s | 124 kB 00:00 2023-10-16T08:48:52.697 INFO:teuthology.orchestra.run.smithi130.stdout:(83/143): python3-requests-2.25.1-7.el9.noarch. 1.2 MB/s | 113 kB 00:00 2023-10-16T08:48:52.731 INFO:teuthology.orchestra.run.smithi130.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 1.9 MB/s | 188 kB 00:00 2023-10-16T08:48:52.755 INFO:teuthology.orchestra.run.smithi094.stdout:(125/143): python3-rsa-4.9-2.el9.noarch.rpm 184 kB/s | 59 kB 00:00 2023-10-16T08:48:52.794 INFO:teuthology.orchestra.run.smithi094.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 126 kB/s | 36 kB 00:00 2023-10-16T08:48:52.869 INFO:teuthology.orchestra.run.smithi094.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 185 kB/s | 51 kB 00:00 2023-10-16T08:48:52.873 INFO:teuthology.orchestra.run.smithi130.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 158 kB/s | 22 kB 00:00 2023-10-16T08:48:52.932 INFO:teuthology.orchestra.run.smithi130.stdout:(86/143): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2023-10-16T08:48:52.976 INFO:teuthology.orchestra.run.smithi130.stdout:(87/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2023-10-16T08:48:53.001 INFO:teuthology.orchestra.run.smithi130.stdout:(88/143): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-10-16T08:48:53.026 INFO:teuthology.orchestra.run.smithi130.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 516 kB/s | 26 kB 00:00 2023-10-16T08:48:53.052 INFO:teuthology.orchestra.run.smithi094.stdout:(128/143): python3-webob-1.8.7-6.el9.noarch.rpm 775 kB/s | 230 kB 00:00 2023-10-16T08:48:53.068 INFO:teuthology.orchestra.run.smithi130.stdout:(90/143): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2023-10-16T08:48:53.086 INFO:teuthology.orchestra.run.smithi094.stdout:(129/143): python3-websocket-client-1.2.3-2.el9 307 kB/s | 90 kB 00:00 2023-10-16T08:48:53.093 INFO:teuthology.orchestra.run.smithi130.stdout:(91/143): python3-pytz-2021.1-5.el9.noarch.rpm 771 kB/s | 51 kB 00:00 2023-10-16T08:48:53.119 INFO:teuthology.orchestra.run.smithi130.stdout:(92/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 86 kB 00:00 2023-10-16T08:48:53.144 INFO:teuthology.orchestra.run.smithi130.stdout:(93/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 914 kB/s | 45 kB 00:00 2023-10-16T08:48:53.203 INFO:teuthology.orchestra.run.smithi094.stdout:(130/143): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2023-10-16T08:48:53.328 INFO:teuthology.orchestra.run.smithi094.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 73 kB/s | 20 kB 00:00 2023-10-16T08:48:53.369 INFO:teuthology.orchestra.run.smithi130.stdout:(94/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2023-10-16T08:48:53.405 INFO:teuthology.orchestra.run.smithi094.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 605 kB/s | 192 kB 00:00 2023-10-16T08:48:53.653 INFO:teuthology.orchestra.run.smithi130.stdout:(95/143): fmt-8.1.1-5.el9.x86_64.rpm 208 kB/s | 111 kB 00:00 2023-10-16T08:48:53.737 INFO:teuthology.orchestra.run.smithi130.stdout:(96/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 522 kB/s | 309 kB 00:00 2023-10-16T08:48:53.737 INFO:teuthology.orchestra.run.smithi094.stdout:(133/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 9.1 MB/s | 3.0 MB 00:00 2023-10-16T08:48:53.762 INFO:teuthology.orchestra.run.smithi130.stdout:(97/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 226 kB/s | 24 kB 00:00 2023-10-16T08:48:53.787 INFO:teuthology.orchestra.run.smithi094.stdout:(134/143): thrift-0.15.0-2.el9.x86_64.rpm 2.7 MB/s | 1.6 MB 00:00 2023-10-16T08:48:53.813 INFO:teuthology.orchestra.run.smithi094.stdout:(135/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 913 kB/s | 68 kB 00:00 2023-10-16T08:48:53.820 INFO:teuthology.orchestra.run.smithi130.stdout:(98/143): liboath-2.6.7-2.el9.x86_64.rpm 588 kB/s | 49 kB 00:00 2023-10-16T08:48:53.870 INFO:teuthology.orchestra.run.smithi130.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 625 kB/s | 67 kB 00:00 2023-10-16T08:48:53.930 INFO:teuthology.orchestra.run.smithi094.stdout:(136/143): NetworkManager-1.45.4-1.el9.x86_64.r 16 MB/s | 2.2 MB 00:00 2023-10-16T08:48:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:(137/143): NetworkManager-libnm-1.45.4-1.el9.x8 9.7 MB/s | 1.8 MB 00:00 2023-10-16T08:48:54.021 INFO:teuthology.orchestra.run.smithi130.stdout:(100/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.1 MB/s | 837 kB 00:00 2023-10-16T08:48:54.022 INFO:teuthology.orchestra.run.smithi094.stdout:(138/143): NetworkManager-team-1.45.4-1.el9.x86 530 kB/s | 41 kB 00:00 2023-10-16T08:48:54.056 INFO:teuthology.orchestra.run.smithi094.stdout:(139/143): NetworkManager-tui-1.45.4-1.el9.x86_ 4.2 MB/s | 244 kB 00:00 2023-10-16T08:48:54.081 INFO:teuthology.orchestra.run.smithi094.stdout:(140/143): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-10-16T08:48:54.104 INFO:teuthology.orchestra.run.smithi130.stdout:(101/143): python3-asyncssh-2.13.2-3.el9.noarch 2.3 MB/s | 548 kB 00:00 2023-10-16T08:48:54.106 INFO:teuthology.orchestra.run.smithi094.stdout:(141/143): libacl-2.3.1-4.el9.x86_64.rpm 451 kB/s | 22 kB 00:00 2023-10-16T08:48:54.130 INFO:teuthology.orchestra.run.smithi130.stdout:(102/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 405 kB/s | 43 kB 00:00 2023-10-16T08:48:54.140 INFO:teuthology.orchestra.run.smithi094.stdout:(142/143): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-10-16T08:48:54.230 INFO:teuthology.orchestra.run.smithi130.stdout:(103/143): libarrow-9.0.0-9.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2023-10-16T08:48:54.232 INFO:teuthology.orchestra.run.smithi094.stdout:(143/143): librados2-18.0.0-6730.g4ba8a190.el9. 3.7 MB/s | 3.3 MB 00:00 2023-10-16T08:48:54.245 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2023-10-16T08:48:54.246 INFO:teuthology.orchestra.run.smithi094.stdout:Total 11 MB/s | 199 MB 00:18 2023-10-16T08:48:54.255 INFO:teuthology.orchestra.run.smithi130.stdout:(104/143): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-10-16T08:48:54.280 INFO:teuthology.orchestra.run.smithi130.stdout:(105/143): python3-cachetools-4.2.4-1.el9.noarc 184 kB/s | 32 kB 00:00 2023-10-16T08:48:54.314 INFO:teuthology.orchestra.run.smithi130.stdout:(106/143): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-10-16T08:48:54.348 INFO:teuthology.orchestra.run.smithi130.stdout:(107/143): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2023-10-16T08:48:54.381 INFO:teuthology.orchestra.run.smithi130.stdout:(108/143): python3-google-auth-2.23.2-1.el9.noa 1.9 MB/s | 196 kB 00:00 2023-10-16T08:48:54.406 INFO:teuthology.orchestra.run.smithi130.stdout:(109/143): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2023-10-16T08:48:54.432 INFO:teuthology.orchestra.run.smithi130.stdout:(110/143): python3-jaraco-classes-3.2.1-5.el9.n 213 kB/s | 18 kB 00:00 2023-10-16T08:48:54.457 INFO:teuthology.orchestra.run.smithi130.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 310 kB/s | 23 kB 00:00 2023-10-16T08:48:54.482 INFO:teuthology.orchestra.run.smithi130.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2023-10-16T08:48:54.507 INFO:teuthology.orchestra.run.smithi130.stdout:(113/143): python3-jaraco-text-3.2.0-6.el9.noar 263 kB/s | 20 kB 00:00 2023-10-16T08:48:54.533 INFO:teuthology.orchestra.run.smithi130.stdout:(114/143): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-10-16T08:48:54.558 INFO:teuthology.orchestra.run.smithi130.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-10-16T08:48:54.608 INFO:teuthology.orchestra.run.smithi130.stdout:(116/143): python3-logutils-0.3.5-21.el9.noarch 621 kB/s | 46 kB 00:00 2023-10-16T08:48:54.633 INFO:teuthology.orchestra.run.smithi130.stdout:(117/143): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2023-10-16T08:48:54.683 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2023-10-16T08:48:54.684 INFO:teuthology.orchestra.run.smithi130.stdout:(118/143): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-10-16T08:48:54.709 INFO:teuthology.orchestra.run.smithi130.stdout:(119/143): python3-natsort-7.1.1-5.el9.noarch.r 579 kB/s | 58 kB 00:00 2023-10-16T08:48:54.743 INFO:teuthology.orchestra.run.smithi130.stdout:(120/143): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2023-10-16T08:48:54.785 INFO:teuthology.orchestra.run.smithi130.stdout:(121/143): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-10-16T08:48:54.810 INFO:teuthology.orchestra.run.smithi130.stdout:(122/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 899 kB/s | 90 kB 00:00 2023-10-16T08:48:54.835 INFO:teuthology.orchestra.run.smithi130.stdout:(123/143): python3-repoze-lru-0.7-16.el9.noarch 336 kB/s | 31 kB 00:00 2023-10-16T08:48:54.870 INFO:teuthology.orchestra.run.smithi130.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-10-16T08:48:54.886 INFO:teuthology.orchestra.run.smithi130.stdout:(125/143): python3-rsa-4.9-2.el9.noarch.rpm 791 kB/s | 59 kB 00:00 2023-10-16T08:48:54.887 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2023-10-16T08:48:54.887 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2023-10-16T08:48:54.903 INFO:teuthology.orchestra.run.smithi130.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2023-10-16T08:48:54.936 INFO:teuthology.orchestra.run.smithi130.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 769 kB/s | 51 kB 00:00 2023-10-16T08:48:54.970 INFO:teuthology.orchestra.run.smithi130.stdout:(128/143): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-10-16T08:48:54.995 INFO:teuthology.orchestra.run.smithi130.stdout:(129/143): python3-websocket-client-1.2.3-2.el9 977 kB/s | 90 kB 00:00 2023-10-16T08:48:55.029 INFO:teuthology.orchestra.run.smithi130.stdout:(130/143): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2023-10-16T08:48:55.054 INFO:teuthology.orchestra.run.smithi130.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2023-10-16T08:48:55.088 INFO:teuthology.orchestra.run.smithi130.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-10-16T08:48:55.163 INFO:teuthology.orchestra.run.smithi130.stdout:(133/143): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2023-10-16T08:48:55.205 INFO:teuthology.orchestra.run.smithi130.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-10-16T08:48:55.305 INFO:teuthology.orchestra.run.smithi130.stdout:(135/143): NetworkManager-1.45.4-1.el9.x86_64.r 23 MB/s | 2.2 MB 00:00 2023-10-16T08:48:55.397 INFO:teuthology.orchestra.run.smithi130.stdout:(136/143): NetworkManager-libnm-1.45.4-1.el9.x8 20 MB/s | 1.8 MB 00:00 2023-10-16T08:48:55.431 INFO:teuthology.orchestra.run.smithi130.stdout:(137/143): NetworkManager-team-1.45.4-1.el9.x86 1.2 MB/s | 41 kB 00:00 2023-10-16T08:48:55.472 INFO:teuthology.orchestra.run.smithi130.stdout:(138/143): NetworkManager-tui-1.45.4-1.el9.x86_ 5.9 MB/s | 244 kB 00:00 2023-10-16T08:48:55.514 INFO:teuthology.orchestra.run.smithi130.stdout:(139/143): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-10-16T08:48:55.548 INFO:teuthology.orchestra.run.smithi130.stdout:(140/143): libacl-2.3.1-4.el9.x86_64.rpm 678 kB/s | 22 kB 00:00 2023-10-16T08:48:55.623 INFO:teuthology.orchestra.run.smithi130.stdout:(141/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 5.7 MB/s | 3.0 MB 00:00 2023-10-16T08:48:55.657 INFO:teuthology.orchestra.run.smithi130.stdout:(142/143): xfsdump-3.1.12-4.el9.x86_64.rpm 2.9 MB/s | 321 kB 00:00 2023-10-16T08:48:55.848 INFO:teuthology.orchestra.run.smithi130.stdout:(143/143): librados2-18.0.0-6730.g4ba8a190.el9. 4.2 MB/s | 3.3 MB 00:00 2023-10-16T08:48:55.863 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-16T08:48:55.863 INFO:teuthology.orchestra.run.smithi130.stdout:Total 15 MB/s | 199 MB 00:13 2023-10-16T08:48:56.290 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-16T08:48:56.493 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-16T08:48:56.494 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-16T08:48:56.959 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2023-10-16T08:48:56.960 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2023-10-16T08:48:58.606 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-16T08:48:58.607 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-16T08:49:02.744 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2023-10-16T08:49:02.842 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-16T08:49:02.870 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-16T08:49:03.058 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-16T08:49:03.161 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-16T08:49:03.583 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-16T08:49:03.687 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T08:49:03.898 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T08:49:03.930 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T08:49:04.049 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T08:49:04.112 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T08:49:04.155 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-16T08:49:04.401 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-16T08:49:04.460 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-16T08:49:04.485 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T08:49:04.604 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-16T08:49:04.634 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T08:49:04.661 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T08:49:04.680 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-16T08:49:04.720 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-16T08:49:04.744 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T08:49:04.747 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-16T08:49:04.838 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-16T08:49:05.005 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-16T08:49:05.207 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T08:49:05.268 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-16T08:49:05.278 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T08:49:05.336 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T08:49:05.478 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T08:49:05.517 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T08:49:05.553 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T08:49:05.562 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T08:49:05.687 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T08:49:05.765 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T08:49:05.812 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-16T08:49:05.973 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T08:49:06.008 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-16T08:49:06.046 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-16T08:49:06.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-16T08:49:06.116 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-16T08:49:06.127 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-16T08:49:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T08:49:06.220 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-16T08:49:06.262 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-16T08:49:06.319 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-16T08:49:06.335 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T08:49:06.367 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T08:49:06.428 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-16T08:49:06.475 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T08:49:06.481 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-16T08:49:06.515 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-16T08:49:06.629 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-16T08:49:06.679 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-16T08:49:06.730 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-16T08:49:06.837 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-16T08:49:06.851 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-16T08:49:06.972 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T08:49:07.028 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-16T08:49:07.060 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T08:49:07.098 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-16T08:49:07.287 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T08:49:07.341 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T08:49:07.801 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T08:49:07.820 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-16T08:49:07.838 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-16T08:49:07.889 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-16T08:49:07.920 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-16T08:49:07.974 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-16T08:49:08.001 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-16T08:49:08.014 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-16T08:49:08.053 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-16T08:49:08.062 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-16T08:49:08.100 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-16T08:49:08.156 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-16T08:49:08.204 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-16T08:49:08.253 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-16T08:49:08.289 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-16T08:49:08.303 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-16T08:49:08.336 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-16T08:49:08.359 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-16T08:49:08.446 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-16T08:49:08.453 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-16T08:49:08.482 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-16T08:49:08.489 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-16T08:49:08.528 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-16T08:49:08.531 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-16T08:49:08.596 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-16T08:49:08.638 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-16T08:49:08.652 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-16T08:49:08.713 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-16T08:49:08.811 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-16T08:49:08.877 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-16T08:49:08.927 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-16T08:49:08.980 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-16T08:49:09.044 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-16T08:49:09.171 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-16T08:49:09.564 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-16T08:49:09.653 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-16T08:49:09.655 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-16T08:49:09.702 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-16T08:49:09.721 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-16T08:49:09.740 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-16T08:49:09.752 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-16T08:49:09.771 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-16T08:49:09.794 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-16T08:49:09.835 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-16T08:49:09.888 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-16T08:49:09.922 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-16T08:49:10.040 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-16T08:49:10.092 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-16T08:49:10.160 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-16T08:49:10.226 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-16T08:49:10.242 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-16T08:49:10.310 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-16T08:49:10.406 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-16T08:49:10.450 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-16T08:49:10.487 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-16T08:49:10.494 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-16T08:49:10.554 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-16T08:49:10.554 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-16T08:49:10.613 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-16T08:49:10.673 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-16T08:49:10.731 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-16T08:49:10.782 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-16T08:49:10.814 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-16T08:49:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-16T08:49:10.868 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-16T08:49:10.896 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-16T08:49:10.915 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-16T08:49:10.939 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-16T08:49:10.960 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-16T08:49:11.003 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-16T08:49:11.085 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-16T08:49:11.088 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-16T08:49:11.128 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-16T08:49:11.141 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-16T08:49:11.166 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-16T08:49:11.182 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-16T08:49:11.201 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-16T08:49:11.238 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-16T08:49:11.274 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-16T08:49:11.310 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-16T08:49:11.316 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-16T08:49:11.354 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-16T08:49:11.389 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-16T08:49:11.446 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-16T08:49:11.469 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-16T08:49:11.484 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-16T08:49:11.518 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-16T08:49:11.599 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-16T08:49:11.629 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-16T08:49:11.674 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-16T08:49:11.676 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-16T08:49:11.818 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-16T08:49:11.882 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-16T08:49:11.956 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-16T08:49:12.012 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-16T08:49:12.191 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-16T08:49:12.248 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-16T08:49:12.272 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-16T08:49:12.310 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-16T08:49:12.354 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-16T08:49:12.397 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-16T08:49:12.449 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-16T08:49:12.532 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-16T08:49:12.589 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-16T08:49:12.631 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-16T08:49:12.736 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-16T08:49:12.778 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-16T08:49:12.813 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-16T08:49:12.863 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-16T08:49:12.874 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-16T08:49:12.916 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-16T08:49:12.921 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-16T08:49:12.978 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-16T08:49:13.061 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-16T08:49:13.106 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-16T08:49:13.122 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-16T08:49:13.163 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-16T08:49:13.244 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-16T08:49:13.311 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-16T08:49:13.398 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-16T08:49:13.435 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-16T08:49:13.532 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-16T08:49:14.289 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-16T08:49:14.336 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-16T08:49:14.337 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-16T08:49:14.369 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-16T08:49:14.475 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-16T08:49:14.492 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-16T08:49:14.536 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-16T08:49:14.772 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-16T08:49:14.808 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-16T08:49:14.901 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-16T08:49:15.723 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-16T08:49:15.872 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-16T08:49:16.044 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-16T08:49:16.141 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-16T08:49:16.178 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-16T08:49:16.210 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-16T08:49:16.242 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-16T08:49:16.598 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-16T08:49:16.631 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T08:49:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T08:49:16.787 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-16T08:49:16.844 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-16T08:49:17.329 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-16T08:49:17.359 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T08:49:17.429 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-16T08:49:17.483 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T08:49:17.510 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-16T08:49:17.511 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-16T08:49:17.548 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-16T08:49:17.579 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-16T08:49:17.619 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-16T08:49:17.981 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-16T08:49:18.017 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T08:49:18.121 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T08:49:18.156 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-16T08:49:18.223 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-16T08:49:18.706 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-16T08:49:18.736 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T08:49:18.828 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T08:49:18.855 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-16T08:49:19.988 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T08:49:20.025 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T08:49:20.642 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T08:49:20.687 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T08:49:20.875 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T08:49:20.875 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-16T08:49:20.875 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-16T08:49:20.876 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:20.921 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T08:49:21.341 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T08:49:21.407 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T08:49:22.044 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T08:49:22.088 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T08:49:22.279 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T08:49:22.279 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-16T08:49:22.280 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-16T08:49:22.280 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:22.330 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T08:49:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T08:49:33.753 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2023-10-16T08:49:33.753 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2023-10-16T08:49:33.754 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2023-10-16T08:49:33.754 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2023-10-16T08:49:33.754 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2023-10-16T08:49:33.754 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2023-10-16T08:49:33.754 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2023-10-16T08:49:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T08:49:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T08:49:34.038 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:34.038 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-16T08:49:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:34.782 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T08:49:34.782 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2023-10-16T08:49:34.783 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2023-10-16T08:49:34.783 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2023-10-16T08:49:34.783 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2023-10-16T08:49:34.783 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2023-10-16T08:49:34.783 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2023-10-16T08:49:34.784 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2023-10-16T08:49:34.784 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:34.990 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T08:49:35.036 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T08:49:35.036 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:35.037 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-16T08:49:35.037 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:35.750 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T08:49:35.835 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T08:49:35.836 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:35.836 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-16T08:49:35.836 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T08:49:35.836 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T08:49:35.836 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:36.057 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T08:49:36.128 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T08:49:36.129 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:36.129 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-16T08:49:36.129 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T08:49:36.129 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T08:49:36.129 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:36.617 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T08:49:36.689 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T08:49:36.690 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:36.690 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-16T08:49:36.690 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T08:49:36.690 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T08:49:36.690 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:36.717 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T08:49:36.799 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T08:49:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-16T08:49:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T08:49:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T08:49:36.800 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:37.026 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T08:49:37.096 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T08:49:37.097 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:37.097 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-16T08:49:37.097 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T08:49:37.098 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T08:49:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:37.371 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T08:49:37.412 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T08:49:37.459 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-16T08:49:37.572 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-16T08:49:37.593 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T08:49:37.606 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T08:49:37.671 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T08:49:37.671 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:37.671 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-16T08:49:37.671 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T08:49:37.672 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T08:49:37.672 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:37.928 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T08:49:37.965 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T08:49:38.305 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T08:49:38.356 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T08:49:38.403 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-16T08:49:38.514 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-16T08:49:38.549 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T08:49:38.871 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T08:49:38.925 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T08:49:39.096 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T08:49:39.124 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T08:49:39.266 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T08:49:39.431 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-16T08:49:39.460 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T08:49:39.535 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T08:49:39.536 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:39.536 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-16T08:49:39.536 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T08:49:39.536 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T08:49:39.536 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:39.644 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T08:49:39.686 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T08:49:40.053 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T08:49:40.083 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T08:49:40.221 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T08:49:40.390 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-16T08:49:40.423 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T08:49:40.502 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T08:49:40.502 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:40.502 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-16T08:49:40.502 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T08:49:40.503 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T08:49:40.503 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:40.552 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T08:49:40.567 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-16T08:49:40.590 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T08:49:40.595 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T08:49:40.673 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T08:49:40.673 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:40.674 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-16T08:49:40.674 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T08:49:40.674 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T08:49:40.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:40.721 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T08:49:40.812 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T08:49:40.812 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:40.813 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-16T08:49:40.813 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:40.888 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T08:49:40.989 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T08:49:40.989 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:40.990 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-16T08:49:40.990 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T08:49:40.990 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T08:49:40.991 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:41.372 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T08:49:41.447 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-16T08:49:41.449 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T08:49:41.449 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:41.449 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-16T08:49:41.449 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T08:49:41.450 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T08:49:41.450 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:41.486 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T08:49:41.570 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T08:49:41.571 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:41.571 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-16T08:49:41.571 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T08:49:41.572 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T08:49:41.572 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:41.621 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T08:49:41.717 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T08:49:41.718 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:41.718 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-16T08:49:41.718 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:41.788 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T08:49:41.885 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T08:49:41.886 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:41.886 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-16T08:49:41.886 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T08:49:41.886 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T08:49:41.886 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:42.247 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T08:49:42.324 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T08:49:42.324 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T08:49:42.325 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-16T08:49:42.325 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T08:49:42.325 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T08:49:42.325 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:45.587 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-16T08:49:45.643 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-16T08:49:45.676 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-16T08:49:45.949 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-16T08:49:46.068 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-16T08:49:46.131 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-16T08:49:46.179 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-16T08:49:46.217 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-16T08:49:46.246 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-16T08:49:46.292 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-16T08:49:46.430 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-16T08:49:46.443 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-16T08:49:46.488 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-16T08:49:46.515 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-16T08:49:46.523 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-16T08:49:46.559 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-16T08:49:46.771 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-16T08:49:46.890 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-16T08:49:46.959 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-16T08:49:47.009 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-16T08:49:47.047 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-16T08:49:47.077 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-16T08:49:47.140 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-16T08:49:47.259 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-16T08:49:47.327 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-16T08:49:47.381 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-16T08:49:47.548 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T08:49:47.591 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T08:49:47.653 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T08:49:47.725 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-16T08:49:48.261 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T08:49:48.304 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T08:49:48.363 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T08:49:48.430 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-16T08:49:49.090 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-16T08:49:49.190 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-16T08:49:49.236 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-16T08:49:49.367 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-16T08:49:49.409 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-16T08:49:49.445 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-16T08:49:49.446 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T08:49:49.548 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T08:49:49.587 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-16T08:49:49.620 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-16T08:49:49.654 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-16T08:49:49.693 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T08:49:49.694 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T08:49:49.798 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-16T08:49:49.885 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-16T08:49:49.932 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-16T08:49:50.028 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T08:49:50.029 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T08:49:50.054 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-16T08:49:50.087 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-16T08:49:50.115 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-16T08:49:50.115 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T08:49:50.226 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T08:49:50.234 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T08:49:50.256 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T08:49:50.257 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T08:49:50.266 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-16T08:49:50.299 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-16T08:49:50.331 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-16T08:49:50.369 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T08:49:50.370 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T08:49:50.387 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T08:49:50.511 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T08:49:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T08:49:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T08:49:50.772 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T08:49:50.773 INFO:teuthology.orchestra.run.smithi094.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-16T08:49:50.773 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:50.846 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T08:49:50.876 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T08:49:50.877 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T08:49:50.990 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T08:49:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T08:49:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T08:49:51.357 INFO:teuthology.orchestra.run.smithi130.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-16T08:49:51.357 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:55.615 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-16T08:49:55.615 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-16T08:49:55.615 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-16T08:49:55.615 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-16T08:49:55.616 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-16T08:49:55.616 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T08:49:55.616 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T08:49:55.616 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T08:49:55.616 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-16T08:49:55.616 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-16T08:49:55.617 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-16T08:49:55.617 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T08:49:55.617 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-16T08:49:55.618 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-16T08:49:55.618 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-16T08:49:55.618 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-16T08:49:55.619 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-16T08:49:55.619 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-16T08:49:55.619 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-16T08:49:55.619 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-16T08:49:55.620 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-16T08:49:55.620 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-16T08:49:55.620 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-16T08:49:55.620 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-16T08:49:55.620 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-16T08:49:55.621 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-16T08:49:55.621 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-16T08:49:55.621 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-16T08:49:55.621 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-16T08:49:55.621 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-16T08:49:55.621 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-16T08:49:55.622 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-16T08:49:55.622 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-16T08:49:55.622 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-16T08:49:55.622 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-16T08:49:55.622 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-16T08:49:55.623 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-16T08:49:55.623 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-16T08:49:55.623 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-16T08:49:55.623 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-16T08:49:55.623 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-16T08:49:55.624 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-16T08:49:55.624 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-16T08:49:55.624 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-16T08:49:55.624 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-16T08:49:55.624 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-16T08:49:55.625 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-16T08:49:55.625 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-16T08:49:55.625 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-16T08:49:55.625 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-16T08:49:55.625 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-16T08:49:55.626 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-16T08:49:55.626 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-16T08:49:55.626 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-16T08:49:55.626 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-16T08:49:55.626 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-16T08:49:55.627 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-16T08:49:55.627 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-16T08:49:55.627 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-16T08:49:55.627 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-16T08:49:55.627 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-16T08:49:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-16T08:49:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-16T08:49:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-16T08:49:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-16T08:49:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-16T08:49:55.629 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-16T08:49:55.629 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-16T08:49:55.629 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-16T08:49:55.629 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-16T08:49:55.630 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-16T08:49:55.630 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-16T08:49:55.630 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-16T08:49:55.630 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-16T08:49:55.631 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-16T08:49:55.631 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-16T08:49:55.631 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-16T08:49:55.631 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-16T08:49:55.631 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-16T08:49:55.631 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-16T08:49:55.632 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-16T08:49:55.632 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-16T08:49:55.632 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-16T08:49:55.632 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-16T08:49:55.632 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-16T08:49:55.633 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-16T08:49:55.633 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-16T08:49:55.633 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-16T08:49:55.633 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-16T08:49:55.633 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-16T08:49:55.634 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-16T08:49:55.634 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-16T08:49:55.634 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-16T08:49:55.634 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-16T08:49:55.634 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-16T08:49:55.635 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-16T08:49:55.635 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-16T08:49:55.635 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-16T08:49:55.635 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-16T08:49:55.635 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-16T08:49:55.635 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-16T08:49:55.636 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-16T08:49:55.636 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-16T08:49:55.636 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-16T08:49:55.636 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-16T08:49:55.636 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-16T08:49:55.637 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-16T08:49:55.637 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-16T08:49:55.637 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-16T08:49:55.637 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-16T08:49:55.637 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-16T08:49:55.637 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-16T08:49:55.638 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-16T08:49:55.638 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-16T08:49:55.638 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-16T08:49:55.638 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-16T08:49:55.638 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-16T08:49:55.639 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-16T08:49:55.639 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-16T08:49:55.639 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-16T08:49:55.639 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-16T08:49:55.640 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-16T08:49:55.640 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-16T08:49:55.640 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-16T08:49:55.640 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-16T08:49:55.640 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-16T08:49:55.640 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-16T08:49:55.641 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-16T08:49:55.641 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-16T08:49:55.641 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-16T08:49:55.641 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-16T08:49:55.641 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-16T08:49:55.642 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-16T08:49:55.642 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-16T08:49:55.642 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-16T08:49:55.642 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-16T08:49:55.642 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-16T08:49:55.643 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-16T08:49:55.643 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-16T08:49:55.643 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-16T08:49:55.643 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-16T08:49:55.643 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-16T08:49:55.643 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-16T08:49:55.644 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-16T08:49:55.644 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-16T08:49:55.644 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-16T08:49:55.644 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-16T08:49:55.644 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-16T08:49:55.645 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-16T08:49:55.645 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-16T08:49:55.645 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T08:49:55.645 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-16T08:49:55.943 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-16T08:49:55.943 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-16T08:49:55.943 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-16T08:49:55.943 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-16T08:49:55.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-16T08:49:55.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T08:49:55.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T08:49:55.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T08:49:55.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-16T08:49:55.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-16T08:49:55.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-16T08:49:55.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T08:49:55.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-16T08:49:55.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-16T08:49:55.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-16T08:49:55.946 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-16T08:49:55.946 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-16T08:49:55.946 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-16T08:49:55.946 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-16T08:49:55.946 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-16T08:49:55.947 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-16T08:49:55.947 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-16T08:49:55.947 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-16T08:49:55.947 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-16T08:49:55.947 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-16T08:49:55.958 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-16T08:49:55.958 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-16T08:49:55.958 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-16T08:49:55.959 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-16T08:49:55.959 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-16T08:49:55.959 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-16T08:49:55.959 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-16T08:49:55.959 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-16T08:49:55.960 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-16T08:49:55.960 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-16T08:49:55.960 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-16T08:49:55.960 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-16T08:49:55.960 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-16T08:49:55.960 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-16T08:49:55.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-16T08:49:55.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-16T08:49:55.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-16T08:49:55.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-16T08:49:55.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-16T08:49:55.962 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-16T08:49:55.962 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-16T08:49:55.962 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-16T08:49:55.962 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-16T08:49:55.962 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-16T08:49:55.963 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-16T08:49:55.963 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-16T08:49:55.963 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-16T08:49:55.963 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-16T08:49:55.963 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-16T08:49:55.963 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-16T08:49:55.964 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-16T08:49:55.964 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-16T08:49:55.964 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-16T08:49:55.964 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-16T08:49:55.964 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-16T08:49:55.965 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-16T08:49:55.965 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-16T08:49:55.965 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-16T08:49:55.965 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-16T08:49:55.965 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-16T08:49:55.965 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-16T08:49:55.966 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-16T08:49:55.966 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-16T08:49:55.966 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-16T08:49:55.966 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-16T08:49:55.966 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-16T08:49:55.967 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-16T08:49:55.968 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-16T08:49:55.968 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-16T08:49:55.968 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-16T08:49:55.968 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-16T08:49:55.969 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-16T08:49:55.969 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-16T08:49:55.969 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-16T08:49:55.969 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-16T08:49:55.969 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-16T08:49:55.970 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-16T08:49:55.970 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-16T08:49:55.970 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-16T08:49:55.970 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-16T08:49:55.971 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-16T08:49:55.971 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-16T08:49:55.971 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-16T08:49:55.971 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-16T08:49:55.971 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-16T08:49:55.972 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-16T08:49:55.972 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-16T08:49:55.972 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-16T08:49:55.972 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-16T08:49:55.972 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-16T08:49:55.972 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-16T08:49:55.973 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-16T08:49:55.973 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-16T08:49:55.973 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-16T08:49:55.973 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-16T08:49:55.973 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-16T08:49:55.974 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-16T08:49:55.974 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-16T08:49:55.974 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-16T08:49:55.974 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-16T08:49:55.974 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-16T08:49:55.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-16T08:49:55.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-16T08:49:55.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-16T08:49:55.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-16T08:49:55.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-16T08:49:55.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-16T08:49:55.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-16T08:49:55.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-16T08:49:55.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-16T08:49:55.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-16T08:49:55.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-16T08:49:55.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-16T08:49:55.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-16T08:49:55.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-16T08:49:55.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-16T08:49:55.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-16T08:49:55.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-16T08:49:55.978 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-16T08:49:55.978 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-16T08:49:55.978 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-16T08:49:55.978 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-16T08:49:55.978 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-16T08:49:55.979 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-16T08:49:55.979 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-16T08:49:55.979 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-16T08:49:55.979 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-16T08:49:55.979 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-16T08:49:55.980 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-16T08:49:55.980 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-16T08:49:55.980 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-16T08:49:55.980 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-16T08:49:55.980 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-16T08:49:55.981 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-16T08:49:55.981 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-16T08:49:55.981 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-16T08:49:55.981 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-16T08:49:55.981 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-16T08:49:55.981 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-16T08:49:55.982 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-16T08:49:55.982 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-16T08:49:55.982 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-16T08:49:55.982 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-16T08:49:55.982 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-16T08:49:55.983 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-16T08:49:55.983 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T08:49:55.983 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-16T08:49:57.666 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T08:49:57.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:57.667 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2023-10-16T08:49:57.667 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:57.667 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:57.667 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:57.667 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:57.668 INFO:teuthology.orchestra.run.smithi094.stdout: acl-2.3.1-4.el9.x86_64 2023-10-16T08:49:57.668 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-16T08:49:57.668 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-16T08:49:57.668 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.668 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.669 INFO:teuthology.orchestra.run.smithi094.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-16T08:49:57.669 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2023-10-16T08:49:57.669 INFO:teuthology.orchestra.run.smithi094.stdout: automake-1.16.2-8.el9.noarch 2023-10-16T08:49:57.669 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.7.4-5.el9.x86_64 2023-10-16T08:49:57.669 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-16T08:49:57.670 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.670 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.670 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.670 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.670 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.671 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.671 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.671 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.671 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.671 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.672 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.672 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.672 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.672 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.672 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.673 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.673 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.673 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.673 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.673 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.674 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.674 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.674 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:57.674 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-16T08:49:57.674 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.4-9.el9.x86_64 2023-10-16T08:49:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-16T08:49:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-16T08:49:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-16T08:49:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-16T08:49:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-16T08:49:57.676 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-16T08:49:57.676 INFO:teuthology.orchestra.run.smithi094.stdout: jq-1.6-15.el9.x86_64 2023-10-16T08:49:57.676 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-16T08:49:57.676 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-16T08:49:57.676 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-16T08:49:57.677 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.677 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.677 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.677 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-16T08:49:57.677 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-16T08:49:57.677 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-16T08:49:57.678 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-16T08:49:57.678 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-16T08:49:57.678 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.678 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-16T08:49:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-16T08:49:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-16T08:49:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-16T08:49:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-16T08:49:57.680 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-16T08:49:57.680 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-16T08:49:57.680 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-16T08:49:57.680 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-16T08:49:57.680 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-16T08:49:57.681 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-16T08:49:57.681 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-13.11-1.el9.x86_64 2023-10-16T08:49:57.681 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-16T08:49:57.681 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-16T08:49:57.681 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-16T08:49:57.682 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-16T08:49:57.682 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-16T08:49:57.682 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-16T08:49:57.682 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-16T08:49:57.682 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.683 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.683 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.683 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-16T08:49:57.683 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-16T08:49:57.683 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-16T08:49:57.684 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-16T08:49:57.684 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-16T08:49:57.684 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-16T08:49:57.684 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-16T08:49:57.684 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-16T08:49:57.685 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-16T08:49:57.685 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-16T08:49:57.685 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-16T08:49:57.685 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-16T08:49:57.685 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-16T08:49:57.686 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-16T08:49:57.686 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-16T08:49:57.686 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-16T08:49:57.686 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-16T08:49:57.686 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-16T08:49:57.687 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-16T08:49:57.687 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-16T08:49:57.687 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-16T08:49:57.687 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-16T08:49:57.687 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-16T08:49:57.688 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-16T08:49:57.688 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-16T08:49:57.688 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-16T08:49:57.688 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-16T08:49:57.688 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2023-10-16T08:49:57.689 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-16T08:49:57.689 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-16T08:49:57.689 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-16T08:49:57.689 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-16T08:49:57.689 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-16T08:49:57.690 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-16T08:49:57.690 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-16T08:49:57.690 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.690 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.690 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-16T08:49:57.691 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-16T08:49:57.691 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-16T08:49:57.691 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.691 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-16T08:49:57.691 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-16T08:49:57.692 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-16T08:49:57.692 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-16T08:49:57.692 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-16T08:49:57.692 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-16T08:49:57.692 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-16T08:49:57.692 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-16T08:49:57.693 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-16T08:49:57.693 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-16T08:49:57.693 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-16T08:49:57.693 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.693 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.694 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:57.694 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-3.el9.x86_64 2023-10-16T08:49:57.694 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-16T08:49:57.694 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-16T08:49:57.695 INFO:teuthology.orchestra.run.smithi094.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-16T08:49:57.695 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-16T08:49:57.695 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-16T08:49:57.696 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-16T08:49:57.696 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:49:57.696 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2023-10-16T08:49:58.003 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T08:49:58.004 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:58.004 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-10-16T08:49:58.004 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:58.004 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:58.004 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:58.004 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-16T08:49:58.005 INFO:teuthology.orchestra.run.smithi130.stdout: acl-2.3.1-4.el9.x86_64 2023-10-16T08:49:58.005 INFO:teuthology.orchestra.run.smithi130.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-16T08:49:58.005 INFO:teuthology.orchestra.run.smithi130.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-16T08:49:58.005 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.005 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.006 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-16T08:49:58.006 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-16T08:49:58.006 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2023-10-16T08:49:58.006 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2023-10-16T08:49:58.006 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-16T08:49:58.007 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.007 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.007 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.007 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.007 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.008 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.008 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.008 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.008 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.008 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.008 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.009 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.009 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.009 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.009 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.009 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.009 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.010 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.010 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.010 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.010 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.011 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.011 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T08:49:58.011 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-16T08:49:58.011 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2023-10-16T08:49:58.011 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-16T08:49:58.011 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-16T08:49:58.012 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-16T08:49:58.012 INFO:teuthology.orchestra.run.smithi130.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-16T08:49:58.012 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-16T08:49:58.012 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-16T08:49:58.012 INFO:teuthology.orchestra.run.smithi130.stdout: jq-1.6-15.el9.x86_64 2023-10-16T08:49:58.013 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-16T08:49:58.013 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-16T08:49:58.013 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-16T08:49:58.013 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.013 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.013 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.014 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-16T08:49:58.014 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-16T08:49:58.014 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-16T08:49:58.014 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-16T08:49:58.014 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-16T08:49:58.015 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.015 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.015 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-16T08:49:58.015 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.015 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-16T08:49:58.016 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-16T08:49:58.016 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-16T08:49:58.016 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-16T08:49:58.016 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-16T08:49:58.016 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-16T08:49:58.017 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-16T08:49:58.017 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-16T08:49:58.017 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-16T08:49:58.017 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-16T08:49:58.017 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.11-1.el9.x86_64 2023-10-16T08:49:58.018 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-16T08:49:58.018 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-16T08:49:58.018 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-16T08:49:58.018 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-16T08:49:58.018 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-16T08:49:58.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-16T08:49:58.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-16T08:49:58.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.019 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.020 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-16T08:49:58.020 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-16T08:49:58.020 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-16T08:49:58.020 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-16T08:49:58.020 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-16T08:49:58.021 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-16T08:49:58.021 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-16T08:49:58.021 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-16T08:49:58.021 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-16T08:49:58.021 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-16T08:49:58.021 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-16T08:49:58.022 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-16T08:49:58.022 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-16T08:49:58.022 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-16T08:49:58.022 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-16T08:49:58.022 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-16T08:49:58.023 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-16T08:49:58.023 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-16T08:49:58.023 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-16T08:49:58.023 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-16T08:49:58.023 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-16T08:49:58.024 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-16T08:49:58.024 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-16T08:49:58.024 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-16T08:49:58.024 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-16T08:49:58.024 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-16T08:49:58.025 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-16T08:49:58.025 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2023-10-16T08:49:58.025 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-16T08:49:58.025 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-16T08:49:58.025 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-16T08:49:58.025 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-16T08:49:58.026 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-16T08:49:58.026 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-16T08:49:58.026 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-16T08:49:58.026 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.026 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.027 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-16T08:49:58.027 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-16T08:49:58.027 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-16T08:49:58.027 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.027 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-16T08:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-16T08:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-16T08:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-16T08:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-16T08:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-16T08:49:58.028 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-16T08:49:58.029 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-16T08:49:58.029 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-16T08:49:58.029 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-16T08:49:58.029 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-16T08:49:58.029 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.029 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.030 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T08:49:58.030 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2023-10-16T08:49:58.030 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-16T08:49:58.030 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-16T08:49:58.030 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-16T08:49:58.031 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-16T08:49:58.031 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-16T08:49:58.031 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-16T08:49:58.032 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:49:58.032 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-16T08:49:58.247 DEBUG:teuthology.parallel:result is None 2023-10-16T08:49:58.482 DEBUG:teuthology.parallel:result is None 2023-10-16T08:49:58.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T08:49:58.707 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T08:49:58.781 INFO:teuthology.orchestra.run.smithi094.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-16T08:49:58.782 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-16T08:49:58.782 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T08:49:58.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T08:49:58.926 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T08:49:58.996 INFO:teuthology.orchestra.run.smithi130.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-16T08:49:58.997 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-16T08:49:58.997 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T08:49:58.997 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T08:49:58.998 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:49:58.998 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T08:49:59.081 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:49:59.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T08:49:59.167 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T08:49:59.168 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:49:59.168 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T08:49:59.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T08:49:59.360 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:49:59.361 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T08:49:59.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T08:49:59.553 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T08:49:59.554 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:49:59.554 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T08:49:59.643 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T08:49:59.757 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:49:59.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T08:49:59.861 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T08:49:59.989 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T08:49:59.990 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:49:59.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T08:50:00.094 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T08:50:00.179 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:00.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T08:50:00.258 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T08:50:00.373 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T08:50:00.437 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T08:50:00.438 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2023-10-16T08:50:00.444 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-10-16T08:50:00.521 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T08:50:00.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T08:50:00.526 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T08:50:00.599 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T08:50:00.600 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T08:50:00.606 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T08:50:00.684 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T08:50:00.684 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T08:50:00.684 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T08:50:00.685 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:00.685 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T08:50:00.725 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T08:50:00.936 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T08:50:01.015 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:01.015 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T08:50:01.057 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T08:50:01.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T08:50:01.350 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T08:50:01.350 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T08:50:01.351 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7428933', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-qa1', 'sha1': '75071e9ab3c3bca3308a5f42b10f82d632c58444'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-qa1', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '75071e9ab3c3bca3308a5f42b10f82d632c58444', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIDtYanxnZnQdiajc3h0gVfF4mqA/1udBJaONh8NTFWOPU1JM8j9veTPKdwjiQCKSwhOrQS6WtwZ2GAYpdCT++k=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4sMmDYQziwGjqS8rNGBmMLOo3oot4NX7CXQRSRiZOXLdDk1CTLJQklvl1jjFI2/BRSjMjrEzA6emJN69JuwT8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_06:54:33', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T08:50:01.352 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T08:50:01.357 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T08:50:01.398 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T08:50:01.443 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T08:50:01.520 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:01.520 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T08:50:01.566 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T08:50:01.566 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2023-10-16T08:50:01.656 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T08:50:01.656 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:01.657 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-10-16T08:50:01.657 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:01.657 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:01.657 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-10-16 08:49:51.258805562 +0000 2023-10-16T08:50:01.657 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-10-16 08:47:20.986958030 +0000 2023-10-16T08:50:01.658 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-10-16 08:47:20.986958030 +0000 2023-10-16T08:50:01.658 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2023-10-16 08:47:20.986958030 +0000 2023-10-16T08:50:01.658 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T08:50:01.735 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-10-16T08:50:01.736 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-10-16T08:50:01.736 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000354827 s, 1.4 MB/s 2023-10-16T08:50:01.738 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T08:50:01.789 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2023-10-16T08:50:01.829 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T08:50:01.830 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:01.830 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-10-16T08:50:01.830 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:01.830 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:01.831 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-10-16 08:49:51.258805562 +0000 2023-10-16T08:50:01.831 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-10-16 08:47:21.975941172 +0000 2023-10-16T08:50:01.831 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-10-16 08:47:21.975941172 +0000 2023-10-16T08:50:01.831 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2023-10-16 08:47:21.975941172 +0000 2023-10-16T08:50:01.832 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T08:50:01.941 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-10-16T08:50:01.941 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-10-16T08:50:01.942 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000295627 s, 1.7 MB/s 2023-10-16T08:50:01.944 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T08:50:01.988 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2023-10-16T08:50:02.072 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T08:50:02.072 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:02.073 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 672 Links: 1 2023-10-16T08:50:02.073 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:02.073 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:02.073 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-10-16 08:49:51.259805545 +0000 2023-10-16T08:50:02.073 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-10-16 08:47:22.970924211 +0000 2023-10-16T08:50:02.074 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-10-16 08:47:22.970924211 +0000 2023-10-16T08:50:02.074 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2023-10-16 08:47:22.970924211 +0000 2023-10-16T08:50:02.074 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T08:50:02.189 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-10-16T08:50:02.190 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-10-16T08:50:02.190 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000231603 s, 2.2 MB/s 2023-10-16T08:50:02.193 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T08:50:02.247 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2023-10-16T08:50:02.290 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T08:50:02.291 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:02.291 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-10-16T08:50:02.291 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:02.291 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:02.292 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2023-10-16 08:49:51.260805528 +0000 2023-10-16T08:50:02.292 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2023-10-16 08:47:24.003906603 +0000 2023-10-16T08:50:02.292 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2023-10-16 08:47:24.003906603 +0000 2023-10-16T08:50:02.292 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2023-10-16 08:47:24.003906603 +0000 2023-10-16T08:50:02.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T08:50:02.420 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2023-10-16T08:50:02.420 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2023-10-16T08:50:02.420 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000282668 s, 1.8 MB/s 2023-10-16T08:50:02.423 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T08:50:02.481 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:02.481 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:02.482 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T08:50:02.542 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T08:50:02.542 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2023-10-16T08:50:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T08:50:02.596 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:02.596 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-10-16T08:50:02.597 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:02.597 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:02.597 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-16 08:49:51.774053126 +0000 2023-10-16T08:50:02.597 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-16 08:47:21.022672321 +0000 2023-10-16T08:50:02.597 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-16 08:47:21.022672321 +0000 2023-10-16T08:50:02.598 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-10-16 08:47:21.022672321 +0000 2023-10-16T08:50:02.598 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T08:50:02.681 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-16T08:50:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-16T08:50:02.682 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000438412 s, 1.2 MB/s 2023-10-16T08:50:02.685 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T08:50:02.739 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2023-10-16T08:50:02.788 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T08:50:02.788 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:02.788 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-10-16T08:50:02.789 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:02.789 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:02.789 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-16 08:49:51.775053109 +0000 2023-10-16T08:50:02.789 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-16 08:47:22.035654615 +0000 2023-10-16T08:50:02.789 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-16 08:47:22.035654615 +0000 2023-10-16T08:50:02.790 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-10-16 08:47:22.035654615 +0000 2023-10-16T08:50:02.790 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T08:50:02.881 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-16T08:50:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-16T08:50:02.882 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000352595 s, 1.5 MB/s 2023-10-16T08:50:02.885 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T08:50:02.942 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2023-10-16T08:50:02.994 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T08:50:02.994 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:02.994 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-10-16T08:50:02.995 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:02.995 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:02.995 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-16 08:49:51.775053109 +0000 2023-10-16T08:50:02.995 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-16 08:47:23.064636628 +0000 2023-10-16T08:50:02.995 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-16 08:47:23.064636628 +0000 2023-10-16T08:50:02.995 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-10-16 08:47:23.064636628 +0000 2023-10-16T08:50:02.996 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T08:50:03.082 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-16T08:50:03.082 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-16T08:50:03.083 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000351692 s, 1.5 MB/s 2023-10-16T08:50:03.086 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T08:50:03.146 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2023-10-16T08:50:03.196 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T08:50:03.196 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T08:50:03.196 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-10-16T08:50:03.197 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T08:50:03.197 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T08:50:03.197 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-16 08:49:51.776053092 +0000 2023-10-16T08:50:03.197 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-16 08:47:24.073618992 +0000 2023-10-16T08:50:03.197 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-16 08:47:24.073618992 +0000 2023-10-16T08:50:03.197 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2023-10-16 08:47:24.073618992 +0000 2023-10-16T08:50:03.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T08:50:03.281 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-16T08:50:03.281 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-16T08:50:03.282 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000364571 s, 1.4 MB/s 2023-10-16T08:50:03.284 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T08:50:03.341 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:03.341 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T08:50:03.342 INFO:tasks.ceph:Generating config... 2023-10-16T08:50:03.343 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T08:50:03.343 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T08:50:03.343 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T08:50:03.344 INFO:tasks.ceph:[client] pid file = 2023-10-16T08:50:03.344 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T08:50:03.344 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T08:50:03.344 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T08:50:03.345 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T08:50:03.345 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T08:50:03.345 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T08:50:03.345 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T08:50:03.346 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T08:50:03.346 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T08:50:03.346 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T08:50:03.347 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T08:50:03.347 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T08:50:03.347 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T08:50:03.347 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T08:50:03.348 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T08:50:03.348 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T08:50:03.348 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T08:50:03.348 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T08:50:03.349 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T08:50:03.349 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T08:50:03.349 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-16T08:50:03.349 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-16T08:50:03.349 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T08:50:03.350 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T08:50:03.350 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-16T08:50:03.350 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T08:50:03.350 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T08:50:03.351 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T08:50:03.351 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T08:50:03.351 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T08:50:03.351 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T08:50:03.352 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T08:50:03.352 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T08:50:03.520 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T08:50:03.528 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T08:50:03.656 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T08:50:03.756 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.b', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]')] 2023-10-16T08:50:03.756 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T08:50:03.757 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:03.757 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T08:50:03.799 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --add b 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:03.947 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:03.947 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid d7b7598f-7f16-4780-92e5-7e8a731f0195 2023-10-16T08:50:03.948 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = pacific 2023-10-16T08:50:03.948 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2023-10-16T08:50:03.948 INFO:teuthology.orchestra.run.smithi094.stdout:fsid d7b7598f-7f16-4780-92e5-7e8a731f0195 2023-10-16T08:50:03.948 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2023-10-16T08:50:03.946841+0000 2023-10-16T08:50:03.948 INFO:teuthology.orchestra.run.smithi094.stdout:created 2023-10-16T08:50:03.946841+0000 2023-10-16T08:50:03.949 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 16 (pacific) 2023-10-16T08:50:03.949 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2023-10-16T08:50:03.949 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2023-10-16T08:50:03.949 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2023-10-16T08:50:03.949 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2023-10-16T08:50:03.949 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T08:50:03.951 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T08:50:03.994 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d7b7598f-7f16-4780-92e5-7e8a731f0195... 2023-10-16T08:50:03.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T08:50:04.041 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T08:50:04.184 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2023-10-16T08:50:04.185 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2023-10-16T08:50:04.185 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T08:50:04.185 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2023-10-16T08:50:04.185 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.185 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2023-10-16T08:50:04.186 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.186 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2023-10-16T08:50:04.186 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.186 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2023-10-16T08:50:04.186 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2023-10-16T08:50:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2023-10-16T08:50:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2023-10-16T08:50:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T08:50:04.188 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2023-10-16T08:50:04.188 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.188 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T08:50:04.188 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T08:50:04.188 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.189 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2023-10-16T08:50:04.189 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.189 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2023-10-16T08:50:04.189 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2023-10-16T08:50:04.189 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2023-10-16T08:50:04.189 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2023-10-16T08:50:04.190 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2023-10-16T08:50:04.190 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2023-10-16T08:50:04.190 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2023-10-16T08:50:04.190 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T08:50:04.190 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T08:50:04.191 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2023-10-16T08:50:04.191 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.191 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T08:50:04.191 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.191 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2023-10-16T08:50:04.191 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.192 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2023-10-16T08:50:04.192 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.192 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2023-10-16T08:50:04.192 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2023-10-16T08:50:04.192 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2023-10-16T08:50:04.192 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-16T08:50:04.193 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = d7b7598f-7f16-4780-92e5-7e8a731f0195 2023-10-16T08:50:04.193 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.193 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2023-10-16T08:50:04.193 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2023-10-16T08:50:04.193 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.194 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2023-10-16T08:50:04.194 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2023-10-16T08:50:04.194 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2023-10-16T08:50:04.194 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.194 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2023-10-16T08:50:04.195 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2023-10-16T08:50:04.195 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.195 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2023-10-16T08:50:04.195 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2023-10-16T08:50:04.195 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2023-10-16T08:50:04.195 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.196 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2023-10-16T08:50:04.196 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2023-10-16T08:50:04.196 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.196 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2023-10-16T08:50:04.196 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.197 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2023-10-16T08:50:04.197 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.197 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2023-10-16T08:50:04.197 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.197 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2023-10-16T08:50:04.198 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2023-10-16T08:50:04.198 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.198 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2023-10-16T08:50:04.198 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2023-10-16T08:50:04.198 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2023-10-16T08:50:04.199 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2023-10-16T08:50:04.199 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2023-10-16T08:50:04.199 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2023-10-16T08:50:04.199 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-16T08:50:04.199 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2023-10-16T08:50:04.199 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2023-10-16T08:50:04.200 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T08:50:04.200 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2023-10-16T08:50:04.200 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2023-10-16T08:50:04.200 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2023-10-16T08:50:04.200 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2023-10-16T08:50:04.200 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2023-10-16T08:50:04.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.201 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2023-10-16T08:50:04.201 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-16T08:50:04.201 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2023-10-16T08:50:04.201 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2023-10-16T08:50:04.202 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2023-10-16T08:50:04.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2023-10-16T08:50:04.202 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2023-10-16T08:50:04.202 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2023-10-16T08:50:04.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.203 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2023-10-16T08:50:04.203 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-16T08:50:04.203 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2023-10-16T08:50:04.203 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2023-10-16T08:50:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2023-10-16T08:50:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2023-10-16T08:50:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2023-10-16T08:50:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2023-10-16T08:50:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2023-10-16T08:50:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2023-10-16T08:50:04.205 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2023-10-16T08:50:04.205 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.205 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T08:50:04.205 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T08:50:04.205 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T08:50:04.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.206 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T08:50:04.206 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T08:50:04.206 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T08:50:04.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.207 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2023-10-16T08:50:04.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2023-10-16T08:50:04.207 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2023-10-16T08:50:04.207 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2023-10-16T08:50:04.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:04.208 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2023-10-16T08:50:04.208 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2023-10-16T08:50:04.208 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2023-10-16T08:50:04.208 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2023-10-16T08:50:04.209 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T08:50:04.209 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T08:50:04.209 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2023-10-16T08:50:04.209 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2023-10-16T08:50:04.209 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-16T08:50:04.209 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2023-10-16T08:50:04.210 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2023-10-16T08:50:04.210 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2023-10-16T08:50:04.210 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2023-10-16T08:50:04.210 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2023-10-16T08:50:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2023-10-16T08:50:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2023-10-16T08:50:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2023-10-16T08:50:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2023-10-16T08:50:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2023-10-16T08:50:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2023-10-16T08:50:04.212 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2023-10-16T08:50:04.212 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2023-10-16T08:50:04.212 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-16T08:50:04.212 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2023-10-16T08:50:04.212 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2023-10-16T08:50:04.212 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2023-10-16T08:50:04.213 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2023-10-16T08:50:04.213 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2023-10-16T08:50:04.213 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2023-10-16T08:50:04.213 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2023-10-16T08:50:04.224 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-10-16T08:50:04.224 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-10-16T08:50:04.224 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T08:50:04.225 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-10-16T08:50:04.225 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.225 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-10-16T08:50:04.225 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.225 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-10-16T08:50:04.225 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.226 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-10-16T08:50:04.226 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-10-16T08:50:04.226 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.226 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-10-16T08:50:04.226 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-10-16T08:50:04.227 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.227 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T08:50:04.227 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-10-16T08:50:04.227 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.227 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T08:50:04.228 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T08:50:04.228 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.228 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-10-16T08:50:04.228 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.228 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-10-16T08:50:04.228 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-10-16T08:50:04.229 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-10-16T08:50:04.229 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-10-16T08:50:04.229 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-10-16T08:50:04.229 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-10-16T08:50:04.229 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-10-16T08:50:04.229 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T08:50:04.230 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T08:50:04.230 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-10-16T08:50:04.230 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.230 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T08:50:04.230 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.231 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-10-16T08:50:04.231 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.231 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-10-16T08:50:04.231 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.231 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-10-16T08:50:04.231 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-10-16T08:50:04.232 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-10-16T08:50:04.232 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.94,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-16T08:50:04.232 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = d7b7598f-7f16-4780-92e5-7e8a731f0195 2023-10-16T08:50:04.232 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.232 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-10-16T08:50:04.232 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-10-16T08:50:04.233 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.233 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-10-16T08:50:04.233 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-10-16T08:50:04.233 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2023-10-16T08:50:04.233 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.234 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-10-16T08:50:04.234 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-10-16T08:50:04.234 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.234 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-10-16T08:50:04.234 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-10-16T08:50:04.235 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-10-16T08:50:04.235 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.235 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-10-16T08:50:04.235 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-10-16T08:50:04.235 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.235 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-10-16T08:50:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-10-16T08:50:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-10-16T08:50:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.236 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-10-16T08:50:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-10-16T08:50:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-10-16T08:50:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-10-16T08:50:04.237 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2023-10-16T08:50:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2023-10-16T08:50:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 20 2023-10-16T08:50:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 20 2023-10-16T08:50:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-16T08:50:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-10-16T08:50:04.238 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 10 2023-10-16T08:50:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T08:50:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2023-10-16T08:50:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2023-10-16T08:50:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2023-10-16T08:50:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2023-10-16T08:50:04.239 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-10-16T08:50:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.240 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-10-16T08:50:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-16T08:50:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-10-16T08:50:04.240 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-16T08:50:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-16T08:50:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-16T08:50:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-16T08:50:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-10-16T08:50:04.241 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.241 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-10-16T08:50:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-16T08:50:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-16T08:50:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-10-16T08:50:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-16T08:50:04.242 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-10-16T08:50:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-10-16T08:50:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-16T08:50:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-10-16T08:50:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-10-16T08:50:04.243 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-16T08:50:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T08:50:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T08:50:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T08:50:04.244 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T08:50:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T08:50:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T08:50:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.245 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2023-10-16T08:50:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2023-10-16T08:50:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2023-10-16T08:50:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: mon op complaint time = 120 2023-10-16T08:50:04.246 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-16T08:50:04.247 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-10-16T08:50:04.247 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-10-16T08:50:04.247 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-10-16T08:50:04.247 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-10-16T08:50:04.247 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T08:50:04.247 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T08:50:04.248 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 600 2023-10-16T08:50:04.248 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-10-16T08:50:04.248 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-16T08:50:04.248 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = "" 2023-10-16T08:50:04.248 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-10-16T08:50:04.249 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-10-16T08:50:04.249 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-10-16T08:50:04.249 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2023-10-16T08:50:04.249 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2023-10-16T08:50:04.249 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-10-16T08:50:04.250 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-10-16T08:50:04.250 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-10-16T08:50:04.250 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2023-10-16T08:50:04.250 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2023-10-16T08:50:04.250 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2023-10-16T08:50:04.251 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds balancer = 20 2023-10-16T08:50:04.251 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-16T08:50:04.251 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug frag = True 2023-10-16T08:50:04.251 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug scatterstat = True 2023-10-16T08:50:04.251 INFO:teuthology.orchestra.run.smithi130.stdout: mds op complaint time = 180 2023-10-16T08:50:04.252 INFO:teuthology.orchestra.run.smithi130.stdout: mds verify scatter = True 2023-10-16T08:50:04.252 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-10-16T08:50:04.252 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-10-16T08:50:04.252 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-10-16T08:50:04.269 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T08:50:04.270 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T08:50:04.406 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T08:50:04.406 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:04.407 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T08:50:04.454 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:04.455 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T08:50:04.535 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:50:04.535 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:04.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T08:50:04.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T08:50:04.699 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:04.699 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:04.791 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:50:04.792 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:04.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T08:50:04.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T08:50:04.944 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:04.945 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:05.036 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T08:50:05.036 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T08:50:05.037 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T08:50:05.202 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T08:50:05.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T08:50:05.378 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T08:50:05.386 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T08:50:05.387 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T08:50:05.565 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T08:50:05.575 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T08:50:05.669 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T08:50:05.850 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T08:50:05.859 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T08:50:05.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T08:50:06.132 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T08:50:06.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T08:50:06.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T08:50:06.394 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T08:50:06.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T08:50:06.504 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T08:50:06.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T08:50:06.636 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T08:50:06.702 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T08:50:06.829 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T08:50:06.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T08:50:07.007 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T08:50:07.071 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-16T08:50:07.199 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-16T08:50:07.256 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T08:50:07.256 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T08:50:07.257 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T08:50:07.360 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:07.360 INFO:tasks.ceph:role: osd.0 2023-10-16T08:50:07.360 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:50:07.361 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T08:50:07.455 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:07.455 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:07.455 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:07.456 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:07.456 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:07.456 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:07.456 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:07.456 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:07.457 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:07.457 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:07.488 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-10-16T08:50:07.493 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-10-16T08:50:07.494 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T08:50:07.603 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T08:50:07.682 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T08:50:07.772 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:07.773 INFO:tasks.ceph:role: osd.1 2023-10-16T08:50:07.773 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:50:07.773 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T08:50:07.859 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:07.859 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:07.859 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:07.859 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:07.860 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:07.860 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:07.860 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:07.860 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:07.860 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:07.861 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:07.892 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-10-16T08:50:07.897 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-10-16T08:50:07.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T08:50:08.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T08:50:08.088 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T08:50:08.171 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:08.172 INFO:tasks.ceph:role: osd.2 2023-10-16T08:50:08.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:50:08.172 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T08:50:08.266 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:08.266 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:08.267 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:08.267 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:08.268 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:08.268 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:08.268 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:08.268 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:08.297 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-10-16T08:50:08.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-10-16T08:50:08.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T08:50:08.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T08:50:08.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T08:50:08.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:08.590 INFO:tasks.ceph:role: osd.3 2023-10-16T08:50:08.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:50:08.590 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T08:50:08.681 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:08.681 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:08.681 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:08.681 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:08.681 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:08.682 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:08.682 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:08.682 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:08.682 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:08.683 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:08.715 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2023-10-16T08:50:08.720 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2023-10-16T08:50:08.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T08:50:08.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T08:50:08.915 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:09.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:09.067+0000 7feee5823500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T08:50:09.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:09.068+0000 7feee5823500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T08:50:09.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:09.068+0000 7feee5823500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T08:50:09.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:09.068+0000 7feee5823500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T08:50:09.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:09.068+0000 7feee5823500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T08:50:09.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:09.071+0000 7feee5823500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T08:50:11.992 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T08:50:12.089 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:12.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:12.225+0000 7f1fa3638500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T08:50:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:12.225+0000 7f1fa3638500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T08:50:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:12.225+0000 7f1fa3638500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T08:50:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:12.225+0000 7f1fa3638500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T08:50:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:12.225+0000 7f1fa3638500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T08:50:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:12.228+0000 7f1fa3638500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T08:50:15.145 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T08:50:15.242 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:15.376+0000 7f0839425500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T08:50:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:15.377+0000 7f0839425500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T08:50:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:15.377+0000 7f0839425500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T08:50:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:15.377+0000 7f0839425500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T08:50:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:15.377+0000 7f0839425500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T08:50:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:15.379+0000 7f0839425500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T08:50:18.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T08:50:18.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:18.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:18.780+0000 7f2704f74500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T08:50:18.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:18.781+0000 7f2704f74500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T08:50:18.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:18.781+0000 7f2704f74500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T08:50:18.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:18.781+0000 7f2704f74500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T08:50:18.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:18.781+0000 7f2704f74500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T08:50:18.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:18.783+0000 7f2704f74500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T08:50:21.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T08:50:21.800 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T08:50:21.903 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:21.903 INFO:tasks.ceph:role: osd.4 2023-10-16T08:50:21.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:50:21.904 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T08:50:22.004 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:22.005 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:22.005 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:22.006 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:22.006 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:22.006 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:22.006 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:22.530 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-16T08:50:22.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-16T08:50:22.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T08:50:22.709 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T08:50:22.815 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T08:50:22.909 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:22.909 INFO:tasks.ceph:role: osd.5 2023-10-16T08:50:22.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:50:22.910 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T08:50:23.008 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:23.008 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:23.008 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:23.009 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:23.009 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:23.009 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:23.009 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:23.009 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:23.010 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:23.010 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:23.498 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-16T08:50:23.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-16T08:50:23.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T08:50:23.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T08:50:23.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T08:50:23.833 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:23.834 INFO:tasks.ceph:role: osd.6 2023-10-16T08:50:23.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:50:23.834 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T08:50:23.936 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:23.937 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:23.937 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:23.938 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:23.938 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:23.938 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:23.939 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:24.449 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-16T08:50:24.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-16T08:50:24.455 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T08:50:24.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T08:50:24.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T08:50:24.831 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T08:50:24.831 INFO:tasks.ceph:role: osd.7 2023-10-16T08:50:24.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:50:24.832 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T08:50:24.933 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T08:50:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T08:50:24.933 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T08:50:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T08:50:24.934 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T08:50:24.934 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-16T08:50:24.934 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T08:50:24.934 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T08:50:24.935 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T08:50:24.935 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T08:50:25.385 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-16T08:50:25.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-16T08:50:25.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T08:50:25.546 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T08:50:25.650 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:25.800 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:25.798+0000 7f2c0102a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T08:50:25.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:25.803+0000 7f2c0102a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T08:50:25.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:25.803+0000 7f2c0102a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T08:50:25.805 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:25.803+0000 7f2c0102a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T08:50:25.806 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:25.803+0000 7f2c0102a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T08:50:25.811 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:25.810+0000 7f2c0102a500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T08:50:29.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T08:50:29.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:29.242 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:29.240+0000 7f0c68214500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T08:50:29.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:29.241+0000 7f0c68214500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T08:50:29.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:29.241+0000 7f0c68214500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T08:50:29.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:29.241+0000 7f0c68214500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T08:50:29.243 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:29.241+0000 7f0c68214500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T08:50:29.244 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:29.243+0000 7f0c68214500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T08:50:31.353 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:50:31.362 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:50:32.194 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T08:50:32.289 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:32.430 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:32.429+0000 7f5d37e14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T08:50:32.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:32.429+0000 7f5d37e14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T08:50:32.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:32.429+0000 7f5d37e14500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T08:50:32.431 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:32.429+0000 7f5d37e14500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T08:50:32.432 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:32.429+0000 7f5d37e14500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T08:50:32.433 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:32.432+0000 7f5d37e14500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T08:50:35.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T08:50:35.464 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:35.600+0000 7f2c65a0d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T08:50:35.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:35.601+0000 7f2c65a0d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T08:50:35.603 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:35.601+0000 7f2c65a0d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T08:50:35.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:35.601+0000 7f2c65a0d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T08:50:35.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:35.601+0000 7f2c65a0d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T08:50:35.604 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:35.603+0000 7f2c65a0d500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T08:50:38.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T08:50:38.880 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T08:50:38.880 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:38.881 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T08:50:38.989 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:38.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T08:50:39.090 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:39.091 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T08:50:39.189 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:39.190 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T08:50:39.287 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:39.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T08:50:39.386 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:39.387 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T08:50:39.479 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:39.480 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T08:50:39.569 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:39.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T08:50:39.667 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:39.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T08:50:39.758 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:39.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T08:50:39.847 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:39.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T08:50:39.940 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:39.940 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T08:50:40.084 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:40.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T08:50:40.178 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:40.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T08:50:40.277 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:40.277 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T08:50:40.337 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:40.337 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T08:50:40.392 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:40.392 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T08:50:40.453 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:40.454 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-16T08:50:40.507 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T08:50:40.507 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T08:50:40.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T08:50:40.605 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2023-10-16T08:50:40.606 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA9+Sxl5IsEDBAAM3U+Kq3lM5sbcEB52TWgrA== 2023-10-16T08:50:40.606 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2023-10-16T08:50:40.606 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA9+Sxl+N2vIRAAiVlhQbB4/KlaD0/uMzK2Nw== 2023-10-16T08:50:40.606 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2023-10-16T08:50:40.606 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA9+SxlQVukMhAAile0aHnbDQJs4QdXEBihrQ== 2023-10-16T08:50:40.607 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2023-10-16T08:50:40.607 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBB+Sxl2F4cBBAAs2jLWhoNofJyqD73J2w4/Q== 2023-10-16T08:50:40.607 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2023-10-16T08:50:40.607 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBE+Sxl5TeEDRAAgAmCwiHOlTdrQsxdecVXUA== 2023-10-16T08:50:40.607 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2023-10-16T08:50:40.608 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBH+Sxl5YGMFhAA7uvjxqKupYur/uVW+1rz5w== 2023-10-16T08:50:40.608 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2023-10-16T08:50:40.608 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBK+Sxl1oqULhAAs9NGpFAkY32Aqr20mwQtOw== 2023-10-16T08:50:40.608 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2023-10-16T08:50:40.608 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA9+SxlV++IFhAAXgG+5AmBo+BXL6/6ihyaqQ== 2023-10-16T08:50:40.609 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2023-10-16T08:50:40.609 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA++SxlzTvWBxAAu21opRN5YDIzcXioGIwj4g== 2023-10-16T08:50:40.609 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2023-10-16T08:50:40.609 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA++SxlZvd/FxAAbaL43YEQM5WWWKanib8hEQ== 2023-10-16T08:50:40.610 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2023-10-16T08:50:40.610 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBR+SxlHr2kLxAAl12On0rOGZE2njAIvVamow== 2023-10-16T08:50:40.610 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2023-10-16T08:50:40.610 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBV+Sxl2UBkDhAAkO6mo4b5ipeFxhIQhXSKbw== 2023-10-16T08:50:40.610 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2023-10-16T08:50:40.611 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBY+SxlWcKkGRAAu96syZk6nLkI84jo0jgnvQ== 2023-10-16T08:50:40.611 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2023-10-16T08:50:40.611 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBb+SxlsgnaIxAA29Lw6t6SqDToSW4m99Fy6w== 2023-10-16T08:50:40.611 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2023-10-16T08:50:40.611 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA++SxlUlLsJRAAUJkmJH2I1H5D3uqFOH2BXQ== 2023-10-16T08:50:40.611 INFO:teuthology.orchestra.run.smithi094.stdout:[client.2] 2023-10-16T08:50:40.612 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA++SxlhE9vMRAAZQF2JzRY+9+0TvmQV5cctA== 2023-10-16T08:50:40.612 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2023-10-16T08:50:40.612 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA/+SxlsfZqABAACwnSBQe73J17rnixyCh9kQ== 2023-10-16T08:50:40.612 INFO:teuthology.orchestra.run.smithi094.stdout:[client.3] 2023-10-16T08:50:40.612 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA/+Sxl6qfXCxAAQt4HpZUXnHRM2DSvu8roIQ== 2023-10-16T08:50:40.614 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2023-10-16T08:50:40.614 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA9+Sxl5IsEDBAAM3U+Kq3lM5sbcEB52TWgrA== 2023-10-16T08:50:40.615 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-10-16T08:50:40.615 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA9+Sxl+N2vIRAAiVlhQbB4/KlaD0/uMzK2Nw== 2023-10-16T08:50:40.615 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-10-16T08:50:40.615 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA9+SxlQVukMhAAile0aHnbDQJs4QdXEBihrQ== 2023-10-16T08:50:40.615 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2023-10-16T08:50:40.616 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBB+Sxl2F4cBBAAs2jLWhoNofJyqD73J2w4/Q== 2023-10-16T08:50:40.616 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2023-10-16T08:50:40.616 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBE+Sxl5TeEDRAAgAmCwiHOlTdrQsxdecVXUA== 2023-10-16T08:50:40.616 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2023-10-16T08:50:40.616 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBH+Sxl5YGMFhAA7uvjxqKupYur/uVW+1rz5w== 2023-10-16T08:50:40.617 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2023-10-16T08:50:40.617 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBK+Sxl1oqULhAAs9NGpFAkY32Aqr20mwQtOw== 2023-10-16T08:50:40.617 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2023-10-16T08:50:40.617 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA9+SxlV++IFhAAXgG+5AmBo+BXL6/6ihyaqQ== 2023-10-16T08:50:40.617 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-10-16T08:50:40.617 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA++SxlzTvWBxAAu21opRN5YDIzcXioGIwj4g== 2023-10-16T08:50:40.618 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2023-10-16T08:50:40.618 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA++SxlZvd/FxAAbaL43YEQM5WWWKanib8hEQ== 2023-10-16T08:50:40.618 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2023-10-16T08:50:40.618 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBR+SxlHr2kLxAAl12On0rOGZE2njAIvVamow== 2023-10-16T08:50:40.618 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2023-10-16T08:50:40.619 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBV+Sxl2UBkDhAAkO6mo4b5ipeFxhIQhXSKbw== 2023-10-16T08:50:40.619 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2023-10-16T08:50:40.619 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY+SxlWcKkGRAAu96syZk6nLkI84jo0jgnvQ== 2023-10-16T08:50:40.619 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2023-10-16T08:50:40.619 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBb+SxlsgnaIxAA29Lw6t6SqDToSW4m99Fy6w== 2023-10-16T08:50:40.620 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-10-16T08:50:40.620 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA++SxlUlLsJRAAUJkmJH2I1H5D3uqFOH2BXQ== 2023-10-16T08:50:40.620 INFO:teuthology.orchestra.run.smithi130.stdout:[client.2] 2023-10-16T08:50:40.620 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA++SxlhE9vMRAAZQF2JzRY+9+0TvmQV5cctA== 2023-10-16T08:50:40.620 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2023-10-16T08:50:40.621 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA/+SxlsfZqABAACwnSBQe73J17rnixyCh9kQ== 2023-10-16T08:50:40.621 INFO:teuthology.orchestra.run.smithi130.stdout:[client.3] 2023-10-16T08:50:40.621 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQA/+Sxl6qfXCxAAQt4HpZUXnHRM2DSvu8roIQ== 2023-10-16T08:50:40.621 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T08:50:40.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T08:50:40.815 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:40.823 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:40.968 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:40.977 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:41.122 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.273 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.282 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.422 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.431 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.569 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:41.720 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T08:50:41.725 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T08:50:41.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:41.871 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:42.018 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:42.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T08:50:42.168 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.173 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.464 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.469 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T08:50:42.763 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:42.772 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:42.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:42.917 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:43.063 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:43.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:43.209 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:43.214 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T08:50:43.356 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T08:50:43.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T08:50:43.450 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T08:50:43.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T08:50:43.687 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T08:50:43.790 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T08:50:43.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T08:50:44.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T08:50:44.135 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T08:50:44.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T08:50:44.373 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:44.382 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T08:50:44.433 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T08:50:44.434 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T08:50:44.435 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T08:50:44.440 INFO:tasks.ceph.mon.a:Started 2023-10-16T08:50:44.441 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T08:50:44.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T08:50:44.447 INFO:tasks.ceph.mon.b:Started 2023-10-16T08:50:44.447 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T08:50:44.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T08:50:44.453 INFO:tasks.ceph.mon.c:Started 2023-10-16T08:50:44.454 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T08:50:44.454 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T08:50:44.454 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T08:50:44.462 INFO:tasks.ceph.mgr.y:Started 2023-10-16T08:50:44.462 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T08:50:44.463 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T08:50:44.467 INFO:tasks.ceph.mgr.x:Started 2023-10-16T08:50:44.468 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T08:50:44.468 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T08:50:44.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.642+0000 7fbe0f4c2640 1 Processor -- start 2023-10-16T08:50:44.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.642+0000 7fbe0f4c2640 1 -- start start 2023-10-16T08:50:44.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0f4c2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:44.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0f4c2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080cf040 con 0x7fbe080ca550 2023-10-16T08:50:44.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0f4c2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080ca9e0 con 0x7fbe08070a30 2023-10-16T08:50:44.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0f4c2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080ce430 con 0x7fbe0815a830 2023-10-16T08:50:44.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0d25e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:44.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0d25e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48570/0 (socket says 172.21.15.94:48570) 2023-10-16T08:50:44.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.643+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 learned_addr learned my addr 172.21.15.94:0/2647824143 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:50:44.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.644+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:44.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.644+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:44.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.644+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:44.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.644+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T08:50:44.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.845+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.845+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.845+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.845+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:44.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:44.845+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T08:50:45.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:45.246+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:45.249 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:45.247+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:45.250 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:45.247+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:45.250 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:45.247+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:45.250 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:45.247+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T08:50:46.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:46.048+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:46.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:46.049+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:46.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:46.049+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:46.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:46.049+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:46.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:46.049+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T08:50:47.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.643+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbe080cb640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:50:47.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.643+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbe080cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:47.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.643+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v1:172.21.15.130:6789/0 conn(0x7fbe08070a30 legacy=0x7fbe080c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:47.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.643+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v1:172.21.15.94:6789/0 conn(0x7fbe080ca550 legacy=0x7fbe08070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:47.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.644+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:47.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.644+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:47.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080ce430 con 0x7fbdec0036e0 2023-10-16T08:50:47.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec008d60 con 0x7fbdec006180 2023-10-16T08:50:47.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.644+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:47.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.644+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:47.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:47.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:47.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T08:50:47.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:47.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:47.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:47.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.645+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T08:50:47.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.846+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:47.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.846+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:47.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.846+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.846+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.846+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.847+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T08:50:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.847+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:47.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.847+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.847+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:47.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:47.847+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T08:50:48.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.248+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:48.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.248+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:48.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:48.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:48.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T08:50:48.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:48.249+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T08:50:49.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:49.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:49.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:49.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:49.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:49.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:49.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:49.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:49.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T08:50:49.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:49.051+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T08:50:50.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 msgr2=0x7fbdec008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:50:50.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec006180 0x7fbdec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:50.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 msgr2=0x7fbdec005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:50:50.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec0036e0 0x7fbdec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:50.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:50.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbe0da5f640 1 -- 172.21.15.94:0/2647824143 reap_dead start 2023-10-16T08:50:50.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:50.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080ce710 con 0x7fbdec004000 2023-10-16T08:50:50.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080ce430 con 0x7fbe0815a830 2023-10-16T08:50:50.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.644+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec008d60 con 0x7fbdec006610 2023-10-16T08:50:50.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.645+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:50.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.645+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:50.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:50.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:50.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:50.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:50.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:50.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:50.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T08:50:50.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.646+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T08:50:50.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.847+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:50.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.847+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:50.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.847+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:50.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.847+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:50.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.847+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:50.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.847+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:50.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.848+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.848+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:50.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.848+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T08:50:50.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:50.848+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T08:50:51.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.249+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:51.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.249+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:51.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.249+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:51.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.249+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:51.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.250+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:51.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.250+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T08:50:51.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.250+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:51.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.250+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:51.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.250+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:51.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:51.250+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T08:50:52.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.051+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:52.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T08:50:52.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0d25e640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:52.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:52.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:52.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T08:50:52.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:52.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:52.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:52.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:52.052+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T08:50:53.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 msgr2=0x7fbdec003ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:50:53.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.130:3300/0 conn(0x7fbdec006610 0x7fbdec003ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:53.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 msgr2=0x7fbdec00b1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:50:53.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> v2:172.21.15.94:3300/0 conn(0x7fbe0815a830 0x7fbdec00b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:53.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 >> v1:172.21.15.94:6789/0 conn(0x7fbdec004000 legacy=0x7fbdec0044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:53.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:53.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec005d50 con 0x7fbdec00d6f0 2023-10-16T08:50:53.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.645+0000 7fbdfeffd640 1 -- 172.21.15.94:0/2647824143 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080ce430 con 0x7fbdec011360 2023-10-16T08:50:53.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.646+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:53.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.646+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:53.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.646+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:53.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.646+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:53.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.646+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T08:50:53.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.847+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:53.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.848+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:53.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.848+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:53.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.848+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:53.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:53.848+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T08:50:54.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.249+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.249+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T08:50:54.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.249+0000 7fbe0ca5d640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T08:50:54.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.249+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T08:50:54.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.249+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T08:50:54.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.889+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618804096 0 0) 0x7fbdec005d50 con 0x7fbdec00d6f0 2023-10-16T08:50:54.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.889+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf4003520 con 0x7fbdec00d6f0 2023-10-16T08:50:54.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3512585170 0 0) 0x7fbdf4003520 con 0x7fbdec00d6f0 2023-10-16T08:50:54.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 msgr2=0x7fbdec013780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:50:54.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdec011360 0x7fbdec013780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec014eb0 con 0x7fbdec00d6f0 2023-10-16T08:50:54.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fbe04016870 con 0x7fbdec00d6f0 2023-10-16T08:50:54.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 >> v1:172.21.15.130:6789/0 conn(0x7fbdec00d6f0 legacy=0x7fbdec00fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:54.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbe0da5f640 1 -- 172.21.15.94:0/2647824143 reap_dead start 2023-10-16T08:50:54.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbdf4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:54.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbdf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:54.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbdf400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:54.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080ce430 con 0x7fbdf40052a0 2023-10-16T08:50:54.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf400c150 con 0x7fbdf40047c0 2023-10-16T08:50:54.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.894+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf400c310 con 0x7fbdf4003970 2023-10-16T08:50:54.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbdf400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbdf4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbdf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0da5f640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 msgr2=0x7fbdf4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:54.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbdf4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0da5f640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 msgr2=0x7fbdf4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:54.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbdf4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0da5f640 1 -- 172.21.15.94:0/2647824143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec014eb0 con 0x7fbdf40052a0 2023-10-16T08:50:54.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.895+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbdf4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:50:54.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.897+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbdf400b980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c1fd0 tx=0x7fbdf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294bdf6ec344cf19 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:54.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.898+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00005e00 con 0x7fbdf40052a0 2023-10-16T08:50:54.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.899+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0002e070 con 0x7fbdf40052a0 2023-10-16T08:50:54.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.899+0000 7fbdfffff640 1 -- 172.21.15.94:0/2647824143 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000072b0 con 0x7fbdf40052a0 2023-10-16T08:50:54.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/2647824143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 msgr2=0x7fbdf400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:54.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbdf400b980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c1fd0 tx=0x7fbdf40057f0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/2647824143 shutdown_connections 2023-10-16T08:50:54.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbdf400b980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbdf4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/2647824143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbdf4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.900+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/2647824143 >> 172.21.15.94:0/2647824143 conn(0x7fbe080b0030 msgr2=0x7fbe080b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:54.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.901+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/2647824143 shutdown_connections 2023-10-16T08:50:54.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.901+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/2647824143 wait complete. 2023-10-16T08:50:54.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.904+0000 7fbe0f4c2640 1 Processor -- start 2023-10-16T08:50:54.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.905+0000 7fbe0f4c2640 1 -- start start 2023-10-16T08:50:54.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0f4c2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbe080cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:54.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0f4c2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbe080ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:54.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0f4c2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbe08155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:54.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0f4c2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f2bd0 con 0x7fbdf40052a0 2023-10-16T08:50:54.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0f4c2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080ad360 con 0x7fbdf40047c0 2023-10-16T08:50:54.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0f4c2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f2050 con 0x7fbdf4003970 2023-10-16T08:50:54.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0da5f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbe08155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0da5f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbe08155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57274/0 (socket says 172.21.15.94:57274) 2023-10-16T08:50:54.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0da5f640 1 -- 172.21.15.94:0/854839111 learned_addr learned my addr 172.21.15.94:0/854839111 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:50:54.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0d25e640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbe080cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.906+0000 7fbe0ca5d640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbe080ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:54.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0da5f640 1 -- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 msgr2=0x7fbe080cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:54.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbe080cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0da5f640 1 -- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 msgr2=0x7fbe080ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:54.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbe080ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0da5f640 1 -- 172.21.15.94:0/854839111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe081f2330 con 0x7fbdf40052a0 2023-10-16T08:50:54.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0da5f640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbe08155400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbe0002b980 tx=0x7fbe0002d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:54.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0003b040 con 0x7fbdf40052a0 2023-10-16T08:50:54.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00007600 con 0x7fbdf40052a0 2023-10-16T08:50:54.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.907+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe081f2610 con 0x7fbdf40052a0 2023-10-16T08:50:54.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.908+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00007990 con 0x7fbdf40052a0 2023-10-16T08:50:54.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.908+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0814dd40 con 0x7fbdf40052a0 2023-10-16T08:50:54.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.908+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbe00030030 con 0x7fbdf40052a0 2023-10-16T08:50:54.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.908+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbe00033430 con 0x7fbdf40052a0 2023-10-16T08:50:54.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.909+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08073ef0 con 0x7fbdf40052a0 2023-10-16T08:50:54.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.912+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbe00045070 con 0x7fbdf40052a0 2023-10-16T08:50:54.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.986+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbe08073ef0 con 0x7fbdf40052a0 2023-10-16T08:50:54.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.988+0000 7fbdfdffb640 1 -- 172.21.15.94:0/854839111 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbe00001780 con 0x7fbdf40052a0 2023-10-16T08:50:54.990 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2023-10-16T08:50:54.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.989+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 msgr2=0x7fbe08155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:54.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.989+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbe08155400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbe0002b980 tx=0x7fbe0002d000 comp rx=0 tx=0).stop 2023-10-16T08:50:54.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 shutdown_connections 2023-10-16T08:50:54.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdf40052a0 0x7fbe08155400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdf40047c0 0x7fbe080ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 --2- 172.21.15.94:0/854839111 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdf4003970 0x7fbe080cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:54.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 >> 172.21.15.94:0/854839111 conn(0x7fbe080b0030 msgr2=0x7fbe081e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:54.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 shutdown_connections 2023-10-16T08:50:54.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:54.990+0000 7fbe0f4c2640 1 -- 172.21.15.94:0/854839111 wait complete. 2023-10-16T08:50:55.008 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T08:50:55.008 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T08:50:55.009 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:55.009 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T08:50:55.085 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:55.085 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T08:50:55.214 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:55.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T08:50:55.298 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:50:55.299 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T08:50:55.430 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:55.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T08:50:55.507 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:55.505+0000 7f4085841040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T08:50:55.523 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:55.523 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T08:50:55.530 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:55.524+0000 7fe87ecb6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T08:50:55.567 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:55.565+0000 7f4085841040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T08:50:55.593 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:55.590+0000 7fe87ecb6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T08:50:55.601 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:55.601 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T08:50:55.730 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:50:55.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T08:50:55.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new d86dc3f4-fa7d-4275-b6da-da86ccad7188 0 2023-10-16T08:50:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.046+0000 7fd40ffff640 1 Processor -- start 2023-10-16T08:50:56.049 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.046+0000 7fd40ffff640 1 -- start start 2023-10-16T08:50:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.047+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 0x7fd410070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.047+0000 7fd40ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd410065ab0 0x7fd410160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.047+0000 7fd40ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4100add40 0x7fd410160f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.047+0000 7fd40ffff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd410071180 con 0x7fd4100add40 2023-10-16T08:50:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.047+0000 7fd40ffff640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100cd880 con 0x7fd410065ab0 2023-10-16T08:50:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.047+0000 7fd40ffff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd410071760 con 0x7fd410070860 2023-10-16T08:50:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd410065ab0 0x7fd410160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 0x7fd410070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd410065ab0 0x7fd410160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:53310/0 (socket says 172.21.15.130:53310) 2023-10-16T08:50:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 0x7fd410070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58276/0 (socket says 172.21.15.130:58276) 2023-10-16T08:50:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 -- 172.21.15.130:0/834157509 learned_addr learned my addr 172.21.15.130:0/834157509 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40f7fe640 1 --2- 172.21.15.130:0/834157509 >> v2:172.21.15.94:3300/0 conn(0x7fd4100add40 0x7fd410160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 -- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 msgr2=0x7fd410070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 --2- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 0x7fd410070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 -- 172.21.15.130:0/834157509 >> v2:172.21.15.94:3300/0 conn(0x7fd4100add40 msgr2=0x7fd410160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 --2- 172.21.15.130:0/834157509 >> v2:172.21.15.94:3300/0 conn(0x7fd4100add40 0x7fd410160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40e7fc640 1 -- 172.21.15.130:0/834157509 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410071a40 con 0x7fd410065ab0 2023-10-16T08:50:56.054 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.048+0000 7fd40effd640 1 --2- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 0x7fd410070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.050+0000 7fd40e7fc640 1 --2- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410065ab0 0x7fd410160a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd41006c020 tx=0x7fd40402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b40e28914d3a69 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.050+0000 7fd40dffb640 1 -- 172.21.15.130:0/834157509 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4040317e0 con 0x7fd410065ab0 2023-10-16T08:50:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.050+0000 7fd40dffb640 1 -- 172.21.15.130:0/834157509 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd404031940 con 0x7fd410065ab0 2023-10-16T08:50:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.050+0000 7fd40dffb640 1 -- 172.21.15.130:0/834157509 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404031cd0 con 0x7fd410065ab0 2023-10-16T08:50:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 -- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410065ab0 msgr2=0x7fd410160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 --2- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410065ab0 0x7fd410160a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd41006c020 tx=0x7fd40402b880 comp rx=0 tx=0).stop 2023-10-16T08:50:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 -- 172.21.15.130:0/834157509 shutdown_connections 2023-10-16T08:50:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 --2- 172.21.15.130:0/834157509 >> v2:172.21.15.94:3300/0 conn(0x7fd4100add40 0x7fd410160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 --2- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410065ab0 0x7fd410160a00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 --2- 172.21.15.130:0/834157509 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410070860 0x7fd410070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 -- 172.21.15.130:0/834157509 >> 172.21.15.130:0/834157509 conn(0x7fd4100cb6d0 msgr2=0x7fd4100cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:56.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 -- 172.21.15.130:0/834157509 shutdown_connections 2023-10-16T08:50:56.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.051+0000 7fd40ffff640 1 -- 172.21.15.130:0/834157509 wait complete. 2023-10-16T08:50:56.058 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.053+0000 7fd40ffff640 1 Processor -- start 2023-10-16T08:50:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.053+0000 7fd40ffff640 1 -- start start 2023-10-16T08:50:56.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 0x7fd4100c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410070860 0x7fd4100c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.061 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4100add40 0x7fd4100c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40ffff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100aba90 con 0x7fd4100add40 2023-10-16T08:50:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40ffff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100c77f0 con 0x7fd410070860 2023-10-16T08:50:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40ffff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100c6f50 con 0x7fd410065ab0 2023-10-16T08:50:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 0x7fd4100c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 0x7fd4100c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58280/0 (socket says 172.21.15.130:58280) 2023-10-16T08:50:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40effd640 1 -- 172.21.15.130:0/129093992 learned_addr learned my addr 172.21.15.130:0/129093992 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.054+0000 7fd40e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410070860 0x7fd4100c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40f7fe640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4100add40 0x7fd4100c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40e7fc640 1 -- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 msgr2=0x7fd4100c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40e7fc640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 0x7fd4100c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40e7fc640 1 -- 172.21.15.130:0/129093992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4100add40 msgr2=0x7fd4100c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40e7fc640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4100add40 0x7fd4100c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40e7fc640 1 -- 172.21.15.130:0/129093992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009400 con 0x7fd410070860 2023-10-16T08:50:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40effd640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 0x7fd4100c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.055+0000 7fd40e7fc640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410070860 0x7fd4100c7bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd404033000 tx=0x7fd4040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:56.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404032880 con 0x7fd410070860 2023-10-16T08:50:56.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd404032a20 con 0x7fd410070860 2023-10-16T08:50:56.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404032dd0 con 0x7fd410070860 2023-10-16T08:50:56.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040094d0 con 0x7fd410070860 2023-10-16T08:50:56.065 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4100c7510 con 0x7fd410070860 2023-10-16T08:50:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd40404e750 con 0x7fd410070860 2023-10-16T08:50:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.056+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd4040455c0 con 0x7fd410070860 2023-10-16T08:50:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.057+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4100ce6d0 con 0x7fd410070860 2023-10-16T08:50:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.060+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd40402e070 con 0x7fd410070860 2023-10-16T08:50:56.140 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.137+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d86dc3f4-fa7d-4275-b6da-da86ccad7188", "id": 0} v 0) v1 -- 0x7fd41004e9b0 con 0x7fd410070860 2023-10-16T08:50:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.144+0000 7fd3f7fff640 1 -- 172.21.15.130:0/129093992 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d86dc3f4-fa7d-4275-b6da-da86ccad7188", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd40404eb90 con 0x7fd410070860 2023-10-16T08:50:56.147 INFO:teuthology.orchestra.run.smithi130.stdout:0 2023-10-16T08:50:56.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.145+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410070860 msgr2=0x7fd4100c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.145+0000 7fd40ffff640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410070860 0x7fd4100c7bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd404033000 tx=0x7fd4040046c0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 shutdown_connections 2023-10-16T08:50:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4100add40 0x7fd4100c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd410070860 0x7fd4100c7bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 --2- 172.21.15.130:0/129093992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd410065ab0 0x7fd4100c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 >> 172.21.15.130:0/129093992 conn(0x7fd4100cb6d0 msgr2=0x7fd410161180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:56.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 shutdown_connections 2023-10-16T08:50:56.150 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.146+0000 7fd40ffff640 1 -- 172.21.15.130:0/129093992 wait complete. 2023-10-16T08:50:56.165 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new d96d9a3f-5002-4580-bde8-303c29927087 1 2023-10-16T08:50:56.180 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.178+0000 7f4085841040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T08:50:56.233 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.230+0000 7fe87ecb6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T08:50:56.240 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.238+0000 7f4085841040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T08:50:56.291 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.288+0000 7f4085841040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T08:50:56.297 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.294+0000 7fe87ecb6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T08:50:56.350 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.348+0000 7fe87ecb6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T08:50:56.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.349+0000 7f2007fff640 1 Processor -- start 2023-10-16T08:50:56.352 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.349+0000 7f2007fff640 1 -- start start 2023-10-16T08:50:56.353 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.351+0000 7f4085841040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T08:50:56.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2007fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 0x7f20080cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2007fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f20080cb770 0x7f2008069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.354 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2007fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f200806a320 0x7f20081606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2007fff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080cc520 con 0x7f200806a320 2023-10-16T08:50:56.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2007fff640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200806a7b0 con 0x7f20080cb770 2023-10-16T08:50:56.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2007fff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080aedb0 con 0x7f20080ae9d0 2023-10-16T08:50:56.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2006ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 0x7f20080cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.355 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f1ffffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f20080cb770 0x7f2008069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f1ffffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f20080cb770 0x7f2008069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:53316/0 (socket says 172.21.15.130:53316) 2023-10-16T08:50:56.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f2006ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 0x7f20080cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58290/0 (socket says 172.21.15.130:58290) 2023-10-16T08:50:56.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.351+0000 7f1ffffff640 1 -- 172.21.15.130:0/754825027 learned_addr learned my addr 172.21.15.130:0/754825027 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:56.356 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.352+0000 7f20077fe640 1 --2- 172.21.15.130:0/754825027 >> v2:172.21.15.94:3300/0 conn(0x7f200806a320 0x7f20081606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.352+0000 7f2006ffd640 1 -- 172.21.15.130:0/754825027 >> v2:172.21.15.130:3300/0 conn(0x7f20080cb770 msgr2=0x7f2008069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.352+0000 7f2006ffd640 1 --2- 172.21.15.130:0/754825027 >> v2:172.21.15.130:3300/0 conn(0x7f20080cb770 0x7f2008069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.352+0000 7f2006ffd640 1 -- 172.21.15.130:0/754825027 >> v2:172.21.15.94:3300/0 conn(0x7f200806a320 msgr2=0x7f20081606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.358 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.352+0000 7f2006ffd640 1 --2- 172.21.15.130:0/754825027 >> v2:172.21.15.94:3300/0 conn(0x7f200806a320 0x7f20081606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.352+0000 7f2006ffd640 1 -- 172.21.15.130:0/754825027 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080cbef0 con 0x7f20080ae9d0 2023-10-16T08:50:56.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.353+0000 7f2006ffd640 1 --2- 172.21.15.130:0/754825027 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 0x7f20080cc940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2008071ef0 tx=0x7f1ff802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dfe60bc97097086 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:56.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.353+0000 7f20067fc640 1 -- 172.21.15.130:0/754825027 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80316f0 con 0x7f20080ae9d0 2023-10-16T08:50:56.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.353+0000 7f20067fc640 1 -- 172.21.15.130:0/754825027 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8031850 con 0x7f20080ae9d0 2023-10-16T08:50:56.359 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.353+0000 7f20067fc640 1 -- 172.21.15.130:0/754825027 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8031be0 con 0x7f20080ae9d0 2023-10-16T08:50:56.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 -- 172.21.15.130:0/754825027 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 msgr2=0x7f20080cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 --2- 172.21.15.130:0/754825027 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 0x7f20080cc940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2008071ef0 tx=0x7f1ff802b790 comp rx=0 tx=0).stop 2023-10-16T08:50:56.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 -- 172.21.15.130:0/754825027 shutdown_connections 2023-10-16T08:50:56.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 --2- 172.21.15.130:0/754825027 >> v2:172.21.15.94:3300/0 conn(0x7f200806a320 0x7f20081606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.360 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 --2- 172.21.15.130:0/754825027 >> v2:172.21.15.130:3300/0 conn(0x7f20080cb770 0x7f2008069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 --2- 172.21.15.130:0/754825027 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20080ae9d0 0x7f20080cc940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 -- 172.21.15.130:0/754825027 >> 172.21.15.130:0/754825027 conn(0x7f20080cf4e0 msgr2=0x7f20080cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:56.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 -- 172.21.15.130:0/754825027 shutdown_connections 2023-10-16T08:50:56.361 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.354+0000 7f2007fff640 1 -- 172.21.15.130:0/754825027 wait complete. 2023-10-16T08:50:56.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.356+0000 7f2007fff640 1 Processor -- start 2023-10-16T08:50:56.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.356+0000 7f2007fff640 1 -- start start 2023-10-16T08:50:56.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.357+0000 7f2007fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 0x7f200815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.357+0000 7f2007fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20080ae9d0 0x7f20080b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.364 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.357+0000 7f2007fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f20080cb770 0x7f20080afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.357+0000 7f2007fff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b3770 con 0x7f20080cb770 2023-10-16T08:50:56.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.357+0000 7f2007fff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200815b050 con 0x7f20080ae9d0 2023-10-16T08:50:56.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.357+0000 7f2007fff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b2af0 con 0x7f200806a320 2023-10-16T08:50:56.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 0x7f200815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.365 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 0x7f200815ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58298/0 (socket says 172.21.15.130:58298) 2023-10-16T08:50:56.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 -- 172.21.15.130:0/3136171579 learned_addr learned my addr 172.21.15.130:0/3136171579 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:56.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f1ffffff640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20080ae9d0 0x7f20080b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f20077fe640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f20080cb770 0x7f20080afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.366 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 -- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20080ae9d0 msgr2=0x7f20080b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20080ae9d0 0x7f20080b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 -- 172.21.15.130:0/3136171579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f20080cb770 msgr2=0x7f20080afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f20080cb770 0x7f20080afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 -- 172.21.15.130:0/3136171579 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80093a0 con 0x7f200806a320 2023-10-16T08:50:56.367 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.358+0000 7f2006ffd640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 0x7f200815ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8000c00 tx=0x7f1ff80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:56.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8034680 con 0x7f200806a320 2023-10-16T08:50:56.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8034800 con 0x7f200806a320 2023-10-16T08:50:56.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080b2dd0 con 0x7f200806a320 2023-10-16T08:50:56.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8034bb0 con 0x7f200806a320 2023-10-16T08:50:56.368 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20080b3390 con 0x7f200806a320 2023-10-16T08:50:56.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1ff803b040 con 0x7f200806a320 2023-10-16T08:50:56.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.359+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1ff804a800 con 0x7f200806a320 2023-10-16T08:50:56.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.360+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080b53e0 con 0x7f200806a320 2023-10-16T08:50:56.369 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.363+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1ff8069b40 con 0x7f200806a320 2023-10-16T08:50:56.403 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.401+0000 7f4085841040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T08:50:56.423 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.421+0000 7fe87ecb6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T08:50:56.442 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.440+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d96d9a3f-5002-4580-bde8-303c29927087", "id": 1} v 0) v1 -- 0x7f200804e9b0 con 0x7f200806a320 2023-10-16T08:50:56.450 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.448+0000 7f1fff7fe640 1 -- 172.21.15.130:0/3136171579 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d96d9a3f-5002-4580-bde8-303c29927087", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ff8058030 con 0x7f200806a320 2023-10-16T08:50:56.450 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-16T08:50:56.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 msgr2=0x7f200815ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 0x7f200815ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8000c00 tx=0x7f1ff80046c0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.452 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 shutdown_connections 2023-10-16T08:50:56.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f20080cb770 0x7f20080afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20080ae9d0 0x7f20080b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 --2- 172.21.15.130:0/3136171579 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f200806a320 0x7f200815ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.449+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 >> 172.21.15.130:0/3136171579 conn(0x7f20080cf4e0 msgr2=0x7f20080ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:56.453 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.450+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 shutdown_connections 2023-10-16T08:50:56.454 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.450+0000 7f2007fff640 1 -- 172.21.15.130:0/3136171579 wait complete. 2023-10-16T08:50:56.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079 2 2023-10-16T08:50:56.484 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.482+0000 7fe87ecb6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T08:50:56.515 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.513+0000 7f4085841040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T08:50:56.594 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.592+0000 7f4085841040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T08:50:56.603 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.600+0000 7fe87ecb6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T08:50:56.647 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.645+0000 7f4085841040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T08:50:56.663 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.661+0000 7f00d4ac2640 1 Processor -- start 2023-10-16T08:50:56.664 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.661+0000 7f00d4ac2640 1 -- start start 2023-10-16T08:50:56.665 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.662+0000 7f00d4ac2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f00d0160da0 0x7f00d015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.662+0000 7f00d4ac2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d00ce4c0 con 0x7f00d00d17e0 2023-10-16T08:50:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00d4ac2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d00cd8b0 con 0x7f00d01609c0 2023-10-16T08:50:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00d4ac2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d00cdb90 con 0x7f00d0160da0 2023-10-16T08:50:56.666 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00cf7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f00d01609c0 0x7f00d00d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33382/0 (socket says 172.21.15.130:33382) 2023-10-16T08:50:56.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00cf7fe640 1 -- 172.21.15.130:0/3518473028 learned_addr learned my addr 172.21.15.130:0/3518473028 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-10-16T08:50:56.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00cffff640 1 --2- 172.21.15.130:0/3518473028 >> v2:172.21.15.94:3300/0 conn(0x7f00d0160da0 0x7f00d015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751898675 0 0) 0x7f00d00cd8b0 con 0x7f00d01609c0 2023-10-16T08:50:56.667 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.663+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b8003520 con 0x7f00d01609c0 2023-10-16T08:50:56.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595243434 0 0) 0x7f00d00ce4c0 con 0x7f00d00d17e0 2023-10-16T08:50:56.669 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d00cd8b0 con 0x7f00d00d17e0 2023-10-16T08:50:56.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412403836 0 0) 0x7f00b8003520 con 0x7f00d01609c0 2023-10-16T08:50:56.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 >> v2:172.21.15.94:3300/0 conn(0x7f00d0160da0 msgr2=0x7f00d015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 --2- 172.21.15.130:0/3518473028 >> v2:172.21.15.94:3300/0 conn(0x7f00d0160da0 0x7f00d015cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.670 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 >> v1:172.21.15.94:6789/0 conn(0x7f00d00d17e0 legacy=0x7f00d015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00cde70 con 0x7f00d01609c0 2023-10-16T08:50:56.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f00c0001b70 con 0x7f00d01609c0 2023-10-16T08:50:56.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 >> v1:172.21.15.130:6789/0 conn(0x7f00d01609c0 legacy=0x7f00d00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8003bc0 0x7f00b8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80047c0 0x7f00b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.671 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b8005180 0x7f00b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00cdb90 con 0x7f00b80047c0 2023-10-16T08:50:56.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b800c120 con 0x7f00b8005180 2023-10-16T08:50:56.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b800c2e0 con 0x7f00b8003bc0 2023-10-16T08:50:56.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00cf7fe640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8003bc0 0x7f00b8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.672 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00cffff640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b8005180 0x7f00b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00ceffd640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80047c0 0x7f00b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00cf7fe640 1 -- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b8005180 msgr2=0x7f00b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.664+0000 7f00cf7fe640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b8005180 0x7f00b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.665+0000 7f00cf7fe640 1 -- 172.21.15.130:0/3518473028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80047c0 msgr2=0x7f00b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.665+0000 7f00cf7fe640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80047c0 0x7f00b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.665+0000 7f00cf7fe640 1 -- 172.21.15.130:0/3518473028 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8003520 con 0x7f00b8003bc0 2023-10-16T08:50:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.665+0000 7f00cffff640 1 -- 172.21.15.130:0/3518473028 reap_dead start 2023-10-16T08:50:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.666+0000 7f00cf7fe640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8003bc0 0x7f00b8003fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00c000c3e0 tx=0x7f00b80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94ca6f1919604c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.666+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0005d20 con 0x7f00b8003bc0 2023-10-16T08:50:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.666+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c0005e80 con 0x7f00b8003bc0 2023-10-16T08:50:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.666+0000 7f00ce7fc640 1 -- 172.21.15.130:0/3518473028 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c002cd20 con 0x7f00b8003bc0 2023-10-16T08:50:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.666+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8003bc0 msgr2=0x7f00b8003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.666+0000 7f00d4ac2640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8003bc0 0x7f00b8003fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00c000c3e0 tx=0x7f00b80057f0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.667+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3518473028 shutdown_connections 2023-10-16T08:50:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.667+0000 7f00d4ac2640 1 --2- 172.21.15.130:0/3518473028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8003bc0 0x7f00b8003fc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.667+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3518473028 >> 172.21.15.130:0/3518473028 conn(0x7f00d009bbf0 msgr2=0x7f00d00d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:56.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.667+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3518473028 shutdown_connections 2023-10-16T08:50:56.676 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.667+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3518473028 wait complete. 2023-10-16T08:50:56.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.668+0000 7f00d4ac2640 1 Processor -- start 2023-10-16T08:50:56.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.668+0000 7f00d4ac2640 1 -- start start 2023-10-16T08:50:56.678 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.669+0000 7f00d4ac2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b8003bc0 0x7f00d014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.669+0000 7f00d4ac2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00c6950 0x7f00d00cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.669+0000 7f00d4ac2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 0x7f00d00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.669+0000 7f00d4ac2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d014e8d0 con 0x7f00b8003bc0 2023-10-16T08:50:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.669+0000 7f00d4ac2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d014dcc0 con 0x7f00d00c6950 2023-10-16T08:50:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.669+0000 7f00d4ac2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d014dfa0 con 0x7f00d00c6dd0 2023-10-16T08:50:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00ceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00c6950 0x7f00d00cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 0x7f00d00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 0x7f00d00cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58304/0 (socket says 172.21.15.130:58304) 2023-10-16T08:50:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 -- 172.21.15.130:0/3055530440 learned_addr learned my addr 172.21.15.130:0/3055530440 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cf7fe640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b8003bc0 0x7f00d014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 -- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00c6950 msgr2=0x7f00d00cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00c6950 0x7f00d00cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 -- 172.21.15.130:0/3055530440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b8003bc0 msgr2=0x7f00d014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b8003bc0 0x7f00d014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 -- 172.21.15.130:0/3055530440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d014e280 con 0x7f00d00c6dd0 2023-10-16T08:50:56.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00ceffd640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00c6950 0x7f00d00cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:56.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.670+0000 7f00cffff640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 0x7f00d00cc0c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f00d006aa80 tx=0x7f00c8011c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:56.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004030 con 0x7f00d00c6dd0 2023-10-16T08:50:56.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8004190 con 0x7f00d00c6dd0 2023-10-16T08:50:56.682 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004520 con 0x7f00d00c6dd0 2023-10-16T08:50:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d014e560 con 0x7f00d00c6dd0 2023-10-16T08:50:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d00c6420 con 0x7f00d00c6dd0 2023-10-16T08:50:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00c800fc20 con 0x7f00d00c6dd0 2023-10-16T08:50:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.671+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f00c8003a30 con 0x7f00d00c6dd0 2023-10-16T08:50:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.672+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d014ea40 con 0x7f00d00c6dd0 2023-10-16T08:50:56.684 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.675+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f00c8003610 con 0x7f00d00c6dd0 2023-10-16T08:50:56.688 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.686+0000 7fe87ecb6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T08:50:56.708 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.706+0000 7f4085841040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T08:50:56.743 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.741+0000 7fe87ecb6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T08:50:56.754 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.752+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079", "id": 2} v 0) v1 -- 0x7f00d004e9b0 con 0x7f00d00c6dd0 2023-10-16T08:50:56.760 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.758+0000 7f00b7fff640 1 -- 172.21.15.130:0/3055530440 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00c8003890 con 0x7f00d00c6dd0 2023-10-16T08:50:56.760 INFO:teuthology.orchestra.run.smithi130.stdout:2 2023-10-16T08:50:56.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 msgr2=0x7f00d00cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:56.762 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 0x7f00d00cc0c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f00d006aa80 tx=0x7f00c8011c30 comp rx=0 tx=0).stop 2023-10-16T08:50:56.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 shutdown_connections 2023-10-16T08:50:56.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d00c6dd0 0x7f00d00cc0c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00c6950 0x7f00d00cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 --2- 172.21.15.130:0/3055530440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b8003bc0 0x7f00d014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:56.763 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 >> 172.21.15.130:0/3055530440 conn(0x7f00d009bbf0 msgr2=0x7f00d006c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:56.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 shutdown_connections 2023-10-16T08:50:56.764 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.759+0000 7f00d4ac2640 1 -- 172.21.15.130:0/3055530440 wait complete. 2023-10-16T08:50:56.764 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:56.761+0000 7f4085841040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T08:50:56.777 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 47dab8eb-15dc-4442-871a-b77860998a27 3 2023-10-16T08:50:56.807 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.804+0000 7fe87ecb6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T08:50:56.865 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:56.862+0000 7fe87ecb6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T08:50:57.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.997+0000 7f6b5e52e640 1 Processor -- start 2023-10-16T08:50:57.000 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.997+0000 7f6b5e52e640 1 -- start start 2023-10-16T08:50:57.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5e52e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6b5815c940 0x7f6b580d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5e52e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580ce810 con 0x7f6b580b6fe0 2023-10-16T08:50:57.001 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5e52e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580b5b40 con 0x7f6b580d0d80 2023-10-16T08:50:57.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5e52e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b58161340 con 0x7f6b5815c940 2023-10-16T08:50:57.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5cd2b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6b580d0d80 0x7f6b58160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54196/0 (socket says 172.21.15.130:54196) 2023-10-16T08:50:57.002 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5cd2b640 1 -- 172.21.15.130:0/2554847136 learned_addr learned my addr 172.21.15.130:0/2554847136 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-10-16T08:50:57.004 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/2554847136 >> v2:172.21.15.94:3300/0 conn(0x7f6b5815c940 0x7f6b580d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326046323 0 0) 0x7f6b580b5b40 con 0x7f6b580d0d80 2023-10-16T08:50:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:56.999+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b44003520 con 0x7f6b580d0d80 2023-10-16T08:50:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303593246 0 0) 0x7f6b44003520 con 0x7f6b580d0d80 2023-10-16T08:50:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 >> v2:172.21.15.94:3300/0 conn(0x7f6b5815c940 msgr2=0x7f6b580d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:57.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 --2- 172.21.15.130:0/2554847136 >> v2:172.21.15.94:3300/0 conn(0x7f6b5815c940 0x7f6b580d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 >> v1:172.21.15.94:6789/0 conn(0x7f6b580b6fe0 legacy=0x7f6b58160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580ce250 con 0x7f6b580d0d80 2023-10-16T08:50:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f6b48001670 con 0x7f6b580d0d80 2023-10-16T08:50:57.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 >> v1:172.21.15.130:6789/0 conn(0x7f6b580d0d80 legacy=0x7f6b58160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b440047c0 0x7f6b44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b44005180 0x7f6b4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58161340 con 0x7f6b44005180 2023-10-16T08:50:57.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4400c0b0 con 0x7f6b440039e0 2023-10-16T08:50:57.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4400c270 con 0x7f6b440047c0 2023-10-16T08:50:57.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b5cd2b640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b440047c0 0x7f6b44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b5dd2d640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b44005180 0x7f6b4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b5d52c640 1 -- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b440047c0 msgr2=0x7f6b44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:57.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.000+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b440047c0 0x7f6b44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.001+0000 7f6b5d52c640 1 -- 172.21.15.130:0/2554847136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b44005180 msgr2=0x7f6b4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:57.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.001+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b44005180 0x7f6b4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.001+0000 7f6b5d52c640 1 -- 172.21.15.130:0/2554847136 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44003520 con 0x7f6b440039e0 2023-10-16T08:50:57.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.001+0000 7f6b5dd2d640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b44005180 0x7f6b4400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:50:57.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.001+0000 7f6b5dd2d640 1 -- 172.21.15.130:0/2554847136 reap_dead start 2023-10-16T08:50:57.009 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.002+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b44003dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009ac0 tx=0x7f6b440057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46961bbd37970aa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.002+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5402c6b0 con 0x7f6b440039e0 2023-10-16T08:50:57.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.002+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5402c810 con 0x7f6b440039e0 2023-10-16T08:50:57.010 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.002+0000 7f6b4ffff640 1 -- 172.21.15.130:0/2554847136 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5402cba0 con 0x7f6b440039e0 2023-10-16T08:50:57.012 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.002+0000 7f6b5e52e640 1 -- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 msgr2=0x7f6b44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.002+0000 7f6b5e52e640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b44003dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009ac0 tx=0x7f6b440057f0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.003+0000 7f6b5e52e640 1 -- 172.21.15.130:0/2554847136 shutdown_connections 2023-10-16T08:50:57.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.003+0000 7f6b5e52e640 1 --2- 172.21.15.130:0/2554847136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b44003dc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.003+0000 7f6b5e52e640 1 -- 172.21.15.130:0/2554847136 >> 172.21.15.130:0/2554847136 conn(0x7f6b5809bb30 msgr2=0x7f6b580d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.013 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.003+0000 7f6b5e52e640 1 -- 172.21.15.130:0/2554847136 shutdown_connections 2023-10-16T08:50:57.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.003+0000 7f6b5e52e640 1 -- 172.21.15.130:0/2554847136 wait complete. 2023-10-16T08:50:57.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.004+0000 7f6b5e52e640 1 Processor -- start 2023-10-16T08:50:57.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.004+0000 7f6b5e52e640 1 -- start start 2023-10-16T08:50:57.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5e52e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b58157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.014 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5e52e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b580c62b0 0x7f6b580c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5e52e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b580c6710 0x7f6b580c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5e52e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c9290 con 0x7f6b580c6710 2023-10-16T08:50:57.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5e52e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5815f420 con 0x7f6b440039e0 2023-10-16T08:50:57.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5e52e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5815ea80 con 0x7f6b580c62b0 2023-10-16T08:50:57.015 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.005+0000 7f6b5d52c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b58157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b58157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57274/0 (socket says 172.21.15.130:57274) 2023-10-16T08:50:57.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 -- 172.21.15.130:0/1718598205 learned_addr learned my addr 172.21.15.130:0/1718598205 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:57.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5cd2b640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b580c62b0 0x7f6b580c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5dd2d640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b580c6710 0x7f6b580c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.016 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 -- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b580c62b0 msgr2=0x7f6b580c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b580c62b0 0x7f6b580c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 -- 172.21.15.130:0/1718598205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b580c6710 msgr2=0x7f6b580c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b580c6710 0x7f6b580c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 -- 172.21.15.130:0/1718598205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5815ed60 con 0x7f6b440039e0 2023-10-16T08:50:57.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5cd2b640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b580c62b0 0x7f6b580c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:57.017 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b5d52c640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b58157cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b5402c250 tx=0x7f6b54004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54003810 con 0x7f6b440039e0 2023-10-16T08:50:57.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.006+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54003970 con 0x7f6b440039e0 2023-10-16T08:50:57.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.007+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54003d00 con 0x7f6b440039e0 2023-10-16T08:50:57.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.007+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5815f040 con 0x7f6b440039e0 2023-10-16T08:50:57.018 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.007+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5806b840 con 0x7f6b440039e0 2023-10-16T08:50:57.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.007+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b54047750 con 0x7f6b440039e0 2023-10-16T08:50:57.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.007+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6b54034440 con 0x7f6b440039e0 2023-10-16T08:50:57.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.008+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b580d0ba0 con 0x7f6b440039e0 2023-10-16T08:50:57.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.010+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6b54066b40 con 0x7f6b440039e0 2023-10-16T08:50:57.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.087+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47dab8eb-15dc-4442-871a-b77860998a27", "id": 3} v 0) v1 -- 0x7f6b5804e9b0 con 0x7f6b440039e0 2023-10-16T08:50:57.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.093+0000 7f6b4dffb640 1 -- 172.21.15.130:0/1718598205 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47dab8eb-15dc-4442-871a-b77860998a27", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b54055030 con 0x7f6b440039e0 2023-10-16T08:50:57.096 INFO:teuthology.orchestra.run.smithi130.stdout:3 2023-10-16T08:50:57.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 msgr2=0x7f6b58157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b58157cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b5402c250 tx=0x7f6b54004730 comp rx=0 tx=0).stop 2023-10-16T08:50:57.098 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 shutdown_connections 2023-10-16T08:50:57.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b580c6710 0x7f6b580c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b580c62b0 0x7f6b580c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 --2- 172.21.15.130:0/1718598205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b440039e0 0x7f6b58157cb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 >> 172.21.15.130:0/1718598205 conn(0x7f6b5809bb30 msgr2=0x7f6b5806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.099 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 shutdown_connections 2023-10-16T08:50:57.100 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.095+0000 7f6b5e52e640 1 -- 172.21.15.130:0/1718598205 wait complete. 2023-10-16T08:50:57.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 79c3ae33-4a13-4e20-99a9-380c938cfda4 4 2023-10-16T08:50:57.212 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.210+0000 7f4085841040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T08:50:57.302 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.299+0000 7f4d32905640 1 Processor -- start 2023-10-16T08:50:57.303 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.300+0000 7f4d32905640 1 -- start start 2023-10-16T08:50:57.304 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.301+0000 7f4d32905640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.301+0000 7f4d32905640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d2c0b4410 0x7f4d2c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.301+0000 7f4d32905640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c15cfd0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.301+0000 7f4d32905640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0d0dc0 con 0x7f4d2c0b4410 2023-10-16T08:50:57.305 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.301+0000 7f4d32905640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0d18f0 con 0x7f4d2c15cbf0 2023-10-16T08:50:57.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.301+0000 7f4d2bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2b7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4d2c0b8400 0x7f4d2c0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54202/0 (socket says 172.21.15.130:54202) 2023-10-16T08:50:57.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2b7fe640 1 -- 172.21.15.130:0/3167311680 learned_addr learned my addr 172.21.15.130:0/3167311680 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-10-16T08:50:57.306 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d30ea2640 1 --2- 172.21.15.130:0/3167311680 >> v2:172.21.15.94:3300/0 conn(0x7f4d2c0b4410 0x7f4d2c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2bfff640 1 -- 172.21.15.130:0/3167311680 >> v2:172.21.15.94:3300/0 conn(0x7f4d2c0b4410 msgr2=0x7f4d2c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:57.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2bfff640 1 --2- 172.21.15.130:0/3167311680 >> v2:172.21.15.94:3300/0 conn(0x7f4d2c0b4410 0x7f4d2c0b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2bfff640 1 -- 172.21.15.130:0/3167311680 >> v1:172.21.15.130:6789/0 conn(0x7f4d2c0b8400 legacy=0x7f4d2c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2affd640 1 -- 172.21.15.130:0/3167311680 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845787679 0 0) 0x7f4d2c15cfd0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.307 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d2bfff640 1 -- 172.21.15.130:0/3167311680 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0d30b0 con 0x7f4d2c15cbf0 2023-10-16T08:50:57.308 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.302+0000 7f4d30ea2640 1 --2- 172.21.15.130:0/3167311680 >> v2:172.21.15.94:3300/0 conn(0x7f4d2c0b4410 0x7f4d2c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:50:57.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.303+0000 7f4d2bfff640 1 --2- 172.21.15.130:0/3167311680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d29d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3cd3d7f9fcf5eb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.303+0000 7f4d2affd640 1 -- 172.21.15.130:0/3167311680 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c02d040 con 0x7f4d2c15cbf0 2023-10-16T08:50:57.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.303+0000 7f4d2affd640 1 -- 172.21.15.130:0/3167311680 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c031810 con 0x7f4d2c15cbf0 2023-10-16T08:50:57.311 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.303+0000 7f4d2affd640 1 -- 172.21.15.130:0/3167311680 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c031ba0 con 0x7f4d2c15cbf0 2023-10-16T08:50:57.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 -- 172.21.15.130:0/3167311680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c15cbf0 msgr2=0x7f4d2c0d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 --2- 172.21.15.130:0/3167311680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d29d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02b8b0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 -- 172.21.15.130:0/3167311680 shutdown_connections 2023-10-16T08:50:57.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 --2- 172.21.15.130:0/3167311680 >> v2:172.21.15.94:3300/0 conn(0x7f4d2c0b4410 0x7f4d2c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 --2- 172.21.15.130:0/3167311680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d29d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 -- 172.21.15.130:0/3167311680 >> 172.21.15.130:0/3167311680 conn(0x7f4d2c071900 msgr2=0x7f4d2c071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 -- 172.21.15.130:0/3167311680 shutdown_connections 2023-10-16T08:50:57.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.304+0000 7f4d32905640 1 -- 172.21.15.130:0/3167311680 wait complete. 2023-10-16T08:50:57.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.306+0000 7f4d32905640 1 Processor -- start 2023-10-16T08:50:57.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.306+0000 7f4d32905640 1 -- start start 2023-10-16T08:50:57.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d32905640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d2c0b4410 0x7f4d2c0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d32905640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 0x7f4d2c0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d32905640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d32905640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0c8970 con 0x7f4d2c0b4410 2023-10-16T08:50:57.314 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d32905640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15f5c0 con 0x7f4d2c15cbf0 2023-10-16T08:50:57.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d32905640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15f880 con 0x7f4d2c0b8400 2023-10-16T08:50:57.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 0x7f4d2c0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d30ea2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.315 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 0x7f4d2c0c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53054/0 (socket says 172.21.15.130:53054) 2023-10-16T08:50:57.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 -- 172.21.15.130:0/289892243 learned_addr learned my addr 172.21.15.130:0/289892243 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:57.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2bfff640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d2c0b4410 0x7f4d2c0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 -- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d2c15cbf0 msgr2=0x7f4d2c0d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 -- 172.21.15.130:0/289892243 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d2c0b4410 msgr2=0x7f4d2c0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.316 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d2c0b4410 0x7f4d2c0c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.307+0000 7f4d2b7fe640 1 -- 172.21.15.130:0/289892243 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c009400 con 0x7f4d2c0b8400 2023-10-16T08:50:57.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d2b7fe640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 0x7f4d2c0c8c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c4d0 tx=0x7f4d1400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d140074e0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d14007660 con 0x7f4d2c0b8400 2023-10-16T08:50:57.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c15fb60 con 0x7f4d2c0b8400 2023-10-16T08:50:57.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14004a20 con 0x7f4d2c0b8400 2023-10-16T08:50:57.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0c91b0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.308+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d14012400 con 0x7f4d2c0b8400 2023-10-16T08:50:57.318 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.309+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4d14012bc0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.309+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c073ef0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.319 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.312+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4d14018070 con 0x7f4d2c0b8400 2023-10-16T08:50:57.344 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:57.342+0000 7fe87ecb6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T08:50:57.370 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.368+0000 7f4085841040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T08:50:57.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.391+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79c3ae33-4a13-4e20-99a9-380c938cfda4", "id": 4} v 0) v1 -- 0x7f4d2c0681a0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.396+0000 7f4d28ff9640 1 -- 172.21.15.130:0/289892243 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79c3ae33-4a13-4e20-99a9-380c938cfda4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d140126b0 con 0x7f4d2c0b8400 2023-10-16T08:50:57.399 INFO:teuthology.orchestra.run.smithi130.stdout:4 2023-10-16T08:50:57.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 msgr2=0x7f4d2c0c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 0x7f4d2c0c8c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c4d0 tx=0x7f4d1400c990 comp rx=0 tx=0).stop 2023-10-16T08:50:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 shutdown_connections 2023-10-16T08:50:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d2c15cbf0 0x7f4d2c0d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d2c0b8400 0x7f4d2c0c8c70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 --2- 172.21.15.130:0/289892243 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d2c0b4410 0x7f4d2c0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.397+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 >> 172.21.15.130:0/289892243 conn(0x7f4d2c071900 msgr2=0x7f4d2c0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.398+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 shutdown_connections 2023-10-16T08:50:57.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.398+0000 7f4d32905640 1 -- 172.21.15.130:0/289892243 wait complete. 2023-10-16T08:50:57.416 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new e49c8ff4-02b7-4c23-9297-cef6d9301761 5 2023-10-16T08:50:57.512 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.510+0000 7f4085841040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T08:50:57.512 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:57.510+0000 7fe87ecb6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T08:50:57.565 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.563+0000 7f4085841040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T08:50:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.602+0000 7fbeeae61640 1 Processor -- start 2023-10-16T08:50:57.605 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.602+0000 7fbeeae61640 1 -- start start 2023-10-16T08:50:57.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbeeae61640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbee406e0e0 0x7fbee406cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbeeae61640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee406d510 con 0x7fbee40ca9b0 2023-10-16T08:50:57.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbeeae61640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee406c2a0 con 0x7fbee40ca5d0 2023-10-16T08:50:57.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbeeae61640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee40cafa0 con 0x7fbee406e0e0 2023-10-16T08:50:57.607 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbee3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbee406e0e0 0x7fbee406cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbee3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbee406e0e0 0x7fbee406cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57282/0 (socket says 172.21.15.130:57282) 2023-10-16T08:50:57.608 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.604+0000 7fbee3fff640 1 -- 172.21.15.130:0/2080392846 learned_addr learned my addr 172.21.15.130:0/2080392846 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:57.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.605+0000 7fbee3fff640 1 -- 172.21.15.130:0/2080392846 >> v1:172.21.15.130:6789/0 conn(0x7fbee40ca5d0 legacy=0x7fbee40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.609 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.605+0000 7fbee3fff640 1 -- 172.21.15.130:0/2080392846 >> v1:172.21.15.94:6789/0 conn(0x7fbee40ca9b0 legacy=0x7fbee40c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:57.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.605+0000 7fbee3fff640 1 -- 172.21.15.130:0/2080392846 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee406c4f0 con 0x7fbee406e0e0 2023-10-16T08:50:57.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.606+0000 7fbee3fff640 1 --2- 172.21.15.130:0/2080392846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee406e0e0 0x7fbee406cfd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009870 tx=0x7fbed002b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc8d4021c8a8be6d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.606+0000 7fbee37fe640 1 -- 172.21.15.130:0/2080392846 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0031860 con 0x7fbee406e0e0 2023-10-16T08:50:57.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.606+0000 7fbee37fe640 1 -- 172.21.15.130:0/2080392846 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed00319c0 con 0x7fbee406e0e0 2023-10-16T08:50:57.610 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.606+0000 7fbee37fe640 1 -- 172.21.15.130:0/2080392846 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0031d50 con 0x7fbee406e0e0 2023-10-16T08:50:57.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 -- 172.21.15.130:0/2080392846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee406e0e0 msgr2=0x7fbee406cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 --2- 172.21.15.130:0/2080392846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee406e0e0 0x7fbee406cfd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009870 tx=0x7fbed002b900 comp rx=0 tx=0).stop 2023-10-16T08:50:57.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 -- 172.21.15.130:0/2080392846 shutdown_connections 2023-10-16T08:50:57.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 --2- 172.21.15.130:0/2080392846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee406e0e0 0x7fbee406cfd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 -- 172.21.15.130:0/2080392846 >> 172.21.15.130:0/2080392846 conn(0x7fbee40b0870 msgr2=0x7fbee40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.611 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 -- 172.21.15.130:0/2080392846 shutdown_connections 2023-10-16T08:50:57.612 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.607+0000 7fbeeae61640 1 -- 172.21.15.130:0/2080392846 wait complete. 2023-10-16T08:50:57.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.609+0000 7fbeeae61640 1 Processor -- start 2023-10-16T08:50:57.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.609+0000 7fbeeae61640 1 -- start start 2023-10-16T08:50:57.614 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbeeae61640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee406e0e0 0x7fbee40c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbeeae61640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca5d0 0x7fbee40b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbeeae61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 0x7fbee409dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbeeae61640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee414f9b0 con 0x7fbee406e0e0 2023-10-16T08:50:57.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbeeae61640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4150810 con 0x7fbee40ca9b0 2023-10-16T08:50:57.615 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbeeae61640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40c1f10 con 0x7fbee40ca5d0 2023-10-16T08:50:57.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 0x7fbee409dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee3fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca5d0 0x7fbee40b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 0x7fbee409dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57294/0 (socket says 172.21.15.130:57294) 2023-10-16T08:50:57.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 -- 172.21.15.130:0/296393381 learned_addr learned my addr 172.21.15.130:0/296393381 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:57.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee8bfd640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee406e0e0 0x7fbee40c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.616 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 -- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca5d0 msgr2=0x7fbee40b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca5d0 0x7fbee40b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 -- 172.21.15.130:0/296393381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee406e0e0 msgr2=0x7fbee40c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee406e0e0 0x7fbee40c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee93fe640 1 -- 172.21.15.130:0/296393381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00094d0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.617 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.610+0000 7fbee3fff640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca5d0 0x7fbee40b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:57.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbee93fe640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 0x7fbee409dfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00b9e0 tx=0x7fbedc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc003b70 con 0x7fbee40ca9b0 2023-10-16T08:50:57.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc003cd0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.618 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee40b1c00 con 0x7fbee40ca9b0 2023-10-16T08:50:57.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00cb60 con 0x7fbee40ca9b0 2023-10-16T08:50:57.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee414fee0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbedc00ccc0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.611+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbedc004420 con 0x7fbee40ca9b0 2023-10-16T08:50:57.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.613+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee4073ef0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.620 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.615+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbedc022060 con 0x7fbee40ca9b0 2023-10-16T08:50:57.665 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:57.662+0000 7fe87ecb6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T08:50:57.674 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.672+0000 7f4085841040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T08:50:57.694 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.692+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e49c8ff4-02b7-4c23-9297-cef6d9301761", "id": 5} v 0) v1 -- 0x7fbee4071bf0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.700 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.698+0000 7fbee17fa640 1 -- 172.21.15.130:0/296393381 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e49c8ff4-02b7-4c23-9297-cef6d9301761", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbedc003ea0 con 0x7fbee40ca9b0 2023-10-16T08:50:57.700 INFO:teuthology.orchestra.run.smithi130.stdout:5 2023-10-16T08:50:57.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 msgr2=0x7fbee409dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 0x7fbee409dfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00b9e0 tx=0x7fbedc00bea0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 shutdown_connections 2023-10-16T08:50:57.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee40ca9b0 0x7fbee409dfb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.702 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca5d0 0x7fbee40b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 --2- 172.21.15.130:0/296393381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee406e0e0 0x7fbee40c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 >> 172.21.15.130:0/296393381 conn(0x7fbee40b0870 msgr2=0x7fbee4161100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 shutdown_connections 2023-10-16T08:50:57.703 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.699+0000 7fbeeae61640 1 -- 172.21.15.130:0/296393381 wait complete. 2023-10-16T08:50:57.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 3e59f2d4-3bdf-4442-afad-dbd7fef9cd77 6 2023-10-16T08:50:57.723 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:57.718+0000 7fe87ecb6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T08:50:57.784 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.782+0000 7f4085841040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T08:50:57.836 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:57.833+0000 7fe87ecb6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T08:50:57.907 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.905+0000 7f7424cb4640 1 Processor -- start 2023-10-16T08:50:57.908 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.905+0000 7f7424cb4640 1 -- start start 2023-10-16T08:50:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.906+0000 7f7424cb4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74200d17e0 0x7f742015c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.906+0000 7f7424cb4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 0x7f742015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.909 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.906+0000 7f7424cb4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200ce4c0 con 0x7f74201609c0 2023-10-16T08:50:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.906+0000 7f7424cb4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200cd8b0 con 0x7f74200d17e0 2023-10-16T08:50:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.906+0000 7f7424cb4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74200cdb90 con 0x7f7420160da0 2023-10-16T08:50:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.906+0000 7f741ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 0x7f742015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f741ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 0x7f742015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:53078/0 (socket says 172.21.15.130:53078) 2023-10-16T08:50:57.910 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f741ffff640 1 -- 172.21.15.130:0/2890260970 learned_addr learned my addr 172.21.15.130:0/2890260970 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:57.911 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f7417fff640 1 --2- 172.21.15.130:0/2890260970 >> v2:172.21.15.94:3300/0 conn(0x7f74200d17e0 0x7f742015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.912 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f741ffff640 1 -- 172.21.15.130:0/2890260970 >> v2:172.21.15.94:3300/0 conn(0x7f74200d17e0 msgr2=0x7f742015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f741ffff640 1 --2- 172.21.15.130:0/2890260970 >> v2:172.21.15.94:3300/0 conn(0x7f74200d17e0 0x7f742015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f741ffff640 1 -- 172.21.15.130:0/2890260970 >> v1:172.21.15.94:6789/0 conn(0x7f74201609c0 legacy=0x7f74200d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f741ffff640 1 -- 172.21.15.130:0/2890260970 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200cde70 con 0x7f7420160da0 2023-10-16T08:50:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.907+0000 7f7417fff640 1 --2- 172.21.15.130:0/2890260970 >> v2:172.21.15.94:3300/0 conn(0x7f74200d17e0 0x7f742015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:50:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.909+0000 7f741ffff640 1 --2- 172.21.15.130:0/2890260970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 0x7f742015ca70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7418009e50 tx=0x7f741802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=209b5d556dac1e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.913 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.909+0000 7f741effd640 1 -- 172.21.15.130:0/2890260970 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741802cb00 con 0x7f7420160da0 2023-10-16T08:50:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.909+0000 7f741effd640 1 -- 172.21.15.130:0/2890260970 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741802cc60 con 0x7f7420160da0 2023-10-16T08:50:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.909+0000 7f741effd640 1 -- 172.21.15.130:0/2890260970 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180343f0 con 0x7f7420160da0 2023-10-16T08:50:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.909+0000 7f7424cb4640 1 -- 172.21.15.130:0/2890260970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 msgr2=0x7f742015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.909+0000 7f7424cb4640 1 --2- 172.21.15.130:0/2890260970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 0x7f742015ca70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7418009e50 tx=0x7f741802bf60 comp rx=0 tx=0).stop 2023-10-16T08:50:57.914 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.910+0000 7f7424cb4640 1 -- 172.21.15.130:0/2890260970 shutdown_connections 2023-10-16T08:50:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.910+0000 7f7424cb4640 1 --2- 172.21.15.130:0/2890260970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7420160da0 0x7f742015ca70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.910+0000 7f7424cb4640 1 --2- 172.21.15.130:0/2890260970 >> v2:172.21.15.94:3300/0 conn(0x7f74200d17e0 0x7f742015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.910+0000 7f7424cb4640 1 -- 172.21.15.130:0/2890260970 >> 172.21.15.130:0/2890260970 conn(0x7f742009bbf0 msgr2=0x7f74200d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.910+0000 7f7424cb4640 1 -- 172.21.15.130:0/2890260970 shutdown_connections 2023-10-16T08:50:57.915 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.910+0000 7f7424cb4640 1 -- 172.21.15.130:0/2890260970 wait complete. 2023-10-16T08:50:57.917 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.911+0000 7f7424cb4640 1 Processor -- start 2023-10-16T08:50:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.911+0000 7f7424cb4640 1 -- start start 2023-10-16T08:50:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.912+0000 7f7424cb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 0x7f742014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.912+0000 7f7424cb4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74201609c0 0x7f74200c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.912+0000 7f7424cb4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7420160da0 0x7f74200c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:57.918 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.912+0000 7f7424cb4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742014b340 con 0x7f7420160da0 2023-10-16T08:50:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.912+0000 7f7424cb4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200c88f0 con 0x7f74200d17e0 2023-10-16T08:50:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.912+0000 7f7424cb4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742015baf0 con 0x7f74201609c0 2023-10-16T08:50:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 0x7f742014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f7417fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74201609c0 0x7f74200c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.919 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 0x7f742014ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57298/0 (socket says 172.21.15.130:57298) 2023-10-16T08:50:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 -- 172.21.15.130:0/424693458 learned_addr learned my addr 172.21.15.130:0/424693458 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741ffff640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7420160da0 0x7f74200c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 -- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74201609c0 msgr2=0x7f74200c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74201609c0 0x7f74200c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.920 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 -- 172.21.15.130:0/424693458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7420160da0 msgr2=0x7f74200c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:57.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7420160da0 0x7f74200c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:57.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 -- 172.21.15.130:0/424693458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418009b30 con 0x7f74200d17e0 2023-10-16T08:50:57.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f7417fff640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74201609c0 0x7f74200c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:57.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.913+0000 7f741f7fe640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 0x7f742014ae00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f741000c450 tx=0x7f741000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:57.921 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100052d0 con 0x7f74200d17e0 2023-10-16T08:50:57.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410005450 con 0x7f74200d17e0 2023-10-16T08:50:57.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410003880 con 0x7f74200d17e0 2023-10-16T08:50:57.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74200c7ce0 con 0x7f74200d17e0 2023-10-16T08:50:57.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74200c82a0 con 0x7f74200d17e0 2023-10-16T08:50:57.922 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7410003ce0 con 0x7f74200d17e0 2023-10-16T08:50:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.914+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7410012c20 con 0x7f74200d17e0 2023-10-16T08:50:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.915+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74200ce100 con 0x7f74200d17e0 2023-10-16T08:50:57.923 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.917+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7410012630 con 0x7f74200d17e0 2023-10-16T08:50:57.945 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.943+0000 7f4085841040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T08:50:57.955 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:57.953+0000 7fe87ecb6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T08:50:57.994 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:57.992+0000 7f4085841040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T08:50:57.997 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:57.994+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3e59f2d4-3bdf-4442-afad-dbd7fef9cd77", "id": 6} v 0) v1 -- 0x7f742004e9b0 con 0x7f74200d17e0 2023-10-16T08:50:58.005 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.002+0000 7f741cff9640 1 -- 172.21.15.130:0/424693458 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e59f2d4-3bdf-4442-afad-dbd7fef9cd77", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7410012890 con 0x7f74200d17e0 2023-10-16T08:50:58.005 INFO:teuthology.orchestra.run.smithi130.stdout:6 2023-10-16T08:50:58.006 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 msgr2=0x7f742014ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 0x7f742014ae00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f741000c450 tx=0x7f741000c910 comp rx=0 tx=0).stop 2023-10-16T08:50:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 shutdown_connections 2023-10-16T08:50:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7420160da0 0x7f74200c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.007 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74201609c0 0x7f74200c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 --2- 172.21.15.130:0/424693458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74200d17e0 0x7f742014ae00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 >> 172.21.15.130:0/424693458 conn(0x7f742009bbf0 msgr2=0x7f74200d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 shutdown_connections 2023-10-16T08:50:58.008 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.004+0000 7f7424cb4640 1 -- 172.21.15.130:0/424693458 wait complete. 2023-10-16T08:50:58.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 24742a3c-8f31-41d9-b0a8-a5e0365b88f3 7 2023-10-16T08:50:58.121 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:58.119+0000 7fe87ecb6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T08:50:58.151 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:58.149+0000 7f4085841040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T08:50:58.173 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:58.171+0000 7fe87ecb6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T08:50:58.211 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.209+0000 7f8442660640 1 Processor -- start 2023-10-16T08:50:58.212 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.209+0000 7f8442660640 1 -- start start 2023-10-16T08:50:58.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.210+0000 7f8442660640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f843c0d17e0 0x7f843c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.210+0000 7f8442660640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0ce4c0 con 0x7f843c1609c0 2023-10-16T08:50:58.213 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.210+0000 7f8442660640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0cd8b0 con 0x7f843c160da0 2023-10-16T08:50:58.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.210+0000 7f8442660640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c0cdb90 con 0x7f843c0d17e0 2023-10-16T08:50:58.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8440e5d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f843c0d17e0 0x7f843c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8441e5f640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f843c160da0 0x7f843c15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:54214/0 (socket says 172.21.15.130:54214) 2023-10-16T08:50:58.214 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8440e5d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f843c0d17e0 0x7f843c15c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57310/0 (socket says 172.21.15.130:57310) 2023-10-16T08:50:58.215 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8441e5f640 1 -- 172.21.15.130:0/3884062853 learned_addr learned my addr 172.21.15.130:0/3884062853 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-10-16T08:50:58.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8440e5d640 1 -- 172.21.15.130:0/3884062853 >> v1:172.21.15.130:6789/0 conn(0x7f843c160da0 legacy=0x7f843c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.216 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8440e5d640 1 -- 172.21.15.130:0/3884062853 >> v1:172.21.15.94:6789/0 conn(0x7f843c1609c0 legacy=0x7f843c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:58.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.211+0000 7f8440e5d640 1 -- 172.21.15.130:0/3884062853 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0cde70 con 0x7f843c0d17e0 2023-10-16T08:50:58.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.212+0000 7f8440e5d640 1 --2- 172.21.15.130:0/3884062853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c15c530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f842c0097a0 tx=0x7f842c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eacffe544f477e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:58.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8433fff640 1 -- 172.21.15.130:0/3884062853 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c030610 con 0x7f843c0d17e0 2023-10-16T08:50:58.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8433fff640 1 -- 172.21.15.130:0/3884062853 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c030770 con 0x7f843c0d17e0 2023-10-16T08:50:58.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8433fff640 1 -- 172.21.15.130:0/3884062853 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c030b00 con 0x7f843c0d17e0 2023-10-16T08:50:58.217 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8442660640 1 -- 172.21.15.130:0/3884062853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 msgr2=0x7f843c15c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8442660640 1 --2- 172.21.15.130:0/3884062853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c15c530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f842c0097a0 tx=0x7f842c02b960 comp rx=0 tx=0).stop 2023-10-16T08:50:58.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8442660640 1 -- 172.21.15.130:0/3884062853 shutdown_connections 2023-10-16T08:50:58.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8442660640 1 --2- 172.21.15.130:0/3884062853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c15c530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.213+0000 7f8442660640 1 -- 172.21.15.130:0/3884062853 >> 172.21.15.130:0/3884062853 conn(0x7f843c09bbf0 msgr2=0x7f843c0d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:58.218 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.214+0000 7f8442660640 1 -- 172.21.15.130:0/3884062853 shutdown_connections 2023-10-16T08:50:58.219 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.214+0000 7f8442660640 1 -- 172.21.15.130:0/3884062853 wait complete. 2023-10-16T08:50:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.215+0000 7f8442660640 1 Processor -- start 2023-10-16T08:50:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.215+0000 7f8442660640 1 -- start start 2023-10-16T08:50:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f8442660640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.221 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f8442660640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f843c1609c0 0x7f843c09c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f8442660640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f843c160da0 0x7f843c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f8442660640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c09fe90 con 0x7f843c1609c0 2023-10-16T08:50:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f8442660640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c09f280 con 0x7f843c0d17e0 2023-10-16T08:50:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f8442660640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c09f560 con 0x7f843c160da0 2023-10-16T08:50:58.222 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.216+0000 7f844165e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c14dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57322/0 (socket says 172.21.15.130:57322) 2023-10-16T08:50:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f8441e5f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f843c160da0 0x7f843c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 -- 172.21.15.130:0/809901614 learned_addr learned my addr 172.21.15.130:0/809901614 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-16T08:50:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f8440e5d640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f843c1609c0 0x7f843c09c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.223 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 -- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f843c160da0 msgr2=0x7f843c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f843c160da0 0x7f843c0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 -- 172.21.15.130:0/809901614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f843c1609c0 msgr2=0x7f843c09c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f843c1609c0 0x7f843c09c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 -- 172.21.15.130:0/809901614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c009400 con 0x7f843c0d17e0 2023-10-16T08:50:58.224 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f8441e5f640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f843c160da0 0x7f843c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:50:58.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.217+0000 7f844165e640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c14dcc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f843800c7c0 tx=0x7f843800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:58.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438003bc0 con 0x7f843c0d17e0 2023-10-16T08:50:58.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438003d40 con 0x7f843c0d17e0 2023-10-16T08:50:58.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800aa90 con 0x7f843c0d17e0 2023-10-16T08:50:58.225 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c09f840 con 0x7f843c0d17e0 2023-10-16T08:50:58.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c14e200 con 0x7f843c0d17e0 2023-10-16T08:50:58.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84380050d0 con 0x7f843c0d17e0 2023-10-16T08:50:58.226 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.218+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8438012b70 con 0x7f843c0d17e0 2023-10-16T08:50:58.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.219+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c04e9b0 con 0x7f843c0d17e0 2023-10-16T08:50:58.227 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.221+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8438012df0 con 0x7f843c0d17e0 2023-10-16T08:50:58.300 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.298+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24742a3c-8f31-41d9-b0a8-a5e0365b88f3", "id": 7} v 0) v1 -- 0x7f843c0ce120 con 0x7f843c0d17e0 2023-10-16T08:50:58.310 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.307+0000 7f8431ffb640 1 -- 172.21.15.130:0/809901614 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24742a3c-8f31-41d9-b0a8-a5e0365b88f3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8438005380 con 0x7f843c0d17e0 2023-10-16T08:50:58.310 INFO:teuthology.orchestra.run.smithi130.stdout:7 2023-10-16T08:50:58.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 msgr2=0x7f843c14dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c14dcc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f843800c7c0 tx=0x7f843800cc80 comp rx=0 tx=0).stop 2023-10-16T08:50:58.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 shutdown_connections 2023-10-16T08:50:58.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f843c160da0 0x7f843c0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.312 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f843c1609c0 0x7f843c09c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 --2- 172.21.15.130:0/809901614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f843c0d17e0 0x7f843c14dcc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 >> 172.21.15.130:0/809901614 conn(0x7f843c09bbf0 msgr2=0x7f843c15f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:58.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 shutdown_connections 2023-10-16T08:50:58.313 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:50:58.309+0000 7f8442660640 1 -- 172.21.15.130:0/809901614 wait complete. 2023-10-16T08:50:58.327 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T08:50:58.327 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T08:50:58.336 INFO:tasks.ceph.osd.0:Started 2023-10-16T08:50:58.336 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T08:50:58.337 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T08:50:58.340 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:58.337+0000 7fe87ecb6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T08:50:58.345 INFO:tasks.ceph.osd.1:Started 2023-10-16T08:50:58.345 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T08:50:58.346 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T08:50:58.352 INFO:tasks.ceph.osd.2:Started 2023-10-16T08:50:58.352 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T08:50:58.353 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T08:50:58.358 INFO:tasks.ceph.osd.3:Started 2023-10-16T08:50:58.359 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T08:50:58.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T08:50:58.367 INFO:tasks.ceph.osd.4:Started 2023-10-16T08:50:58.368 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T08:50:58.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T08:50:58.376 INFO:tasks.ceph.osd.5:Started 2023-10-16T08:50:58.376 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T08:50:58.377 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T08:50:58.382 INFO:tasks.ceph.osd.6:Started 2023-10-16T08:50:58.383 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T08:50:58.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T08:50:58.389 INFO:tasks.ceph.osd.7:Started 2023-10-16T08:50:58.390 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:50:58.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.614+0000 7fe159e7c640 1 Processor -- start 2023-10-16T08:50:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.615+0000 7fe159e7c640 1 -- start start 2023-10-16T08:50:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe159e7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe15415cd10 0x7fe1540d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe159e7c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1541611b0 0x7fe1540cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe159e7c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1540ce370 con 0x7fe1540cd9b0 2023-10-16T08:50:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe159e7c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1541617d0 con 0x7fe1541611b0 2023-10-16T08:50:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe159e7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540d0c30 con 0x7fe15415cd10 2023-10-16T08:50:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1541611b0 0x7fe1540cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1541611b0 0x7fe1540cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57304/0 (socket says 172.21.15.94:57304) 2023-10-16T08:50:58.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe14bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe1540cd9b0 0x7fe154160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:51132/0 (socket says 172.21.15.94:51132) 2023-10-16T08:50:58.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 -- 172.21.15.94:0/3365360853 learned_addr learned my addr 172.21.15.94:0/3365360853 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:50:58.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe1537fe640 1 --2- 172.21.15.94:0/3365360853 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe15415cd10 0x7fe1540d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 -- 172.21.15.94:0/3365360853 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe15415cd10 msgr2=0x7fe1540d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:50:58.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 --2- 172.21.15.94:0/3365360853 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe15415cd10 0x7fe1540d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 -- 172.21.15.94:0/3365360853 >> v1:172.21.15.94:6789/0 conn(0x7fe1540cd9b0 legacy=0x7fe154160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe153fff640 1 -- 172.21.15.94:0/3365360853 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540d0f10 con 0x7fe1541611b0 2023-10-16T08:50:58.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.616+0000 7fe152ffd640 1 -- 172.21.15.94:0/3365360853 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221747936 0 0) 0x7fe1540ce370 con 0x7fe1540cd9b0 2023-10-16T08:50:58.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.618+0000 7fe153fff640 1 --2- 172.21.15.94:0/3365360853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541611b0 0x7fe1540cde30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009e50 tx=0x7fe14c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38694fe932565329 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:58.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.618+0000 7fe152ffd640 1 -- 172.21.15.94:0/3365360853 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c02ca70 con 0x7fe1541611b0 2023-10-16T08:50:58.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.618+0000 7fe152ffd640 1 -- 172.21.15.94:0/3365360853 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c02cbd0 con 0x7fe1541611b0 2023-10-16T08:50:58.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.618+0000 7fe152ffd640 1 -- 172.21.15.94:0/3365360853 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0343f0 con 0x7fe1541611b0 2023-10-16T08:50:58.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 -- 172.21.15.94:0/3365360853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541611b0 msgr2=0x7fe1540cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 --2- 172.21.15.94:0/3365360853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541611b0 0x7fe1540cde30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009e50 tx=0x7fe14c02bed0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 -- 172.21.15.94:0/3365360853 shutdown_connections 2023-10-16T08:50:58.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 --2- 172.21.15.94:0/3365360853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1541611b0 0x7fe1540cde30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 --2- 172.21.15.94:0/3365360853 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe15415cd10 0x7fe1540d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 -- 172.21.15.94:0/3365360853 >> 172.21.15.94:0/3365360853 conn(0x7fe1540b44a0 msgr2=0x7fe1540b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:58.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 -- 172.21.15.94:0/3365360853 shutdown_connections 2023-10-16T08:50:58.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.619+0000 7fe159e7c640 1 -- 172.21.15.94:0/3365360853 wait complete. 2023-10-16T08:50:58.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.621+0000 7fe159e7c640 1 Processor -- start 2023-10-16T08:50:58.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.621+0000 7fe159e7c640 1 -- start start 2023-10-16T08:50:58.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe159e7c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 0x7fe15415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe159e7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe15415cd10 0x7fe15414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe159e7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1541611b0 0x7fe1540cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe159e7c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15414e700 con 0x7fe1540cd9b0 2023-10-16T08:50:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe159e7c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15414eeb0 con 0x7fe15415cd10 2023-10-16T08:50:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe159e7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540cc9f0 con 0x7fe1541611b0 2023-10-16T08:50:58.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 0x7fe15415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 0x7fe15415ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57316/0 (socket says 172.21.15.94:57316) 2023-10-16T08:50:58.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 -- 172.21.15.94:0/2551436631 learned_addr learned my addr 172.21.15.94:0/2551436631 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:50:58.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe153fff640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1541611b0 0x7fe1540cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe14bfff640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe15415cd10 0x7fe15414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:58.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 -- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1541611b0 msgr2=0x7fe1540cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1541611b0 0x7fe1540cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 -- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe15415cd10 msgr2=0x7fe15414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe15415cd10 0x7fe15414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe1537fe640 1 -- 172.21.15.94:0/2551436631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c009b30 con 0x7fe1540cd9b0 2023-10-16T08:50:58.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.622+0000 7fe14bfff640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe15415cd10 0x7fe15414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:50:58.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.623+0000 7fe1537fe640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 0x7fe15415ae50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e9e0 tx=0x7fe14400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:58.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.623+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144009670 con 0x7fe1540cd9b0 2023-10-16T08:50:58.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.623+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400c970 con 0x7fe1540cd9b0 2023-10-16T08:50:58.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.623+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400cd20 con 0x7fe1540cd9b0 2023-10-16T08:50:58.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.623+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1540cba50 con 0x7fe1540cd9b0 2023-10-16T08:50:58.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.624+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15414e8f0 con 0x7fe1540cd9b0 2023-10-16T08:50:58.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.624+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe144013770 con 0x7fe1540cd9b0 2023-10-16T08:50:58.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.624+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe14400ce80 con 0x7fe1540cd9b0 2023-10-16T08:50:58.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.625+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe154073ef0 con 0x7fe1540cd9b0 2023-10-16T08:50:58.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.627+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe144021060 con 0x7fe1540cd9b0 2023-10-16T08:50:58.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.690+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1540d08e0 con 0x7fe1540cd9b0 2023-10-16T08:50:58.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.691+0000 7fe150ff9640 1 -- 172.21.15.94:0/2551436631 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe144017070 con 0x7fe1540cd9b0 2023-10-16T08:50:58.693 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:50:58.694 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:50:58.301863+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:50:58.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 msgr2=0x7fe15415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:58.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 0x7fe15415ae50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e9e0 tx=0x7fe14400eea0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 shutdown_connections 2023-10-16T08:50:58.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1541611b0 0x7fe1540cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe15415cd10 0x7fe15414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 --2- 172.21.15.94:0/2551436631 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1540cd9b0 0x7fe15415ae50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:58.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.692+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 >> 172.21.15.94:0/2551436631 conn(0x7fe1540b44a0 msgr2=0x7fe15415b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:58.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.693+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 shutdown_connections 2023-10-16T08:50:58.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:50:58.693+0000 7fe159e7c640 1 -- 172.21.15.94:0/2551436631 wait complete. 2023-10-16T08:50:58.710 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T08:50:58.711 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T08:50:59.044 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T08:50:59.042+0000 7f8fb4f1e500 -1 Falling back to public interface 2023-10-16T08:50:59.070 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T08:50:59.068+0000 7fd247c1f500 -1 Falling back to public interface 2023-10-16T08:50:59.070 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T08:50:59.068+0000 7f4b0f3e2500 -1 Falling back to public interface 2023-10-16T08:50:59.071 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T08:50:59.068+0000 7fb0abb4a500 -1 Falling back to public interface 2023-10-16T08:50:59.075 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T08:50:59.073+0000 7fc216e0c500 -1 Falling back to public interface 2023-10-16T08:50:59.079 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T08:50:59.078+0000 7f2353aad500 -1 Falling back to public interface 2023-10-16T08:50:59.082 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T08:50:59.080+0000 7f2e60049500 -1 Falling back to public interface 2023-10-16T08:50:59.096 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T08:50:59.095+0000 7fbe413ad500 -1 Falling back to public interface 2023-10-16T08:50:59.265 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:59.263+0000 7f4085841040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T08:50:59.424 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:59.422+0000 7fe87ecb6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T08:50:59.516 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T08:50:59.593 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:59.591+0000 7f4085841040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T08:50:59.656 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:59.654+0000 7f4085841040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T08:50:59.684 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.682+0000 7ff309da9640 1 Processor -- start 2023-10-16T08:50:59.684 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.682+0000 7ff309da9640 1 -- start start 2023-10-16T08:50:59.685 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff309da9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3040cace0 0x7ff3040cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:59.685 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff309da9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30406de60 con 0x7ff30415ced0 2023-10-16T08:50:59.685 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff309da9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040cc310 con 0x7ff3040c90b0 2023-10-16T08:50:59.686 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff309da9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30415d2b0 con 0x7ff3040cace0 2023-10-16T08:50:59.686 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff3037fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff30415ced0 0x7ff30406cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:51148/0 (socket says 172.21.15.94:51148) 2023-10-16T08:50:59.686 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff3037fe640 1 -- 172.21.15.94:0/1869663455 learned_addr learned my addr 172.21.15.94:0/1869663455 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:50:59.686 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.683+0000 7ff2faffd640 1 --2- 172.21.15.94:0/1869663455 >> v2:172.21.15.130:3300/0 conn(0x7ff3040cace0 0x7ff3040cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:59.688 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.684+0000 7ff302ffd640 1 -- 172.21.15.94:0/1869663455 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688058907 0 0) 0x7ff30406de60 con 0x7ff30415ced0 2023-10-16T08:50:59.688 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.684+0000 7ff302ffd640 1 -- 172.21.15.94:0/1869663455 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f0003520 con 0x7ff30415ced0 2023-10-16T08:50:59.689 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.684+0000 7ff2faffd640 1 -- 172.21.15.94:0/1869663455 >> v1:172.21.15.130:6789/0 conn(0x7ff3040c90b0 legacy=0x7ff3040c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:59.689 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.684+0000 7ff2faffd640 1 -- 172.21.15.94:0/1869663455 >> v1:172.21.15.94:6789/0 conn(0x7ff30415ced0 legacy=0x7ff30406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:59.689 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.684+0000 7ff2faffd640 1 -- 172.21.15.94:0/1869663455 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040cc5b0 con 0x7ff3040cace0 2023-10-16T08:50:59.689 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.685+0000 7ff2faffd640 1 --2- 172.21.15.94:0/1869663455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff3040cb150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097d0 tx=0x7ff2ec02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc861bf1bf140a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:59.689 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.685+0000 7ff302ffd640 1 -- 172.21.15.94:0/1869663455 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec030610 con 0x7ff3040cace0 2023-10-16T08:50:59.690 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.685+0000 7ff302ffd640 1 -- 172.21.15.94:0/1869663455 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec030770 con 0x7ff3040cace0 2023-10-16T08:50:59.690 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.685+0000 7ff302ffd640 1 -- 172.21.15.94:0/1869663455 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec030ae0 con 0x7ff3040cace0 2023-10-16T08:50:59.690 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 -- 172.21.15.94:0/1869663455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 msgr2=0x7ff3040cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:59.690 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 --2- 172.21.15.94:0/1869663455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff3040cb150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097d0 tx=0x7ff2ec02b960 comp rx=0 tx=0).stop 2023-10-16T08:50:59.691 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 -- 172.21.15.94:0/1869663455 shutdown_connections 2023-10-16T08:50:59.691 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 --2- 172.21.15.94:0/1869663455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff3040cb150 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:59.691 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 -- 172.21.15.94:0/1869663455 >> 172.21.15.94:0/1869663455 conn(0x7ff3040b0110 msgr2=0x7ff3040b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:59.692 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 -- 172.21.15.94:0/1869663455 shutdown_connections 2023-10-16T08:50:59.692 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.686+0000 7ff309da9640 1 -- 172.21.15.94:0/1869663455 wait complete. 2023-10-16T08:50:59.694 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.687+0000 7ff309da9640 1 Processor -- start 2023-10-16T08:50:59.695 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.688+0000 7ff309da9640 1 -- start start 2023-10-16T08:50:59.695 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.688+0000 7ff309da9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 0x7ff3040c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:59.695 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff309da9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff30414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:59.695 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff309da9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff30415ced0 0x7ff30415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:50:59.696 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff309da9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040c5bb0 con 0x7ff3040c90b0 2023-10-16T08:50:59.696 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff309da9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040c4f30 con 0x7ff3040cace0 2023-10-16T08:50:59.696 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff309da9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040c7c40 con 0x7ff30415ced0 2023-10-16T08:50:59.696 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 0x7ff3040c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:59.696 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 0x7ff3040c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57326/0 (socket says 172.21.15.94:57326) 2023-10-16T08:50:59.697 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 -- 172.21.15.94:0/1574276242 learned_addr learned my addr 172.21.15.94:0/1574276242 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:50:59.697 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff2faffd640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff30414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:59.697 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 -- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff30415ced0 msgr2=0x7ff30415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:59.697 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff303fff640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff30415ced0 0x7ff30415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:50:59.697 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff30415ced0 0x7ff30415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:59.698 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 -- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 msgr2=0x7ff30414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:59.698 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff30414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:59.698 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 -- 172.21.15.94:0/1574276242 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec009400 con 0x7ff3040c90b0 2023-10-16T08:50:59.698 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff2faffd640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff30414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:50:59.698 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff303fff640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff30415ced0 0x7ff30415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:50:59.699 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.689+0000 7ff3037fe640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 0x7ff3040c5670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400cbc0 tx=0x7ff2f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:50:59.699 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.690+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400ad40 con 0x7ff3040c90b0 2023-10-16T08:50:59.699 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.690+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4012400 con 0x7ff3040c90b0 2023-10-16T08:50:59.699 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.690+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400aea0 con 0x7ff3040c90b0 2023-10-16T08:50:59.700 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.690+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3040c4c50 con 0x7ff3040c90b0 2023-10-16T08:50:59.700 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.690+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3040c81c0 con 0x7ff3040c90b0 2023-10-16T08:50:59.700 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.691+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2f4012ab0 con 0x7ff3040c90b0 2023-10-16T08:50:59.700 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.691+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff2f4012d60 con 0x7ff3040c90b0 2023-10-16T08:50:59.700 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.691+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3040cb610 con 0x7ff3040c90b0 2023-10-16T08:50:59.701 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.694+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff2f4021060 con 0x7ff3040c90b0 2023-10-16T08:50:59.731 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:59.729+0000 7fe87ecb6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T08:50:59.777 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.775+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3040cc860 con 0x7ff3040c90b0 2023-10-16T08:50:59.778 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.776+0000 7ff300ff9640 1 -- 172.21.15.94:0/1574276242 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff2f4017070 con 0x7ff3040c90b0 2023-10-16T08:50:59.778 INFO:teuthology.misc.health.smithi094.stdout: 2023-10-16T08:50:59.779 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:50:58.301863+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:50:59.780 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 msgr2=0x7ff3040c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:50:59.780 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 0x7ff3040c5670 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400cbc0 tx=0x7ff2f400a430 comp rx=0 tx=0).stop 2023-10-16T08:50:59.780 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 shutdown_connections 2023-10-16T08:50:59.781 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff30415ced0 0x7ff30415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:59.781 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3040cace0 0x7ff30414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:59.781 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 --2- 172.21.15.94:0/1574276242 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3040c90b0 0x7ff3040c5670 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:50:59.781 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 >> 172.21.15.94:0/1574276242 conn(0x7ff3040b0110 msgr2=0x7ff30406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:50:59.781 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 shutdown_connections 2023-10-16T08:50:59.782 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:50:59.778+0000 7ff309da9640 1 -- 172.21.15.94:0/1574276242 wait complete. 2023-10-16T08:50:59.789 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:59.787+0000 7fe87ecb6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T08:50:59.792 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T08:50:59.795 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:50:59.794+0000 7f4085841040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T08:50:59.911 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-16T08:50:59.910+0000 7fe87ecb6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T08:51:00.833 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:51:00.831+0000 7f4026c51640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T08:51:00.836 INFO:tasks.ceph.mgr.y.smithi094.stderr:2023-10-16T08:51:00.834+0000 7f4026c51640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T08:51:01.529 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:51:01.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:51:02.560 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T08:51:02.558+0000 7f8fb4f1e500 -1 osd.0 0 log_to_monitors true 2023-10-16T08:51:02.612 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T08:51:02.611+0000 7fd247c1f500 -1 osd.6 0 log_to_monitors true 2023-10-16T08:51:02.659 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T08:51:02.657+0000 7f4b0f3e2500 -1 osd.5 0 log_to_monitors true 2023-10-16T08:51:02.659 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T08:51:02.658+0000 7f2e60049500 -1 osd.3 0 log_to_monitors true 2023-10-16T08:51:02.885 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T08:51:02.883+0000 7fb0abb4a500 -1 osd.1 0 log_to_monitors true 2023-10-16T08:51:02.915 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T08:51:02.913+0000 7fc216e0c500 -1 osd.2 0 log_to_monitors true 2023-10-16T08:51:02.929 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T08:51:02.928+0000 7f2353aad500 -1 osd.7 0 log_to_monitors true 2023-10-16T08:51:02.947 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T08:51:02.946+0000 7fbe413ad500 -1 osd.4 0 log_to_monitors true 2023-10-16T08:51:05.042 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T08:51:05.040+0000 7f2e5bfd7640 -1 osd.3 0 waiting for initial osdmap 2023-10-16T08:51:05.045 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T08:51:05.043+0000 7f8fb0eaa640 -1 osd.0 0 waiting for initial osdmap 2023-10-16T08:51:05.059 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T08:51:05.057+0000 7f2e53df7640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:05.063 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T08:51:05.061+0000 7f8fa8cca640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:05.382 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T08:51:05.379+0000 7f4b0bb84640 -1 osd.5 0 waiting for initial osdmap 2023-10-16T08:51:05.396 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T08:51:05.395+0000 7fd2434eb640 -1 osd.6 0 waiting for initial osdmap 2023-10-16T08:51:05.412 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T08:51:05.410+0000 7f4b0318e640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:05.423 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T08:51:05.422+0000 7fd23b30b640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:05.955 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T08:51:05.953+0000 7fb0a7ad6640 -1 osd.1 0 waiting for initial osdmap 2023-10-16T08:51:05.975 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T08:51:05.974+0000 7fb09f8f6640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:05.978 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T08:51:05.977+0000 7fc212d98640 -1 osd.2 0 waiting for initial osdmap 2023-10-16T08:51:05.993 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T08:51:05.991+0000 7fc20abb8640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:06.270 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T08:51:06.268+0000 7f234fa39640 -1 osd.7 0 waiting for initial osdmap 2023-10-16T08:51:06.285 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T08:51:06.283+0000 7f2347859640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:06.288 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T08:51:06.287+0000 7fbe3d339640 -1 osd.4 0 waiting for initial osdmap 2023-10-16T08:51:06.314 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T08:51:06.313+0000 7fbe35159640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T08:51:06.599 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:06.780 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.778+0000 7f2fe0839640 1 Processor -- start 2023-10-16T08:51:06.780 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.778+0000 7f2fe0839640 1 -- start start 2023-10-16T08:51:06.781 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.779+0000 7f2fe0839640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 0x7f2fdc0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.782 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.779+0000 7f2fe0839640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2fdc06c970 0x7f2fdc06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.782 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.779+0000 7f2fe0839640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0cb930 con 0x7f2fdc15ae90 2023-10-16T08:51:06.782 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.779+0000 7f2fe0839640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc070260 con 0x7f2fdc06c970 2023-10-16T08:51:06.782 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.779+0000 7f2fe0839640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc070540 con 0x7f2fdc0cafb0 2023-10-16T08:51:06.783 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fda59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2fdc15ae90 0x7f2fdc15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58138/0 (socket says 172.21.15.94:58138) 2023-10-16T08:51:06.783 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fda59c640 1 -- 172.21.15.94:0/2922710889 learned_addr learned my addr 172.21.15.94:0/2922710889 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:06.786 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fdad9d640 1 --2- 172.21.15.94:0/2922710889 >> v2:172.21.15.130:3300/0 conn(0x7f2fdc06c970 0x7f2fdc06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.786 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 0x7f2fdc0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.786 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113680463 0 0) 0x7f2fdc0cb930 con 0x7f2fdc15ae90 2023-10-16T08:51:06.786 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc8003520 con 0x7f2fdc15ae90 2023-10-16T08:51:06.787 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555747659 0 0) 0x7f2fc8003520 con 0x7f2fdc15ae90 2023-10-16T08:51:06.787 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 msgr2=0x7f2fdc0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:06.787 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 0x7f2fdc0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.787 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 >> v2:172.21.15.130:3300/0 conn(0x7f2fdc06c970 msgr2=0x7f2fdc06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:06.788 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.780+0000 7f2fd9d9b640 1 --2- 172.21.15.94:0/2922710889 >> v2:172.21.15.130:3300/0 conn(0x7f2fdc06c970 0x7f2fdc06cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.788 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc070820 con 0x7f2fdc15ae90 2023-10-16T08:51:06.788 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f2fcc001670 con 0x7f2fdc15ae90 2023-10-16T08:51:06.788 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 >> v1:172.21.15.94:6789/0 conn(0x7f2fdc15ae90 legacy=0x7f2fdc15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:06.788 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 0x7f2fc8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.789 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.789 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc8004d00 0x7f2fc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.789 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc070260 con 0x7f2fc8003ef0 2023-10-16T08:51:06.789 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc070540 con 0x7f2fc8004d00 2023-10-16T08:51:06.789 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc800fd90 con 0x7f2fdc0cafb0 2023-10-16T08:51:06.789 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.790 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fda59c640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 0x7f2fc8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.790 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fdad9d640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc8004d00 0x7f2fc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.790 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd3fff640 1 -- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 msgr2=0x7f2fc8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:06.790 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc0cafb0 0x7f2fc8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.791 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd3fff640 1 -- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc8004d00 msgr2=0x7f2fc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:06.791 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.781+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc8004d00 0x7f2fc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.791 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.782+0000 7f2fd3fff640 1 -- 172.21.15.94:0/2922710889 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8003520 con 0x7f2fc8003ef0 2023-10-16T08:51:06.791 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.783+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fc80047c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009a90 tx=0x7f2fc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0a845450c34775 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:06.791 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.783+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402c6b0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.792 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.783+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc402c810 con 0x7f2fc8003ef0 2023-10-16T08:51:06.792 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.783+0000 7f2fd9d9b640 1 -- 172.21.15.94:0/2922710889 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402cbc0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.792 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.783+0000 7f2fe0839640 1 -- 172.21.15.94:0/2922710889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 msgr2=0x7f2fc80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:06.793 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.784+0000 7f2fe0839640 1 --2- 172.21.15.94:0/2922710889 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fc80047c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009a90 tx=0x7f2fc80057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.793 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.784+0000 7f2fdad9d640 1 -- 172.21.15.94:0/2922710889 reap_dead start 2023-10-16T08:51:06.793 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.784+0000 7f2fe0839640 1 -- 172.21.15.94:0/2922710889 shutdown_connections 2023-10-16T08:51:06.793 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.784+0000 7f2fe0839640 1 -- 172.21.15.94:0/2922710889 >> 172.21.15.94:0/2922710889 conn(0x7f2fdc0b0110 msgr2=0x7f2fdc0b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:06.793 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.784+0000 7f2fe0839640 1 -- 172.21.15.94:0/2922710889 shutdown_connections 2023-10-16T08:51:06.794 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.784+0000 7f2fe0839640 1 -- 172.21.15.94:0/2922710889 wait complete. 2023-10-16T08:51:06.796 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.785+0000 7f2fe0839640 1 Processor -- start 2023-10-16T08:51:06.797 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 -- start start 2023-10-16T08:51:06.797 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fdc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.797 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc1eed10 0x7f2fdc15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.797 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fdc157850 0x7f2fdc157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.797 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1584e0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.797 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc158240 con 0x7f2fdc157850 2023-10-16T08:51:06.798 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.786+0000 7f2fe0839640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc15e160 con 0x7f2fdc1eed10 2023-10-16T08:51:06.798 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fdc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.798 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fdc155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47924/0 (socket says 172.21.15.94:47924) 2023-10-16T08:51:06.798 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 -- 172.21.15.94:0/767992779 learned_addr learned my addr 172.21.15.94:0/767992779 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:06.798 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc1eed10 0x7f2fdc15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.799 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fdad9d640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fdc157850 0x7f2fdc157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.799 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 -- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc1eed10 msgr2=0x7f2fdc15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:06.799 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc1eed10 0x7f2fdc15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.799 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 -- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fdc157850 msgr2=0x7f2fdc157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:06.799 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fdc157850 0x7f2fdc157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.800 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 -- 172.21.15.94:0/767992779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc1567c0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.800 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fdad9d640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fdc157850 0x7f2fdc157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:06.800 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.787+0000 7f2fda59c640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fdc155780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00e7a0 tx=0x7f2fcc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:06.800 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.788+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00eeb0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.800 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.788+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00c8d0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.801 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.788+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc156aa0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.801 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.788+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00cc80 con 0x7f2fc8003ef0 2023-10-16T08:51:06.801 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.788+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc157060 con 0x7f2fc8003ef0 2023-10-16T08:51:06.801 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.789+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc070ae0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.801 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.790+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f2fcc013420 con 0x7f2fc8003ef0 2023-10-16T08:51:06.801 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.790+0000 7f2fd2ffd640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2fbc06ae10 0x7f2fbc06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:06.802 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.791+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3911+0+0 (secure 0 0 0) 0x7f2fcc088b90 con 0x7f2fc8003ef0 2023-10-16T08:51:06.802 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.791+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2fbc06ae10 0x7f2fbc06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:06.802 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.791+0000 7f2fd3fff640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2fbc06ae10 0x7f2fbc06d2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4036000 tx=0x7f2fc4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:06.803 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.795+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fdc070ae0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.978 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.977+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fdc070ae0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.980 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.978+0000 7f2fd2ffd640 1 -- 172.21.15.94:0/767992779 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9924 (secure 0 0 0) 0x7f2fdc070ae0 con 0x7f2fc8003ef0 2023-10-16T08:51:06.981 INFO:teuthology.misc.health.smithi094.stdout: 2023-10-16T08:51:06.981 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":14,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:06.062485+0000","last_up_change":"2023-10-16T08:51:06.062485+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:06.983 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2fbc06ae10 msgr2=0x7f2fbc06d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:06.983 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2fbc06ae10 0x7f2fbc06d2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4036000 tx=0x7f2fc4030000 comp rx=0 tx=0).stop 2023-10-16T08:51:06.983 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 msgr2=0x7f2fdc155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:06.984 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fdc155780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00e7a0 tx=0x7f2fcc00ec60 comp rx=0 tx=0).stop 2023-10-16T08:51:06.984 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 shutdown_connections 2023-10-16T08:51:06.984 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2fbc06ae10 0x7f2fbc06d2d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.984 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fdc157850 0x7f2fdc157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.985 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fdc1eed10 0x7f2fdc15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.985 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 --2- 172.21.15.94:0/767992779 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fc8003ef0 0x7f2fdc155780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:06.985 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 >> 172.21.15.94:0/767992779 conn(0x7f2fdc0b0110 msgr2=0x7f2fdc159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:06.985 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 shutdown_connections 2023-10-16T08:51:06.985 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:06.981+0000 7f2fe0839640 1 -- 172.21.15.94:0/767992779 wait complete. 2023-10-16T08:51:06.996 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-10-16T08:51:13.804 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:13.990 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.988+0000 7f4897db0640 1 Processor -- start 2023-10-16T08:51:13.991 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.988+0000 7f4897db0640 1 -- start start 2023-10-16T08:51:13.992 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f4897db0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48900cafb0 0x7f48900cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:13.992 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f4897db0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900cb930 con 0x7f489015ae90 2023-10-16T08:51:13.992 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f4897db0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4890070260 con 0x7f489006c970 2023-10-16T08:51:13.992 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f4897db0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4890070540 con 0x7f48900cafb0 2023-10-16T08:51:13.993 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f489534b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48900cafb0 0x7f48900cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:13.993 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f489534b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48900cafb0 0x7f48900cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47958/0 (socket says 172.21.15.94:47958) 2023-10-16T08:51:13.993 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.990+0000 7f489534b640 1 -- 172.21.15.94:0/22491946 learned_addr learned my addr 172.21.15.94:0/22491946 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:13.995 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.991+0000 7f489534b640 1 -- 172.21.15.94:0/22491946 >> v1:172.21.15.130:6789/0 conn(0x7f489006c970 legacy=0x7f489006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:13.995 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.991+0000 7f489534b640 1 -- 172.21.15.94:0/22491946 >> v1:172.21.15.94:6789/0 conn(0x7f489015ae90 legacy=0x7f489015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:13.995 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.991+0000 7f489534b640 1 -- 172.21.15.94:0/22491946 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890070820 con 0x7f48900cafb0 2023-10-16T08:51:13.995 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.991+0000 7f4894b4a640 1 -- 172.21.15.94:0/22491946 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000013353 0 0) 0x7f48900cb930 con 0x7f489015ae90 2023-10-16T08:51:13.995 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.992+0000 7f489534b640 1 --2- 172.21.15.94:0/22491946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48900cafb0 0x7f48900cb3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4880009870 tx=0x7f488002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d458b38ec58b8be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:13.996 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.992+0000 7f4894b4a640 1 -- 172.21.15.94:0/22491946 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880030850 con 0x7f48900cafb0 2023-10-16T08:51:13.996 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.992+0000 7f4894b4a640 1 -- 172.21.15.94:0/22491946 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800309b0 con 0x7f48900cafb0 2023-10-16T08:51:13.996 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.992+0000 7f4894b4a640 1 -- 172.21.15.94:0/22491946 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880030d40 con 0x7f48900cafb0 2023-10-16T08:51:13.996 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 -- 172.21.15.94:0/22491946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48900cafb0 msgr2=0x7f48900cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:13.996 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 --2- 172.21.15.94:0/22491946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48900cafb0 0x7f48900cb3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4880009870 tx=0x7f488002b990 comp rx=0 tx=0).stop 2023-10-16T08:51:13.997 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 -- 172.21.15.94:0/22491946 shutdown_connections 2023-10-16T08:51:13.997 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 --2- 172.21.15.94:0/22491946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48900cafb0 0x7f48900cb3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:13.997 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 -- 172.21.15.94:0/22491946 >> 172.21.15.94:0/22491946 conn(0x7f48900b0110 msgr2=0x7f48900b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:13.997 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 -- 172.21.15.94:0/22491946 shutdown_connections 2023-10-16T08:51:13.997 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.993+0000 7f4897db0640 1 -- 172.21.15.94:0/22491946 wait complete. 2023-10-16T08:51:14.000 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.995+0000 7f4897db0640 1 Processor -- start 2023-10-16T08:51:14.000 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.995+0000 7f4897db0640 1 -- start start 2023-10-16T08:51:14.000 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f4897db0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f489006c970 0x7f48900c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.000 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f4897db0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48900cafb0 0x7f48900ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.001 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f4897db0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 0x7f48900b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.001 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f4897db0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900c2f50 con 0x7f489015ae90 2023-10-16T08:51:14.001 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f4897db0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900cc6f0 con 0x7f48900cafb0 2023-10-16T08:51:14.001 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f4897db0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900c2990 con 0x7f489006c970 2023-10-16T08:51:14.001 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 0x7f48900b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.002 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 0x7f48900b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47966/0 (socket says 172.21.15.94:47966) 2023-10-16T08:51:14.002 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 -- 172.21.15.94:0/700287297 learned_addr learned my addr 172.21.15.94:0/700287297 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:14.002 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 -- 172.21.15.94:0/700287297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f489006c970 msgr2=0x7f48900c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.002 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f489006c970 0x7f48900c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.002 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 -- 172.21.15.94:0/700287297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48900cafb0 msgr2=0x7f48900ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.003 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48900cafb0 0x7f48900ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.003 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.996+0000 7f489634d640 1 -- 172.21.15.94:0/700287297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800094d0 con 0x7f489015ae90 2023-10-16T08:51:14.003 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.997+0000 7f489634d640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 0x7f48900b2900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f488800b970 tx=0x7f488800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.003 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.997+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800cb40 con 0x7f489015ae90 2023-10-16T08:51:14.003 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.997+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800cca0 con 0x7f489015ae90 2023-10-16T08:51:14.004 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.997+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888014680 con 0x7f489015ae90 2023-10-16T08:51:14.004 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.997+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48900c2c70 con 0x7f489015ae90 2023-10-16T08:51:14.004 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.997+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48900c2610 con 0x7f489015ae90 2023-10-16T08:51:14.004 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.998+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900cc170 con 0x7f489015ae90 2023-10-16T08:51:14.005 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:13.999+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4888003970 con 0x7f489015ae90 2023-10-16T08:51:14.005 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.000+0000 7f48867fc640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f487406ae70 0x7f487406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.006 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.000+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4888089190 con 0x7f489015ae90 2023-10-16T08:51:14.006 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.001+0000 7f4895b4c640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f487406ae70 0x7f487406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.006 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.001+0000 7f4895b4c640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f487406ae70 0x7f487406d330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f488c001600 tx=0x7f488c007910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.006 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.004+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4888054570 con 0x7f489015ae90 2023-10-16T08:51:14.196 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.194+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48900cc170 con 0x7f489015ae90 2023-10-16T08:51:14.197 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.196+0000 7f48867fc640 1 -- 172.21.15.94:0/700287297 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f48900cc170 con 0x7f489015ae90 2023-10-16T08:51:14.198 INFO:teuthology.misc.health.smithi094.stdout: 2023-10-16T08:51:14.198 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":18,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:10.289687+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:14.200 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f487406ae70 msgr2=0x7f487406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.201 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f487406ae70 0x7f487406d330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f488c001600 tx=0x7f488c007910 comp rx=0 tx=0).stop 2023-10-16T08:51:14.201 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 msgr2=0x7f48900b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.201 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 0x7f48900b2900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f488800b970 tx=0x7f488800be30 comp rx=0 tx=0).stop 2023-10-16T08:51:14.201 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 shutdown_connections 2023-10-16T08:51:14.201 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f489015ae90 0x7f48900b2900 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.202 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f487406ae70 0x7f487406d330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.202 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48900cafb0 0x7f48900ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.202 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 --2- 172.21.15.94:0/700287297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f489006c970 0x7f48900c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.202 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.198+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 >> 172.21.15.94:0/700287297 conn(0x7f48900b0110 msgr2=0x7f48900c1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:14.202 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.199+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 shutdown_connections 2023-10-16T08:51:14.203 INFO:teuthology.misc.health.smithi094.stderr:2023-10-16T08:51:14.199+0000 7f4897db0640 1 -- 172.21.15.94:0/700287297 wait complete. 2023-10-16T08:51:14.215 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T08:51:14.215 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T08:51:14.216 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T08:51:14.216 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T08:51:14.224 INFO:tasks.ceph.mds.a:Started 2023-10-16T08:51:14.225 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T08:51:14.225 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T08:51:14.233 INFO:tasks.ceph.mds.c:Started 2023-10-16T08:51:14.233 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T08:51:14.233 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T08:51:14.242 INFO:tasks.ceph.mds.b:Started 2023-10-16T08:51:14.243 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T08:51:14.243 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T08:51:14.252 INFO:tasks.ceph.mds.d:Started 2023-10-16T08:51:14.252 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T08:51:14.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:14.379 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2023-10-16T08:51:14.380 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2023-10-16T08:51:14.410 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-16T08:51:14.414 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2023-10-16T08:51:14.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.437+0000 7f47040b4640 1 Processor -- start 2023-10-16T08:51:14.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.437+0000 7f47040b4640 1 -- start start 2023-10-16T08:51:14.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f47040b4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f46fc15ca80 0x7f46fc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f47040b4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46fc0b0720 0x7f46fc0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f47040b4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc161620 con 0x7f46fc15ce60 2023-10-16T08:51:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f47040b4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc0cafa0 con 0x7f46fc0b0720 2023-10-16T08:51:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f47040b4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc0cb280 con 0x7f46fc15ca80 2023-10-16T08:51:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f4702651640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46fc0b0720 0x7f46fc0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.438+0000 7f470164f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f46fc15ce60 0x7f46fc0b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58160/0 (socket says 172.21.15.94:58160) 2023-10-16T08:51:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4702651640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46fc0b0720 0x7f46fc0cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:47998/0 (socket says 172.21.15.94:47998) 2023-10-16T08:51:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f470164f640 1 -- 172.21.15.94:0/760506986 learned_addr learned my addr 172.21.15.94:0/760506986 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4701e50640 1 --2- 172.21.15.94:0/760506986 >> v2:172.21.15.130:3300/0 conn(0x7f46fc15ca80 0x7f46fc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4702651640 1 -- 172.21.15.94:0/760506986 >> v2:172.21.15.130:3300/0 conn(0x7f46fc15ca80 msgr2=0x7f46fc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4702651640 1 --2- 172.21.15.94:0/760506986 >> v2:172.21.15.130:3300/0 conn(0x7f46fc15ca80 0x7f46fc0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4702651640 1 -- 172.21.15.94:0/760506986 >> v1:172.21.15.94:6789/0 conn(0x7f46fc15ce60 legacy=0x7f46fc0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.444 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4702651640 1 -- 172.21.15.94:0/760506986 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0cb560 con 0x7f46fc0b0720 2023-10-16T08:51:14.444 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.439+0000 7f4700e4e640 1 -- 172.21.15.94:0/760506986 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489000686 0 0) 0x7f46fc161620 con 0x7f46fc15ce60 2023-10-16T08:51:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.440+0000 7f4702651640 1 --2- 172.21.15.94:0/760506986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc0b0720 0x7f46fc0cc4f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0b0cd0 tx=0x7f46f402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2ccecf32c86572 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.440+0000 7f4700e4e640 1 -- 172.21.15.94:0/760506986 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f402cc70 con 0x7f46fc0b0720 2023-10-16T08:51:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.440+0000 7f4700e4e640 1 -- 172.21.15.94:0/760506986 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f402cdd0 con 0x7f46fc0b0720 2023-10-16T08:51:14.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.440+0000 7f4700e4e640 1 -- 172.21.15.94:0/760506986 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4034660 con 0x7f46fc0b0720 2023-10-16T08:51:14.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 -- 172.21.15.94:0/760506986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc0b0720 msgr2=0x7f46fc0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 --2- 172.21.15.94:0/760506986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc0b0720 0x7f46fc0cc4f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0b0cd0 tx=0x7f46f402bec0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 -- 172.21.15.94:0/760506986 shutdown_connections 2023-10-16T08:51:14.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 --2- 172.21.15.94:0/760506986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc0b0720 0x7f46fc0cc4f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 --2- 172.21.15.94:0/760506986 >> v2:172.21.15.130:3300/0 conn(0x7f46fc15ca80 0x7f46fc0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 -- 172.21.15.94:0/760506986 >> 172.21.15.94:0/760506986 conn(0x7f46fc06c1c0 msgr2=0x7f46fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:14.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 -- 172.21.15.94:0/760506986 shutdown_connections 2023-10-16T08:51:14.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.441+0000 7f47040b4640 1 -- 172.21.15.94:0/760506986 wait complete. 2023-10-16T08:51:14.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 Processor -- start 2023-10-16T08:51:14.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 -- start start 2023-10-16T08:51:14.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46fc0b0720 0x7f46fc0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 0x7f46fc0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46fc15ce60 0x7f46fc0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1586e0 con 0x7f46fc15ca80 2023-10-16T08:51:14.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0b1d70 con 0x7f46fc15ce60 2023-10-16T08:51:14.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f47040b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0b2050 con 0x7f46fc0b0720 2023-10-16T08:51:14.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f470164f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 0x7f46fc0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f470164f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 0x7f46fc0b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48002/0 (socket says 172.21.15.94:48002) 2023-10-16T08:51:14.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f470164f640 1 -- 172.21.15.94:0/3028117336 learned_addr learned my addr 172.21.15.94:0/3028117336 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:14.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f4701e50640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46fc0b0720 0x7f46fc0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.444+0000 7f4702651640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46fc15ce60 0x7f46fc0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f470164f640 1 -- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46fc0b0720 msgr2=0x7f46fc0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f470164f640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46fc0b0720 0x7f46fc0c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f470164f640 1 -- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46fc15ce60 msgr2=0x7f46fc0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f470164f640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46fc15ce60 0x7f46fc0b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f470164f640 1 -- 172.21.15.94:0/3028117336 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f4009a70 con 0x7f46fc15ca80 2023-10-16T08:51:14.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f470164f640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 0x7f46fc0b11b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00c470 tx=0x7f46ec00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec005ce0 con 0x7f46fc15ca80 2023-10-16T08:51:14.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec005e40 con 0x7f46fc15ca80 2023-10-16T08:51:14.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0072b0 con 0x7f46fc15ca80 2023-10-16T08:51:14.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc0b2330 con 0x7f46fc15ca80 2023-10-16T08:51:14.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.445+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc0b28f0 con 0x7f46fc15ca80 2023-10-16T08:51:14.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.446+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc0b2b10 con 0x7f46fc15ca80 2023-10-16T08:51:14.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.447+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46ec007410 con 0x7f46fc15ca80 2023-10-16T08:51:14.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.448+0000 7f46f27fc640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f46e006aea0 0x7f46e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.448+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f46ec0887c0 con 0x7f46fc15ca80 2023-10-16T08:51:14.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.448+0000 7f4701e50640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f46e006aea0 0x7f46e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.449+0000 7f4701e50640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f46e006aea0 0x7f46e006d360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46f80079a0 tx=0x7f46f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.453+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46ec053bd0 con 0x7f46fc15ca80 2023-10-16T08:51:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.642+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46fc073ef0 con 0x7f46fc15ca80 2023-10-16T08:51:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.643+0000 7f46f27fc640 1 -- 172.21.15.94:0/3028117336 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f46ec017090 con 0x7f46fc15ca80 2023-10-16T08:51:14.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:14.645 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:10.289687+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.645+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f46e006aea0 msgr2=0x7f46e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.645+0000 7f47040b4640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f46e006aea0 0x7f46e006d360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46f80079a0 tx=0x7f46f8008040 comp rx=0 tx=0).stop 2023-10-16T08:51:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.645+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 msgr2=0x7f46fc0b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.645+0000 7f47040b4640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 0x7f46fc0b11b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00c470 tx=0x7f46ec00c930 comp rx=0 tx=0).stop 2023-10-16T08:51:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 shutdown_connections 2023-10-16T08:51:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f46e006aea0 0x7f46e006d360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46fc15ce60 0x7f46fc0b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46fc15ca80 0x7f46fc0b11b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 --2- 172.21.15.94:0/3028117336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46fc0b0720 0x7f46fc0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 >> 172.21.15.94:0/3028117336 conn(0x7f46fc06c1c0 msgr2=0x7f46fc0700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 shutdown_connections 2023-10-16T08:51:14.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.646+0000 7f47040b4640 1 -- 172.21.15.94:0/3028117336 wait complete. 2023-10-16T08:51:14.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T08:51:14.665 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:51:14.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.874+0000 7f75c3202640 1 Processor -- start 2023-10-16T08:51:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.875+0000 7f75c3202640 1 -- start start 2023-10-16T08:51:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.876+0000 7f75c3202640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 0x7f75bc15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.876+0000 7f75c3202640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.876+0000 7f75c3202640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0c8e40 con 0x7f75bc0c8930 2023-10-16T08:51:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.876+0000 7f75c3202640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0c9090 con 0x7f75bc070400 2023-10-16T08:51:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.876+0000 7f75c3202640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c9370 con 0x7f75bc0cb400 2023-10-16T08:51:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.877+0000 7f75c2200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 0x7f75bc15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.877+0000 7f75c2200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 0x7f75bc15e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:36858/0 (socket says 172.21.15.94:36858) 2023-10-16T08:51:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.877+0000 7f75c2200640 1 -- 172.21.15.94:0/319848383 learned_addr learned my addr 172.21.15.94:0/319848383 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.877+0000 7f75c2a01640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.878+0000 7f75c2a01640 1 -- 172.21.15.94:0/319848383 >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 msgr2=0x7f75bc15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.878+0000 7f75c2a01640 1 --2- 172.21.15.94:0/319848383 >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 0x7f75bc15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.878+0000 7f75c2a01640 1 -- 172.21.15.94:0/319848383 >> v1:172.21.15.130:6789/0 conn(0x7f75bc0c8930 legacy=0x7f75bc0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.878+0000 7f75c2a01640 1 -- 172.21.15.94:0/319848383 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0c9650 con 0x7f75bc0cb400 2023-10-16T08:51:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.878+0000 7f75c2200640 1 --2- 172.21.15.94:0/319848383 >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 0x7f75bc15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.879+0000 7f75c2a01640 1 --2- 172.21.15.94:0/319848383 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0707e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d90 tx=0x7f75b402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e34cc281fc12e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.879+0000 7f75c11fe640 1 -- 172.21.15.94:0/319848383 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b402cc60 con 0x7f75bc0cb400 2023-10-16T08:51:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c11fe640 1 -- 172.21.15.94:0/319848383 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b402cdc0 con 0x7f75bc0cb400 2023-10-16T08:51:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c11fe640 1 -- 172.21.15.94:0/319848383 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4034660 con 0x7f75bc0cb400 2023-10-16T08:51:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 -- 172.21.15.94:0/319848383 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 msgr2=0x7f75bc0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 --2- 172.21.15.94:0/319848383 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0707e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d90 tx=0x7f75b402beb0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 -- 172.21.15.94:0/319848383 shutdown_connections 2023-10-16T08:51:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 --2- 172.21.15.94:0/319848383 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0707e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 --2- 172.21.15.94:0/319848383 >> v2:172.21.15.130:3300/0 conn(0x7f75bc070400 0x7f75bc15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 -- 172.21.15.94:0/319848383 >> 172.21.15.94:0/319848383 conn(0x7f75bc06a470 msgr2=0x7f75bc0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 -- 172.21.15.94:0/319848383 shutdown_connections 2023-10-16T08:51:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.880+0000 7f75c3202640 1 -- 172.21.15.94:0/319848383 wait complete. 2023-10-16T08:51:14.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.882+0000 7f75c3202640 1 Processor -- start 2023-10-16T08:51:14.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.882+0000 7f75c3202640 1 -- start start 2023-10-16T08:51:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c3202640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 0x7f75bc144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c3202640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75bc0c8930 0x7f75bc0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c3202640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c3202640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c1e80 con 0x7f75bc070400 2023-10-16T08:51:14.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c3202640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0b29a0 con 0x7f75bc0c8930 2023-10-16T08:51:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c3202640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc147450 con 0x7f75bc0cb400 2023-10-16T08:51:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 0x7f75bc144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 0x7f75bc144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58546/0 (socket says 172.21.15.94:58546) 2023-10-16T08:51:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.883+0000 7f75c2200640 1 -- 172.21.15.94:0/440354427 learned_addr learned my addr 172.21.15.94:0/440354427 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c19ff640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75bc0c8930 0x7f75bc0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2a01640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2200640 1 -- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 msgr2=0x7f75bc0c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2200640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2200640 1 -- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75bc0c8930 msgr2=0x7f75bc0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:14.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2200640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75bc0c8930 0x7f75bc0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:14.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2200640 1 -- 172.21.15.94:0/440354427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80094d0 con 0x7f75bc070400 2023-10-16T08:51:14.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c2200640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 0x7f75bc144870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75b800e9d0 tx=0x7f75b800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800ca60 con 0x7f75bc070400 2023-10-16T08:51:14.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800cbc0 con 0x7f75bc070400 2023-10-16T08:51:14.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b4009a70 con 0x7f75bc070400 2023-10-16T08:51:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.884+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8013470 con 0x7f75bc070400 2023-10-16T08:51:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.885+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc147a10 con 0x7f75bc070400 2023-10-16T08:51:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.886+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0c20f0 con 0x7f75bc070400 2023-10-16T08:51:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.887+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75b80135d0 con 0x7f75bc070400 2023-10-16T08:51:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.887+0000 7f75b2ffd640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f75a006ae70 0x7f75a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.887+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75b8089920 con 0x7f75bc070400 2023-10-16T08:51:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.888+0000 7f75c19ff640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f75a006ae70 0x7f75a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.888+0000 7f75c19ff640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f75a006ae70 0x7f75a006d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0cdf60 tx=0x7f75ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:14.892+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75b8054d20 con 0x7f75bc070400 2023-10-16T08:51:15.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.082+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75bc0b3d80 con 0x7f75bc070400 2023-10-16T08:51:15.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.083+0000 7f75b2ffd640 1 -- 172.21.15.94:0/440354427 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75b80170a0 con 0x7f75bc070400 2023-10-16T08:51:15.085 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:51:15.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.085+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f75a006ae70 msgr2=0x7f75a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.085+0000 7f75c3202640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f75a006ae70 0x7f75a006d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0cdf60 tx=0x7f75ac009040 comp rx=0 tx=0).stop 2023-10-16T08:51:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.085+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 msgr2=0x7f75bc144870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.085+0000 7f75c3202640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 0x7f75bc144870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75b800e9d0 tx=0x7f75b800ee90 comp rx=0 tx=0).stop 2023-10-16T08:51:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 shutdown_connections 2023-10-16T08:51:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75bc0cb400 0x7f75bc0c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f75a006ae70 0x7f75a006d330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75bc0c8930 0x7f75bc0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 --2- 172.21.15.94:0/440354427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f75bc070400 0x7f75bc144870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 >> 172.21.15.94:0/440354427 conn(0x7f75bc06a470 msgr2=0x7f75bc15e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 shutdown_connections 2023-10-16T08:51:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.086+0000 7f75c3202640 1 -- 172.21.15.94:0/440354427 wait complete. 2023-10-16T08:51:15.106 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:51:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.309+0000 7f63e35d0640 1 Processor -- start 2023-10-16T08:51:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.309+0000 7f63e35d0640 1 -- start start 2023-10-16T08:51:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e35d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63dc0b0010 0x7f63dc0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e35d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63dc15f040 0x7f63dc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e35d0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc0707f0 con 0x7f63dc15ad00 2023-10-16T08:51:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e35d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc070ad0 con 0x7f63dc0b0010 2023-10-16T08:51:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e35d0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc15b1d0 con 0x7f63dc15f040 2023-10-16T08:51:15.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e136c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63dc0b0010 0x7f63dc0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e0b6b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f63dc15ad00 0x7f63dc0b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:33996/0 (socket says 172.21.15.94:33996) 2023-10-16T08:51:15.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.311+0000 7f63e0b6b640 1 -- 172.21.15.94:0/2698395938 learned_addr learned my addr 172.21.15.94:0/2698395938 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.312+0000 7f63e1b6d640 1 --2- 172.21.15.94:0/2698395938 >> v2:172.21.15.130:3300/0 conn(0x7f63dc15f040 0x7f63dc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.312+0000 7f63e136c640 1 -- 172.21.15.94:0/2698395938 >> v2:172.21.15.130:3300/0 conn(0x7f63dc15f040 msgr2=0x7f63dc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.312+0000 7f63e136c640 1 --2- 172.21.15.94:0/2698395938 >> v2:172.21.15.130:3300/0 conn(0x7f63dc15f040 0x7f63dc15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.312+0000 7f63e136c640 1 -- 172.21.15.94:0/2698395938 >> v1:172.21.15.94:6789/0 conn(0x7f63dc15ad00 legacy=0x7f63dc0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.312+0000 7f63e136c640 1 -- 172.21.15.94:0/2698395938 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc15b4b0 con 0x7f63dc0b0010 2023-10-16T08:51:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.312+0000 7f63d3fff640 1 -- 172.21.15.94:0/2698395938 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662353857 0 0) 0x7f63dc0707f0 con 0x7f63dc15ad00 2023-10-16T08:51:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.313+0000 7f63e136c640 1 --2- 172.21.15.94:0/2698395938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc0b0010 0x7f63dc0701a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0adf80 tx=0x7f63d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df579d4664f315 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.313+0000 7f63d3fff640 1 -- 172.21.15.94:0/2698395938 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8031830 con 0x7f63dc0b0010 2023-10-16T08:51:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.313+0000 7f63d3fff640 1 -- 172.21.15.94:0/2698395938 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8031990 con 0x7f63dc0b0010 2023-10-16T08:51:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.313+0000 7f63d3fff640 1 -- 172.21.15.94:0/2698395938 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8031d20 con 0x7f63dc0b0010 2023-10-16T08:51:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 -- 172.21.15.94:0/2698395938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc0b0010 msgr2=0x7f63dc0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 --2- 172.21.15.94:0/2698395938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc0b0010 0x7f63dc0701a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0adf80 tx=0x7f63d802b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 -- 172.21.15.94:0/2698395938 shutdown_connections 2023-10-16T08:51:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 --2- 172.21.15.94:0/2698395938 >> v2:172.21.15.130:3300/0 conn(0x7f63dc15f040 0x7f63dc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 --2- 172.21.15.94:0/2698395938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc0b0010 0x7f63dc0701a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 -- 172.21.15.94:0/2698395938 >> 172.21.15.94:0/2698395938 conn(0x7f63dc06c1c0 msgr2=0x7f63dc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 -- 172.21.15.94:0/2698395938 shutdown_connections 2023-10-16T08:51:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.314+0000 7f63e35d0640 1 -- 172.21.15.94:0/2698395938 wait complete. 2023-10-16T08:51:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.316+0000 7f63e35d0640 1 Processor -- start 2023-10-16T08:51:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.316+0000 7f63e35d0640 1 -- start start 2023-10-16T08:51:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e35d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63dc0b0010 0x7f63dc1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e35d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 0x7f63dc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e35d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63dc15f040 0x7f63dc0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e35d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0c5660 con 0x7f63dc15ad00 2023-10-16T08:51:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e35d0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0c5940 con 0x7f63dc0b0010 2023-10-16T08:51:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e35d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0c5c20 con 0x7f63dc15f040 2023-10-16T08:51:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e0b6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 0x7f63dc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e0b6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 0x7f63dc0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58566/0 (socket says 172.21.15.94:58566) 2023-10-16T08:51:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e0b6b640 1 -- 172.21.15.94:0/1783700701 learned_addr learned my addr 172.21.15.94:0/1783700701 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e136c640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63dc0b0010 0x7f63dc1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e1b6d640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63dc15f040 0x7f63dc0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e0b6b640 1 -- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63dc15f040 msgr2=0x7f63dc0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.317+0000 7f63e0b6b640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63dc15f040 0x7f63dc0cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63e0b6b640 1 -- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63dc0b0010 msgr2=0x7f63dc1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63e0b6b640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63dc0b0010 0x7f63dc1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63e0b6b640 1 -- 172.21.15.94:0/1783700701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8009400 con 0x7f63dc15ad00 2023-10-16T08:51:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63e0b6b640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 0x7f63dc0cd1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00c4b0 tx=0x7f63cc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0074e0 con 0x7f63dc15ad00 2023-10-16T08:51:15.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc007660 con 0x7f63dc15ad00 2023-10-16T08:51:15.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc004a20 con 0x7f63dc15ad00 2023-10-16T08:51:15.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc0c5f00 con 0x7f63dc15ad00 2023-10-16T08:51:15.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.318+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc0c7540 con 0x7f63dc15ad00 2023-10-16T08:51:15.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.319+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc0c6420 con 0x7f63dc15ad00 2023-10-16T08:51:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.320+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63cc004b80 con 0x7f63dc15ad00 2023-10-16T08:51:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.321+0000 7f63d1ffb640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63c006ae70 0x7f63c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.321+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63cc088490 con 0x7f63dc15ad00 2023-10-16T08:51:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.321+0000 7f63e136c640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63c006ae70 0x7f63c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.322+0000 7f63e136c640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63c006ae70 0x7f63c006d330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63d8036000 tx=0x7f63d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.325+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63dc0c6420 con 0x7f63dc15ad00 2023-10-16T08:51:15.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.553+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63dc0cdc30 con 0x7f63dc15ad00 2023-10-16T08:51:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.554+0000 7f63d1ffb640 1 -- 172.21.15.94:0/1783700701 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f63cc018090 con 0x7f63dc15ad00 2023-10-16T08:51:15.556 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:15.556 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T08:51:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 3 2023-10-16T08:51:15.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.556+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63c006ae70 msgr2=0x7f63c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.556+0000 7f63e35d0640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63c006ae70 0x7f63c006d330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63d8036000 tx=0x7f63d8008030 comp rx=0 tx=0).stop 2023-10-16T08:51:15.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.556+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 msgr2=0x7f63dc0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.556+0000 7f63e35d0640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 0x7f63dc0cd1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00c4b0 tx=0x7f63cc00c970 comp rx=0 tx=0).stop 2023-10-16T08:51:15.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 shutdown_connections 2023-10-16T08:51:15.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63dc15f040 0x7f63dc0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63dc15ad00 0x7f63dc0cd1b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63c006ae70 0x7f63c006d330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 --2- 172.21.15.94:0/1783700701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63dc0b0010 0x7f63dc1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 >> 172.21.15.94:0/1783700701 conn(0x7f63dc06c1c0 msgr2=0x7f63dc0aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 shutdown_connections 2023-10-16T08:51:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.557+0000 7f63e35d0640 1 -- 172.21.15.94:0/1783700701 wait complete. 2023-10-16T08:51:15.575 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:15.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.767+0000 7fdf77af7640 1 Processor -- start 2023-10-16T08:51:15.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.768+0000 7fdf77af7640 1 -- start start 2023-10-16T08:51:15.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.769+0000 7fdf77af7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdf700b0010 0x7fdf700701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.769+0000 7fdf77af7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf7015f040 0x7fdf7015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.769+0000 7fdf77af7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700707f0 con 0x7fdf7015ad00 2023-10-16T08:51:15.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.769+0000 7fdf77af7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf70070ad0 con 0x7fdf700b0010 2023-10-16T08:51:15.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.769+0000 7fdf77af7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7015b1d0 con 0x7fdf7015f040 2023-10-16T08:51:15.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.769+0000 7fdf75893640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdf700b0010 0x7fdf700701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75893640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdf700b0010 0x7fdf700701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58576/0 (socket says 172.21.15.94:58576) 2023-10-16T08:51:15.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75893640 1 -- 172.21.15.94:0/1698650925 learned_addr learned my addr 172.21.15.94:0/1698650925 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:15.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75092640 1 --1- 172.21.15.94:0/1698650925 >> v1:172.21.15.94:6789/0 conn(0x7fdf7015ad00 0x7fdf700b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34004/0 (socket says 172.21.15.94:34004) 2023-10-16T08:51:15.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf76094640 1 --2- 172.21.15.94:0/1698650925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf7015f040 0x7fdf7015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75893640 1 -- 172.21.15.94:0/1698650925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf7015f040 msgr2=0x7fdf7015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:15.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75893640 1 --2- 172.21.15.94:0/1698650925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf7015f040 0x7fdf7015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75893640 1 -- 172.21.15.94:0/1698650925 >> v1:172.21.15.94:6789/0 conn(0x7fdf7015ad00 legacy=0x7fdf700b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.770+0000 7fdf75893640 1 -- 172.21.15.94:0/1698650925 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7015b4b0 con 0x7fdf700b0010 2023-10-16T08:51:15.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.771+0000 7fdf75893640 1 --2- 172.21.15.94:0/1698650925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf700b0010 0x7fdf700701a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009870 tx=0x7fdf6c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeb836bcc549e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:15.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.771+0000 7fdf74891640 1 -- 172.21.15.94:0/1698650925 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c030840 con 0x7fdf700b0010 2023-10-16T08:51:15.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.771+0000 7fdf74891640 1 -- 172.21.15.94:0/1698650925 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0309a0 con 0x7fdf700b0010 2023-10-16T08:51:15.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.771+0000 7fdf74891640 1 -- 172.21.15.94:0/1698650925 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c030d30 con 0x7fdf700b0010 2023-10-16T08:51:15.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 -- 172.21.15.94:0/1698650925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf700b0010 msgr2=0x7fdf700701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 --2- 172.21.15.94:0/1698650925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf700b0010 0x7fdf700701a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009870 tx=0x7fdf6c02b980 comp rx=0 tx=0).stop 2023-10-16T08:51:15.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 -- 172.21.15.94:0/1698650925 shutdown_connections 2023-10-16T08:51:15.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 --2- 172.21.15.94:0/1698650925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf7015f040 0x7fdf7015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 --2- 172.21.15.94:0/1698650925 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf700b0010 0x7fdf700701a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 -- 172.21.15.94:0/1698650925 >> 172.21.15.94:0/1698650925 conn(0x7fdf7006c1c0 msgr2=0x7fdf7006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:15.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 -- 172.21.15.94:0/1698650925 shutdown_connections 2023-10-16T08:51:15.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.772+0000 7fdf77af7640 1 -- 172.21.15.94:0/1698650925 wait complete. 2023-10-16T08:51:15.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.774+0000 7fdf77af7640 1 Processor -- start 2023-10-16T08:51:15.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.774+0000 7fdf77af7640 1 -- start start 2023-10-16T08:51:15.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf77af7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf700b0010 0x7fdf70154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf77af7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 0x7fdf70155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf77af7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf7015f040 0x7fdf700b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf77af7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700abbb0 con 0x7fdf7015ad00 2023-10-16T08:51:15.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf77af7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700ab860 con 0x7fdf7015f040 2023-10-16T08:51:15.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf77af7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700b1720 con 0x7fdf700b0010 2023-10-16T08:51:15.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf75092640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 0x7fdf70155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf75092640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 0x7fdf70155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58586/0 (socket says 172.21.15.94:58586) 2023-10-16T08:51:15.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf75092640 1 -- 172.21.15.94:0/4231199015 learned_addr learned my addr 172.21.15.94:0/4231199015 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:15.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf75893640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf700b0010 0x7fdf70154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.775+0000 7fdf75092640 1 -- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf700b0010 msgr2=0x7fdf70154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf75092640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf700b0010 0x7fdf70154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf76094640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf7015f040 0x7fdf700b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf75092640 1 -- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf7015f040 msgr2=0x7fdf700b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf75092640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf7015f040 0x7fdf700b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf75092640 1 -- 172.21.15.94:0/4231199015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0094d0 con 0x7fdf7015ad00 2023-10-16T08:51:15.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf75893640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf700b0010 0x7fdf70154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:15.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf75092640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 0x7fdf70155a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c480 tx=0x7fdf6000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:15.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60007480 con 0x7fdf7015ad00 2023-10-16T08:51:15.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf600075e0 con 0x7fdf7015ad00 2023-10-16T08:51:15.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf700b1a00 con 0x7fdf7015ad00 2023-10-16T08:51:15.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60004a00 con 0x7fdf7015ad00 2023-10-16T08:51:15.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.776+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70154b40 con 0x7fdf7015ad00 2023-10-16T08:51:15.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.777+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700abcf0 con 0x7fdf7015ad00 2023-10-16T08:51:15.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.778+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf60004b60 con 0x7fdf7015ad00 2023-10-16T08:51:15.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.780+0000 7fdf667fc640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdf5406ae70 0x7fdf5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:15.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.780+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf60088500 con 0x7fdf7015ad00 2023-10-16T08:51:15.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.780+0000 7fdf75893640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdf5406ae70 0x7fdf5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:15.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.781+0000 7fdf75893640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdf5406ae70 0x7fdf5406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c036000 tx=0x7fdf6c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:15.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.784+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf700abcf0 con 0x7fdf7015ad00 2023-10-16T08:51:15.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.975+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf700abcf0 con 0x7fdf7015ad00 2023-10-16T08:51:15.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.977+0000 7fdf667fc640 1 -- 172.21.15.94:0/4231199015 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fdf700abcf0 con 0x7fdf7015ad00 2023-10-16T08:51:15.979 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:15.980 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:10.289687+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdf5406ae70 msgr2=0x7fdf5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdf5406ae70 0x7fdf5406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c036000 tx=0x7fdf6c03b040 comp rx=0 tx=0).stop 2023-10-16T08:51:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 msgr2=0x7fdf70155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 0x7fdf70155a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c480 tx=0x7fdf6000c940 comp rx=0 tx=0).stop 2023-10-16T08:51:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 shutdown_connections 2023-10-16T08:51:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdf5406ae70 0x7fdf5406d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf7015f040 0x7fdf700b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf7015ad00 0x7fdf70155a60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 --2- 172.21.15.94:0/4231199015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf700b0010 0x7fdf70154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:15.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 >> 172.21.15.94:0/4231199015 conn(0x7fdf7006c1c0 msgr2=0x7fdf700ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:15.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 shutdown_connections 2023-10-16T08:51:15.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:15.980+0000 7fdf77af7640 1 -- 172.21.15.94:0/4231199015 wait complete. 2023-10-16T08:51:16.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T08:51:16.002 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:51:16.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.210+0000 7fad5354c640 1 Processor -- start 2023-10-16T08:51:16.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.211+0000 7fad5354c640 1 -- start start 2023-10-16T08:51:16.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad5354c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fad4c15cbc0 0x7fad4c0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad5354c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c0b02e0 0x7fad4c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad5354c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fad4c06b100 0x7fad4c0af790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad5354c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c0d16c0 con 0x7fad4c15cbc0 2023-10-16T08:51:16.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad5354c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c0aedc0 con 0x7fad4c06b100 2023-10-16T08:51:16.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad5354c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0cfe70 con 0x7fad4c0b02e0 2023-10-16T08:51:16.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad512e8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fad4c15cbc0 0x7fad4c0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad512e8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fad4c15cbc0 0x7fad4c0afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58596/0 (socket says 172.21.15.94:58596) 2023-10-16T08:51:16.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.212+0000 7fad512e8640 1 -- 172.21.15.94:0/549235060 learned_addr learned my addr 172.21.15.94:0/549235060 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:16.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.213+0000 7fad512e8640 1 -- 172.21.15.94:0/549235060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c0b02e0 msgr2=0x7fad4c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:16.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.213+0000 7fad512e8640 1 --2- 172.21.15.94:0/549235060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c0b02e0 0x7fad4c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.213+0000 7fad512e8640 1 -- 172.21.15.94:0/549235060 >> v2:172.21.15.130:3300/0 conn(0x7fad4c06b100 msgr2=0x7fad4c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:16.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.213+0000 7fad512e8640 1 --2- 172.21.15.94:0/549235060 >> v2:172.21.15.130:3300/0 conn(0x7fad4c06b100 0x7fad4c0af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.213+0000 7fad512e8640 1 -- 172.21.15.94:0/549235060 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c0ae490 con 0x7fad4c15cbc0 2023-10-16T08:51:16.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.214+0000 7fad512e8640 1 --2- 172.21.15.94:0/549235060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c15cbc0 0x7fad4c0afda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0719d0 tx=0x7fad3c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e603e69afc25b7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:16.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.214+0000 7fad43fff640 1 -- 172.21.15.94:0/549235060 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c031860 con 0x7fad4c15cbc0 2023-10-16T08:51:16.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.214+0000 7fad43fff640 1 -- 172.21.15.94:0/549235060 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0319c0 con 0x7fad4c15cbc0 2023-10-16T08:51:16.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.214+0000 7fad43fff640 1 -- 172.21.15.94:0/549235060 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c031d50 con 0x7fad4c15cbc0 2023-10-16T08:51:16.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 -- 172.21.15.94:0/549235060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c15cbc0 msgr2=0x7fad4c0afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 --2- 172.21.15.94:0/549235060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c15cbc0 0x7fad4c0afda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0719d0 tx=0x7fad3c02b900 comp rx=0 tx=0).stop 2023-10-16T08:51:16.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 -- 172.21.15.94:0/549235060 shutdown_connections 2023-10-16T08:51:16.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 --2- 172.21.15.94:0/549235060 >> v2:172.21.15.130:3300/0 conn(0x7fad4c06b100 0x7fad4c0af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 --2- 172.21.15.94:0/549235060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c0b02e0 0x7fad4c0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 --2- 172.21.15.94:0/549235060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c15cbc0 0x7fad4c0afda0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 -- 172.21.15.94:0/549235060 >> 172.21.15.94:0/549235060 conn(0x7fad4c0d0820 msgr2=0x7fad4c0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:16.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 -- 172.21.15.94:0/549235060 shutdown_connections 2023-10-16T08:51:16.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.215+0000 7fad5354c640 1 -- 172.21.15.94:0/549235060 wait complete. 2023-10-16T08:51:16.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.216+0000 7fad5354c640 1 Processor -- start 2023-10-16T08:51:16.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.217+0000 7fad5354c640 1 -- start start 2023-10-16T08:51:16.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.217+0000 7fad5354c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c06b100 0x7fad4c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.217+0000 7fad5354c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 0x7fad4c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.217+0000 7fad5354c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c15cbc0 0x7fad4c0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad5354c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c151570 con 0x7fad4c0b02e0 2023-10-16T08:51:16.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad5354c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c155260 con 0x7fad4c06b100 2023-10-16T08:51:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad5354c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c155540 con 0x7fad4c15cbc0 2023-10-16T08:51:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 0x7fad4c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 0x7fad4c1f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58600/0 (socket says 172.21.15.94:58600) 2023-10-16T08:51:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 -- 172.21.15.94:0/2063512244 learned_addr learned my addr 172.21.15.94:0/2063512244 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad512e8640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c06b100 0x7fad4c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 -- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c15cbc0 msgr2=0x7fad4c0c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c15cbc0 0x7fad4c0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 -- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c06b100 msgr2=0x7fad4c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c06b100 0x7fad4c154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 -- 172.21.15.94:0/2063512244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0094d0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.218+0000 7fad50ae7640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 0x7fad4c1f1f90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b450 tx=0x7fad4800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:16.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.219+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011890 con 0x7fad4c0b02e0 2023-10-16T08:51:16.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.219+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad480119f0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.219+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011da0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.219+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c155820 con 0x7fad4c0b02e0 2023-10-16T08:51:16.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.219+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c155de0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.220+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c155fd0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.221+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad4801a400 con 0x7fad4c0b02e0 2023-10-16T08:51:16.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.222+0000 7fad41ffb640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fad3806ae70 0x7fad3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.222+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad480896a0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.222+0000 7fad512e8640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fad3806ae70 0x7fad3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.223+0000 7fad512e8640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fad3806ae70 0x7fad3806d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad3c036000 tx=0x7fad3c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:16.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.227+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad48054a90 con 0x7fad4c0b02e0 2023-10-16T08:51:16.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.416+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad4c073ef0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.416+0000 7fad41ffb640 1 -- 172.21.15.94:0/2063512244 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad480150a0 con 0x7fad4c0b02e0 2023-10-16T08:51:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:51:16.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fad3806ae70 msgr2=0x7fad3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fad3806ae70 0x7fad3806d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad3c036000 tx=0x7fad3c03c040 comp rx=0 tx=0).stop 2023-10-16T08:51:16.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 msgr2=0x7fad4c1f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 0x7fad4c1f1f90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b450 tx=0x7fad4800b910 comp rx=0 tx=0).stop 2023-10-16T08:51:16.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 shutdown_connections 2023-10-16T08:51:16.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad4c15cbc0 0x7fad4c0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad4c0b02e0 0x7fad4c1f1f90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fad3806ae70 0x7fad3806d330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 --2- 172.21.15.94:0/2063512244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c06b100 0x7fad4c154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 >> 172.21.15.94:0/2063512244 conn(0x7fad4c0d0820 msgr2=0x7fad4c158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:16.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 shutdown_connections 2023-10-16T08:51:16.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.419+0000 7fad5354c640 1 -- 172.21.15.94:0/2063512244 wait complete. 2023-10-16T08:51:16.438 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T08:51:16.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.647+0000 7feee597c640 1 Processor -- start 2023-10-16T08:51:16.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.647+0000 7feee597c640 1 -- start start 2023-10-16T08:51:16.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.649+0000 7feee597c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.649+0000 7feee597c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feee0071cd0 0x7feee0165780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.649+0000 7feee597c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feee00c1b80 0x7feee00b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.649+0000 7feee597c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee0070630 con 0x7feee0071cd0 2023-10-16T08:51:16.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.649+0000 7feee597c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee0165cc0 con 0x7feee00c1b80 2023-10-16T08:51:16.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.649+0000 7feee597c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee00cbdf0 con 0x7feee00c17a0 2023-10-16T08:51:16.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feee0071cd0 0x7feee0165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feee0071cd0 0x7feee0165780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58612/0 (socket says 172.21.15.94:58612) 2023-10-16T08:51:16.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 -- 172.21.15.94:0/3068284640 learned_addr learned my addr 172.21.15.94:0/3068284640 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:16.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feedf7fe640 1 --2- 172.21.15.94:0/3068284640 >> v2:172.21.15.130:3300/0 conn(0x7feee00c1b80 0x7feee00b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feedeffd640 1 --2- 172.21.15.94:0/3068284640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 -- 172.21.15.94:0/3068284640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 msgr2=0x7feee00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:16.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 --2- 172.21.15.94:0/3068284640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 -- 172.21.15.94:0/3068284640 >> v2:172.21.15.130:3300/0 conn(0x7feee00c1b80 msgr2=0x7feee00b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:16.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 --2- 172.21.15.94:0/3068284640 >> v2:172.21.15.130:3300/0 conn(0x7feee00c1b80 0x7feee00b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.650+0000 7feed67fc640 1 -- 172.21.15.94:0/3068284640 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00cb1e0 con 0x7feee0071cd0 2023-10-16T08:51:16.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.651+0000 7feed67fc640 1 --2- 172.21.15.94:0/3068284640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee0071cd0 0x7feee0165780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feee0164cd0 tx=0x7feec802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75f1220a7c5f06b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:16.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.652+0000 7feede7fc640 1 -- 172.21.15.94:0/3068284640 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8030850 con 0x7feee0071cd0 2023-10-16T08:51:16.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.652+0000 7feede7fc640 1 -- 172.21.15.94:0/3068284640 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec80309b0 con 0x7feee0071cd0 2023-10-16T08:51:16.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.652+0000 7feede7fc640 1 -- 172.21.15.94:0/3068284640 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8030d40 con 0x7feee0071cd0 2023-10-16T08:51:16.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.652+0000 7feee597c640 1 -- 172.21.15.94:0/3068284640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee0071cd0 msgr2=0x7feee0165780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.652+0000 7feee597c640 1 --2- 172.21.15.94:0/3068284640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee0071cd0 0x7feee0165780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feee0164cd0 tx=0x7feec802b990 comp rx=0 tx=0).stop 2023-10-16T08:51:16.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 -- 172.21.15.94:0/3068284640 shutdown_connections 2023-10-16T08:51:16.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 --2- 172.21.15.94:0/3068284640 >> v2:172.21.15.130:3300/0 conn(0x7feee00c1b80 0x7feee00b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 --2- 172.21.15.94:0/3068284640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee0071cd0 0x7feee0165780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 --2- 172.21.15.94:0/3068284640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 -- 172.21.15.94:0/3068284640 >> 172.21.15.94:0/3068284640 conn(0x7feee006c1c0 msgr2=0x7feee006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:16.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 -- 172.21.15.94:0/3068284640 shutdown_connections 2023-10-16T08:51:16.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.653+0000 7feee597c640 1 -- 172.21.15.94:0/3068284640 wait complete. 2023-10-16T08:51:16.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.654+0000 7feee597c640 1 Processor -- start 2023-10-16T08:51:16.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.655+0000 7feee597c640 1 -- start start 2023-10-16T08:51:16.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.655+0000 7feee597c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feee0071cd0 0x7feee00b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.655+0000 7feee597c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feee597c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 0x7feee00c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feee597c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00b22b0 con 0x7feee00c1b80 2023-10-16T08:51:16.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feee597c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee015b810 con 0x7feee0071cd0 2023-10-16T08:51:16.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feee597c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee015b530 con 0x7feee00c17a0 2023-10-16T08:51:16.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 0x7feee00c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 0x7feee00c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58616/0 (socket says 172.21.15.94:58616) 2023-10-16T08:51:16.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 -- 172.21.15.94:0/3182701538 learned_addr learned my addr 172.21.15.94:0/3182701538 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:16.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feed67fc640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedeffd640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feee0071cd0 0x7feee00b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 -- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 msgr2=0x7feee00c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 -- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feee0071cd0 msgr2=0x7feee00b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feee0071cd0 0x7feee00b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.656+0000 7feedf7fe640 1 -- 172.21.15.94:0/3182701538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80094d0 con 0x7feee00c1b80 2023-10-16T08:51:16.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.657+0000 7feedf7fe640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 0x7feee00c2500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feed8007e30 tx=0x7feed800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:16.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.657+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8014620 con 0x7feee00c1b80 2023-10-16T08:51:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.657+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800ee90 con 0x7feee00c1b80 2023-10-16T08:51:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.657+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80149c0 con 0x7feee00c1b80 2023-10-16T08:51:16.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.657+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee00b1c60 con 0x7feee00c1b80 2023-10-16T08:51:16.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.657+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee00c2a40 con 0x7feee00c1b80 2023-10-16T08:51:16.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.659+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee00b2420 con 0x7feee00c1b80 2023-10-16T08:51:16.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.659+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feed8014b20 con 0x7feee00c1b80 2023-10-16T08:51:16.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.660+0000 7feedcff9640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feec406aea0 0x7feec406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:16.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.660+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feed8089cb0 con 0x7feee00c1b80 2023-10-16T08:51:16.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.660+0000 7feedeffd640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feec406aea0 0x7feec406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.661+0000 7feedeffd640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feec406aea0 0x7feec406d360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feed0006fd0 tx=0x7feed0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:16.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.665+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feed8055020 con 0x7feee00c1b80 2023-10-16T08:51:16.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.856+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feee0073ef0 con 0x7feee00c1b80 2023-10-16T08:51:16.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.857+0000 7feedcff9640 1 -- 172.21.15.94:0/3182701538 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7feed8058640 con 0x7feee00c1b80 2023-10-16T08:51:16.859 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:16.859 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2023-10-16T08:51:16.859 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:51:16.859 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2023-10-16T08:51:16.860 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2023-10-16T08:51:16.860 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:51:16.860 INFO:teuthology.orchestra.run.smithi094.stdout:] 2023-10-16T08:51:16.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feec406aea0 msgr2=0x7feec406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feec406aea0 0x7feec406d360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feed0006fd0 tx=0x7feed0008040 comp rx=0 tx=0).stop 2023-10-16T08:51:16.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 msgr2=0x7feee00c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:16.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 0x7feee00c2500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feed8007e30 tx=0x7feed800e4b0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 shutdown_connections 2023-10-16T08:51:16.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee00c1b80 0x7feee00c2500 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feee00c17a0 0x7feee00c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feec406aea0 0x7feec406d360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 --2- 172.21.15.94:0/3182701538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feee0071cd0 0x7feee00b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:16.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.859+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 >> 172.21.15.94:0/3182701538 conn(0x7feee006c1c0 msgr2=0x7feee015f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:16.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.860+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 shutdown_connections 2023-10-16T08:51:16.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:16.860+0000 7feee597c640 1 -- 172.21.15.94:0/3182701538 wait complete. 2023-10-16T08:51:16.881 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T08:51:16.882 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T08:51:17.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.103+0000 7fb28d99e640 1 Processor -- start 2023-10-16T08:51:17.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.104+0000 7fb28d99e640 1 -- start start 2023-10-16T08:51:17.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.105+0000 7fb28d99e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb288157340 0x7fb28815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.105+0000 7fb28d99e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb2880cd8a0 0x7fb288159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.105+0000 7fb28d99e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28815e250 con 0x7fb2880cd410 2023-10-16T08:51:17.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.105+0000 7fb28d99e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880ce390 con 0x7fb288157340 2023-10-16T08:51:17.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.105+0000 7fb28d99e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880cddd0 con 0x7fb2880cd8a0 2023-10-16T08:51:17.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb288157340 0x7fb28815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb288157340 0x7fb28815dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58622/0 (socket says 172.21.15.94:58622) 2023-10-16T08:51:17.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 -- 172.21.15.94:0/3476161457 learned_addr learned my addr 172.21.15.94:0/3476161457 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:17.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb2877fe640 1 --2- 172.21.15.94:0/3476161457 >> v2:172.21.15.130:3300/0 conn(0x7fb2880cd8a0 0x7fb288159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 -- 172.21.15.94:0/3476161457 >> v2:172.21.15.130:3300/0 conn(0x7fb2880cd8a0 msgr2=0x7fb288159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:17.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 --2- 172.21.15.94:0/3476161457 >> v2:172.21.15.130:3300/0 conn(0x7fb2880cd8a0 0x7fb288159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 -- 172.21.15.94:0/3476161457 >> v1:172.21.15.130:6789/0 conn(0x7fb2880cd410 legacy=0x7fb2880cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:17.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.106+0000 7fb286ffd640 1 -- 172.21.15.94:0/3476161457 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880ce0b0 con 0x7fb288157340 2023-10-16T08:51:17.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.107+0000 7fb286ffd640 1 --2- 172.21.15.94:0/3476161457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb288157340 0x7fb28815dd10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2880cbdc0 tx=0x7fb27802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146051f92dca7387 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:17.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb2867fc640 1 -- 172.21.15.94:0/3476161457 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780317e0 con 0x7fb288157340 2023-10-16T08:51:17.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb2867fc640 1 -- 172.21.15.94:0/3476161457 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb278031940 con 0x7fb288157340 2023-10-16T08:51:17.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb2867fc640 1 -- 172.21.15.94:0/3476161457 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278031cd0 con 0x7fb288157340 2023-10-16T08:51:17.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 -- 172.21.15.94:0/3476161457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb288157340 msgr2=0x7fb28815dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3476161457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb288157340 0x7fb28815dd10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2880cbdc0 tx=0x7fb27802b880 comp rx=0 tx=0).stop 2023-10-16T08:51:17.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 -- 172.21.15.94:0/3476161457 shutdown_connections 2023-10-16T08:51:17.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3476161457 >> v2:172.21.15.130:3300/0 conn(0x7fb2880cd8a0 0x7fb288159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3476161457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb288157340 0x7fb28815dd10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 -- 172.21.15.94:0/3476161457 >> 172.21.15.94:0/3476161457 conn(0x7fb28806c190 msgr2=0x7fb28806c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:17.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.108+0000 7fb28d99e640 1 -- 172.21.15.94:0/3476161457 shutdown_connections 2023-10-16T08:51:17.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.109+0000 7fb28d99e640 1 -- 172.21.15.94:0/3476161457 wait complete. 2023-10-16T08:51:17.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.111+0000 7fb28d99e640 1 Processor -- start 2023-10-16T08:51:17.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.111+0000 7fb28d99e640 1 -- start start 2023-10-16T08:51:17.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb28d99e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 0x7fb2880ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb28d99e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2880cd8a0 0x7fb28815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb28d99e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb288157340 0x7fb28815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb28d99e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb288156330 con 0x7fb2880cd410 2023-10-16T08:51:17.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb28d99e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb288156610 con 0x7fb2880cd8a0 2023-10-16T08:51:17.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb28d99e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2881568f0 con 0x7fb288157340 2023-10-16T08:51:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 0x7fb2880ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 0x7fb2880ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58624/0 (socket says 172.21.15.94:58624) 2023-10-16T08:51:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 -- 172.21.15.94:0/3253825146 learned_addr learned my addr 172.21.15.94:0/3253825146 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 -- 172.21.15.94:0/3253825146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb288157340 msgr2=0x7fb28815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb288157340 0x7fb28815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 -- 172.21.15.94:0/3253825146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2880cd8a0 msgr2=0x7fb28815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2880cd8a0 0x7fb28815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.112+0000 7fb286ffd640 1 -- 172.21.15.94:0/3253825146 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2780094d0 con 0x7fb2880cd410 2023-10-16T08:51:17.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.113+0000 7fb286ffd640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 0x7fb2880ad2e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb278000c00 tx=0x7fb2780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:17.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.113+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278032880 con 0x7fb2880cd410 2023-10-16T08:51:17.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.113+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb278032a20 con 0x7fb2880cd410 2023-10-16T08:51:17.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.113+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278032dd0 con 0x7fb2880cd410 2023-10-16T08:51:17.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.113+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb288156bd0 con 0x7fb2880cd410 2023-10-16T08:51:17.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.113+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28814d400 con 0x7fb2880cd410 2023-10-16T08:51:17.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.114+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2881570f0 con 0x7fb2880cd410 2023-10-16T08:51:17.125 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.115+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb27804e450 con 0x7fb2880cd410 2023-10-16T08:51:17.126 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.116+0000 7fb284ff9640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb26806ae70 0x7fb26806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.126 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.116+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2780ab370 con 0x7fb2880cd410 2023-10-16T08:51:17.126 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.117+0000 7fb27e7fc640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb26806ae70 0x7fb26806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.126 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.117+0000 7fb27e7fc640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb26806ae70 0x7fb26806d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb270006fd0 tx=0x7fb270006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:17.127 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.120+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2881570f0 con 0x7fb2880cd410 2023-10-16T08:51:17.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.314+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb2881570f0 con 0x7fb2880cd410 2023-10-16T08:51:17.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.420+0000 7fb284ff9640 1 -- 172.21.15.94:0/3253825146 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb2881570f0 con 0x7fb2880cd410 2023-10-16T08:51:17.422 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2023-10-16T08:51:17.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb26806ae70 msgr2=0x7fb26806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb26806ae70 0x7fb26806d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb270006fd0 tx=0x7fb270006bc0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 msgr2=0x7fb2880ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 0x7fb2880ad2e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb278000c00 tx=0x7fb2780046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 shutdown_connections 2023-10-16T08:51:17.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb288157340 0x7fb28815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb26806ae70 0x7fb26806d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2880cd8a0 0x7fb28815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.423+0000 7fb28d99e640 1 --2- 172.21.15.94:0/3253825146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2880cd410 0x7fb2880ad2e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.424+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 >> 172.21.15.94:0/3253825146 conn(0x7fb28806c190 msgr2=0x7fb288071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.424+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 shutdown_connections 2023-10-16T08:51:17.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.424+0000 7fb28d99e640 1 -- 172.21.15.94:0/3253825146 wait complete. 2023-10-16T08:51:17.452 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-16T08:51:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.652+0000 7f3784955640 1 Processor -- start 2023-10-16T08:51:17.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.653+0000 7f3784955640 1 -- start start 2023-10-16T08:51:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.654+0000 7f3784955640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37800cb9f0 0x7f378015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.654+0000 7f3784955640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015d260 0x7f3780069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.654+0000 7f3784955640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378015d820 con 0x7f378015c940 2023-10-16T08:51:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.654+0000 7f3784955640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378015db00 con 0x7f37800cb9f0 2023-10-16T08:51:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.654+0000 7f3784955640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37801605f0 con 0x7f378015d260 2023-10-16T08:51:17.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.654+0000 7f377dd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37800cb9f0 0x7f378015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377dd9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37800cb9f0 0x7f378015cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58638/0 (socket says 172.21.15.94:58638) 2023-10-16T08:51:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377dd9b640 1 -- 172.21.15.94:0/2920987177 learned_addr learned my addr 172.21.15.94:0/2920987177 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:17.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377dd9b640 1 -- 172.21.15.94:0/2920987177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015d260 msgr2=0x7f3780069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377ed9d640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015d260 0x7f3780069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377d59a640 1 -- 172.21.15.94:0/2920987177 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707507152 0 0) 0x7f378015d820 con 0x7f378015c940 2023-10-16T08:51:17.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377dd9b640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015d260 0x7f3780069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377dd9b640 1 -- 172.21.15.94:0/2920987177 >> v1:172.21.15.94:6789/0 conn(0x7f378015c940 legacy=0x7f3780160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377dd9b640 1 -- 172.21.15.94:0/2920987177 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37801608d0 con 0x7f37800cb9f0 2023-10-16T08:51:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.655+0000 7f377ed9d640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015d260 0x7f3780069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:17.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.656+0000 7f377dd9b640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37800cb9f0 0x7f378015cd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3768009870 tx=0x7f376802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a43b0ea3b1a8679 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.656+0000 7f377d59a640 1 -- 172.21.15.94:0/2920987177 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680317c0 con 0x7f37800cb9f0 2023-10-16T08:51:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f377d59a640 1 -- 172.21.15.94:0/2920987177 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768031920 con 0x7f37800cb9f0 2023-10-16T08:51:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f377d59a640 1 -- 172.21.15.94:0/2920987177 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768031cb0 con 0x7f37800cb9f0 2023-10-16T08:51:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f3784955640 1 -- 172.21.15.94:0/2920987177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37800cb9f0 msgr2=0x7f378015cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f3784955640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37800cb9f0 0x7f378015cd20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3768009870 tx=0x7f376802b860 comp rx=0 tx=0).stop 2023-10-16T08:51:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f3784955640 1 -- 172.21.15.94:0/2920987177 shutdown_connections 2023-10-16T08:51:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f3784955640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015d260 0x7f3780069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f3784955640 1 --2- 172.21.15.94:0/2920987177 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37800cb9f0 0x7f378015cd20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.657+0000 7f3784955640 1 -- 172.21.15.94:0/2920987177 >> 172.21.15.94:0/2920987177 conn(0x7f378006d600 msgr2=0x7f378006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:17.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.658+0000 7f3784955640 1 -- 172.21.15.94:0/2920987177 shutdown_connections 2023-10-16T08:51:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.658+0000 7f3784955640 1 -- 172.21.15.94:0/2920987177 wait complete. 2023-10-16T08:51:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.659+0000 7f3784955640 1 Processor -- start 2023-10-16T08:51:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 -- start start 2023-10-16T08:51:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37800cb9f0 0x7f3780153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015c940 0x7f37800c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 0x7f37800c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ae2a0 con 0x7f378015d260 2023-10-16T08:51:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ad3f0 con 0x7f37800cb9f0 2023-10-16T08:51:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.660+0000 7f3784955640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3780154500 con 0x7f378015c940 2023-10-16T08:51:17.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 0x7f37800c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 0x7f37800c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58650/0 (socket says 172.21.15.94:58650) 2023-10-16T08:51:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 -- 172.21.15.94:0/3207127040 learned_addr learned my addr 172.21.15.94:0/3207127040 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377dd9b640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015c940 0x7f37800c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377e59c640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37800cb9f0 0x7f3780153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 -- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015c940 msgr2=0x7f37800c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015c940 0x7f37800c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 -- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37800cb9f0 msgr2=0x7f3780153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37800cb9f0 0x7f3780153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 -- 172.21.15.94:0/3207127040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680094d0 con 0x7f378015d260 2023-10-16T08:51:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377e59c640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37800cb9f0 0x7f3780153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:17.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.661+0000 7f377ed9d640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 0x7f37800c5d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f377800c7f0 tx=0x7f377800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:17.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.662+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778007820 con 0x7f378015d260 2023-10-16T08:51:17.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.662+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778007980 con 0x7f378015d260 2023-10-16T08:51:17.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.662+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778007d70 con 0x7f378015d260 2023-10-16T08:51:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.662+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800ad690 con 0x7f378015d260 2023-10-16T08:51:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.662+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800adc50 con 0x7f378015d260 2023-10-16T08:51:17.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.663+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37800ae410 con 0x7f378015d260 2023-10-16T08:51:17.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.665+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3778024480 con 0x7f378015d260 2023-10-16T08:51:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.666+0000 7f3776ffd640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376006aea0 0x7f376006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.666+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3778089b50 con 0x7f378015d260 2023-10-16T08:51:17.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.666+0000 7f377e59c640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376006aea0 0x7f376006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:17.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.667+0000 7f377e59c640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376006aea0 0x7f376006d360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37700012e0 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:17.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.670+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3778089e60 con 0x7f378015d260 2023-10-16T08:51:17.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:17.862+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f3780073ef0 con 0x7f378015d260 2023-10-16T08:51:18.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.426+0000 7f3776ffd640 1 -- 172.21.15.94:0/3207127040 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f377801f0d0 con 0x7f378015d260 2023-10-16T08:51:18.428 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2023-10-16T08:51:18.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376006aea0 msgr2=0x7f376006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:18.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376006aea0 0x7f376006d360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37700012e0 tx=0x7f3770009040 comp rx=0 tx=0).stop 2023-10-16T08:51:18.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 msgr2=0x7f37800c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:18.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 0x7f37800c5d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f377800c7f0 tx=0x7f377800ccb0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 shutdown_connections 2023-10-16T08:51:18.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f378015d260 0x7f37800c5d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f378015c940 0x7f37800c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376006aea0 0x7f376006d360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 --2- 172.21.15.94:0/3207127040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37800cb9f0 0x7f3780153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 >> 172.21.15.94:0/3207127040 conn(0x7f378006d600 msgr2=0x7f37800cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 shutdown_connections 2023-10-16T08:51:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.430+0000 7f3784955640 1 -- 172.21.15.94:0/3207127040 wait complete. 2023-10-16T08:51:18.468 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T08:51:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.653+0000 7f23aead7640 1 Processor -- start 2023-10-16T08:51:18.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.653+0000 7f23aead7640 1 -- start start 2023-10-16T08:51:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.654+0000 7f23aead7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a80cf530 0x7f23a80cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.654+0000 7f23aead7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f23a80aec20 0x7f23a80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.654+0000 7f23aead7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a815b180 con 0x7f23a815ada0 2023-10-16T08:51:18.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.654+0000 7f23aead7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a80cdcc0 con 0x7f23a80aec20 2023-10-16T08:51:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.654+0000 7f23aead7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80ad480 con 0x7f23a80cf530 2023-10-16T08:51:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ac873640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f23a815ada0 0x7f23a80cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:34016/0 (socket says 172.21.15.94:34016) 2023-10-16T08:51:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ac873640 1 -- 172.21.15.94:0/632672062 learned_addr learned my addr 172.21.15.94:0/632672062 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ad074640 1 --2- 172.21.15.94:0/632672062 >> v2:172.21.15.94:3300/0 conn(0x7f23a80aec20 0x7f23a80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:18.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23a7fff640 1 --2- 172.21.15.94:0/632672062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a80cf530 0x7f23a80cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:18.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ad074640 1 -- 172.21.15.94:0/632672062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a80cf530 msgr2=0x7f23a80cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:18.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ad074640 1 --2- 172.21.15.94:0/632672062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a80cf530 0x7f23a80cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ad074640 1 -- 172.21.15.94:0/632672062 >> v1:172.21.15.94:6789/0 conn(0x7f23a815ada0 legacy=0x7f23a80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:18.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.655+0000 7f23ad074640 1 -- 172.21.15.94:0/632672062 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80ce6e0 con 0x7f23a80aec20 2023-10-16T08:51:18.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.656+0000 7f23ad074640 1 --2- 172.21.15.94:0/632672062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80cb9b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097a0 tx=0x7f23a002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6e67520acadf48 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:18.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.656+0000 7f23a77fe640 1 -- 172.21.15.94:0/632672062 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0031780 con 0x7f23a80aec20 2023-10-16T08:51:18.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23a77fe640 1 -- 172.21.15.94:0/632672062 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a00318e0 con 0x7f23a80aec20 2023-10-16T08:51:18.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23a77fe640 1 -- 172.21.15.94:0/632672062 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0031c70 con 0x7f23a80aec20 2023-10-16T08:51:18.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 -- 172.21.15.94:0/632672062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 msgr2=0x7f23a80cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:18.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 --2- 172.21.15.94:0/632672062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80cb9b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097a0 tx=0x7f23a002b820 comp rx=0 tx=0).stop 2023-10-16T08:51:18.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 -- 172.21.15.94:0/632672062 shutdown_connections 2023-10-16T08:51:18.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 --2- 172.21.15.94:0/632672062 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80cb9b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 --2- 172.21.15.94:0/632672062 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a80cf530 0x7f23a80cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 -- 172.21.15.94:0/632672062 >> 172.21.15.94:0/632672062 conn(0x7f23a80d0860 msgr2=0x7f23a80d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:18.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 -- 172.21.15.94:0/632672062 shutdown_connections 2023-10-16T08:51:18.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.657+0000 7f23aead7640 1 -- 172.21.15.94:0/632672062 wait complete. 2023-10-16T08:51:18.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.660+0000 7f23aead7640 1 Processor -- start 2023-10-16T08:51:18.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.660+0000 7f23aead7640 1 -- start start 2023-10-16T08:51:18.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23aead7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:18.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23aead7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a80cf530 0x7f23a80b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:18.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23aead7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a815ada0 0x7f23a80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:18.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23aead7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80c97d0 con 0x7f23a80aec20 2023-10-16T08:51:18.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23aead7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80c6d20 con 0x7f23a80cf530 2023-10-16T08:51:18.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23aead7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80c7000 con 0x7f23a815ada0 2023-10-16T08:51:18.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23ac873640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:18.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23ac873640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58680/0 (socket says 172.21.15.94:58680) 2023-10-16T08:51:18.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.661+0000 7f23ac873640 1 -- 172.21.15.94:0/3211992836 learned_addr learned my addr 172.21.15.94:0/3211992836 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:18.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23a7fff640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a80cf530 0x7f23a80b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:18.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ad074640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a815ada0 0x7f23a80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:18.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ac873640 1 -- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a815ada0 msgr2=0x7f23a80c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:18.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ac873640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a815ada0 0x7f23a80c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ac873640 1 -- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a80cf530 msgr2=0x7f23a80b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:18.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ac873640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a80cf530 0x7f23a80b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:18.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ac873640 1 -- 172.21.15.94:0/3211992836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0009400 con 0x7f23a80aec20 2023-10-16T08:51:18.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ad074640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a815ada0 0x7f23a80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:18.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.662+0000 7f23ac873640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80c36f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f239800c7a0 tx=0x7f239800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:18.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.663+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800a640 con 0x7f23a80aec20 2023-10-16T08:51:18.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.663+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239800a7a0 con 0x7f23a80aec20 2023-10-16T08:51:18.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.663+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a80b66b0 con 0x7f23a80aec20 2023-10-16T08:51:18.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.663+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800ab30 con 0x7f23a80aec20 2023-10-16T08:51:18.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.663+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a80c6940 con 0x7f23a80aec20 2023-10-16T08:51:18.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.664+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a80c9bd0 con 0x7f23a80aec20 2023-10-16T08:51:18.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.665+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f239800ac90 con 0x7f23a80aec20 2023-10-16T08:51:18.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.666+0000 7f23a57fa640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f238806ae70 0x7f238806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:18.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.666+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2398088bb0 con 0x7f23a80aec20 2023-10-16T08:51:18.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.666+0000 7f23a7fff640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f238806ae70 0x7f238806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:18.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.667+0000 7f23a7fff640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f238806ae70 0x7f238806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23a8153080 tx=0x7f2390008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:18.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.671+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23a80c9bd0 con 0x7f23a80aec20 2023-10-16T08:51:18.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:18.894+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f23a80c9bd0 con 0x7f23a80aec20 2023-10-16T08:51:19.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.450+0000 7f23a57fa640 1 -- 172.21.15.94:0/3211992836 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f23a80c9bd0 con 0x7f23a80aec20 2023-10-16T08:51:19.453 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T08:51:19.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.454+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f238806ae70 msgr2=0x7f238806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:19.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.454+0000 7f23aead7640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f238806ae70 0x7f238806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23a8153080 tx=0x7f2390008040 comp rx=0 tx=0).stop 2023-10-16T08:51:19.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.454+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 msgr2=0x7f23a80c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:19.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.454+0000 7f23aead7640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80c36f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f239800c7a0 tx=0x7f239800cc60 comp rx=0 tx=0).stop 2023-10-16T08:51:19.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.455+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 shutdown_connections 2023-10-16T08:51:19.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.455+0000 7f23aead7640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23a815ada0 0x7f23a80c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.455+0000 7f23aead7640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f238806ae70 0x7f238806d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.455+0000 7f23aead7640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a80cf530 0x7f23a80b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.455+0000 7f23aead7640 1 --2- 172.21.15.94:0/3211992836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23a80aec20 0x7f23a80c36f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.455+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 >> 172.21.15.94:0/3211992836 conn(0x7f23a80d0860 msgr2=0x7f23a806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:19.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.456+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 shutdown_connections 2023-10-16T08:51:19.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.457+0000 7f23aead7640 1 -- 172.21.15.94:0/3211992836 wait complete. 2023-10-16T08:51:19.503 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-16T08:51:19.504 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-16T08:51:19.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.679+0000 7efc79010640 1 Processor -- start 2023-10-16T08:51:19.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.679+0000 7efc79010640 1 -- start start 2023-10-16T08:51:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc79010640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc74157340 0x7efc7415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc79010640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc740cd8a0 0x7efc74159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:19.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc79010640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7415e250 con 0x7efc740cd410 2023-10-16T08:51:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc79010640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740ce390 con 0x7efc740cd8a0 2023-10-16T08:51:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc79010640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740cddd0 con 0x7efc74157340 2023-10-16T08:51:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc740cd8a0 0x7efc74159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:19.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7efc740cd8a0 0x7efc74159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58694/0 (socket says 172.21.15.94:58694) 2023-10-16T08:51:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 -- 172.21.15.94:0/424859047 learned_addr learned my addr 172.21.15.94:0/424859047 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 -- 172.21.15.94:0/424859047 >> v2:172.21.15.130:3300/0 conn(0x7efc74157340 msgr2=0x7efc7415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 --2- 172.21.15.94:0/424859047 >> v2:172.21.15.130:3300/0 conn(0x7efc74157340 0x7efc7415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 -- 172.21.15.94:0/424859047 >> v1:172.21.15.130:6789/0 conn(0x7efc740cd410 legacy=0x7efc740cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.681+0000 7efc7359e640 1 -- 172.21.15.94:0/424859047 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740ce0b0 con 0x7efc740cd8a0 2023-10-16T08:51:19.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.682+0000 7efc7359e640 1 --2- 172.21.15.94:0/424859047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd8a0 0x7efc74159d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc7406dbc0 tx=0x7efc6c02e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110f0d2ca217e783 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:19.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc7259c640 1 -- 172.21.15.94:0/424859047 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c02ec00 con 0x7efc740cd8a0 2023-10-16T08:51:19.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc7259c640 1 -- 172.21.15.94:0/424859047 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c02ed60 con 0x7efc740cd8a0 2023-10-16T08:51:19.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc7259c640 1 -- 172.21.15.94:0/424859047 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c036610 con 0x7efc740cd8a0 2023-10-16T08:51:19.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 -- 172.21.15.94:0/424859047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd8a0 msgr2=0x7efc74159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:19.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 --2- 172.21.15.94:0/424859047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd8a0 0x7efc74159d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc7406dbc0 tx=0x7efc6c02e060 comp rx=0 tx=0).stop 2023-10-16T08:51:19.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 -- 172.21.15.94:0/424859047 shutdown_connections 2023-10-16T08:51:19.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 --2- 172.21.15.94:0/424859047 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd8a0 0x7efc74159d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 --2- 172.21.15.94:0/424859047 >> v2:172.21.15.130:3300/0 conn(0x7efc74157340 0x7efc7415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 -- 172.21.15.94:0/424859047 >> 172.21.15.94:0/424859047 conn(0x7efc7406c190 msgr2=0x7efc7406c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:19.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 -- 172.21.15.94:0/424859047 shutdown_connections 2023-10-16T08:51:19.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.683+0000 7efc79010640 1 -- 172.21.15.94:0/424859047 wait complete. 2023-10-16T08:51:19.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.685+0000 7efc79010640 1 Processor -- start 2023-10-16T08:51:19.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.685+0000 7efc79010640 1 -- start start 2023-10-16T08:51:19.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc79010640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 0x7efc740aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:19.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc79010640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740cd8a0 0x7efc74143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:19.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc79010640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc74157340 0x7efc740ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:19.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc79010640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740aef80 con 0x7efc740cd410 2023-10-16T08:51:19.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc79010640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740ae3b0 con 0x7efc740cd8a0 2023-10-16T08:51:19.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc79010640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc740ac6f0 con 0x7efc74157340 2023-10-16T08:51:19.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc72d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 0x7efc740aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:19.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc72d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 0x7efc740aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58710/0 (socket says 172.21.15.94:58710) 2023-10-16T08:51:19.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.686+0000 7efc72d9d640 1 -- 172.21.15.94:0/1207482462 learned_addr learned my addr 172.21.15.94:0/1207482462 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:19.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc6bfff640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740cd8a0 0x7efc74143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:19.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc72d9d640 1 -- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc74157340 msgr2=0x7efc740ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:19.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc72d9d640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc74157340 0x7efc740ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc72d9d640 1 -- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740cd8a0 msgr2=0x7efc74143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:19.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc72d9d640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740cd8a0 0x7efc74143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:19.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc72d9d640 1 -- 172.21.15.94:0/1207482462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009b30 con 0x7efc740cd410 2023-10-16T08:51:19.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc72d9d640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 0x7efc740aca60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc6400b4a0 tx=0x7efc6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:19.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64010610 con 0x7efc740cd410 2023-10-16T08:51:19.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64010770 con 0x7efc740cd410 2023-10-16T08:51:19.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64010b20 con 0x7efc740cd410 2023-10-16T08:51:19.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc740ae650 con 0x7efc740cd410 2023-10-16T08:51:19.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.687+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc740aec10 con 0x7efc740cd410 2023-10-16T08:51:19.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.688+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc74073ef0 con 0x7efc740cd410 2023-10-16T08:51:19.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.689+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc64010c80 con 0x7efc740cd410 2023-10-16T08:51:19.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.690+0000 7efc6b7fe640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7efc5406ae70 0x7efc5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:19.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.690+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc640891f0 con 0x7efc740cd410 2023-10-16T08:51:19.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.690+0000 7efc6bfff640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7efc5406ae70 0x7efc5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:19.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.691+0000 7efc6bfff640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7efc5406ae70 0x7efc5406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc7414b090 tx=0x7efc5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:19.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.695+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc64054330 con 0x7efc740cd410 2023-10-16T08:51:19.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:19.882+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7efc740cd1f0 con 0x7efc740cd410 2023-10-16T08:51:20.409 INFO:tasks.ceph.mds.d.smithi130.stderr:2023-10-16T08:51:20.407+0000 7f71f4ec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T08:51:20.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.472+0000 7efc6b7fe640 1 -- 172.21.15.94:0/1207482462 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7efc64057950 con 0x7efc740cd410 2023-10-16T08:51:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7efc5406ae70 msgr2=0x7efc5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7efc5406ae70 0x7efc5406d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc7414b090 tx=0x7efc5c008040 comp rx=0 tx=0).stop 2023-10-16T08:51:20.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 msgr2=0x7efc740aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:20.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 0x7efc740aca60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc6400b4a0 tx=0x7efc6400b960 comp rx=0 tx=0).stop 2023-10-16T08:51:20.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 shutdown_connections 2023-10-16T08:51:20.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc74157340 0x7efc740ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7efc5406ae70 0x7efc5406d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc740cd8a0 0x7efc74143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 --2- 172.21.15.94:0/1207482462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc740cd410 0x7efc740aca60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.476+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 >> 172.21.15.94:0/1207482462 conn(0x7efc7406c190 msgr2=0x7efc740c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.477+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 shutdown_connections 2023-10-16T08:51:20.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.477+0000 7efc79010640 1 -- 172.21.15.94:0/1207482462 wait complete. 2023-10-16T08:51:20.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T08:51:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.707+0000 7f00bcc96640 1 Processor -- start 2023-10-16T08:51:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.707+0000 7f00bcc96640 1 -- start start 2023-10-16T08:51:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00bcc96640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f00b80ae760 0x7f00b80b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:20.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00bcc96640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b806c640 con 0x7f00b80b3e70 2023-10-16T08:51:20.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00bcc96640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b806c920 con 0x7f00b8159860 2023-10-16T08:51:20.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00bcc96640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b806cc00 con 0x7f00b80ae760 2023-10-16T08:51:20.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00b6d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f00b80ae760 0x7f00b80b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00b6d9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f00b80ae760 0x7f00b80b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58720/0 (socket says 172.21.15.94:58720) 2023-10-16T08:51:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.709+0000 7f00b6d9d640 1 -- 172.21.15.94:0/1709708683 learned_addr learned my addr 172.21.15.94:0/1709708683 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.710+0000 7f00b6d9d640 1 -- 172.21.15.94:0/1709708683 >> v1:172.21.15.130:6789/0 conn(0x7f00b8159860 legacy=0x7f00b806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.710+0000 7f00b6d9d640 1 -- 172.21.15.94:0/1709708683 >> v1:172.21.15.94:6789/0 conn(0x7f00b80b3e70 legacy=0x7f00b80ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.710+0000 7f00b6d9d640 1 -- 172.21.15.94:0/1709708683 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b806cee0 con 0x7f00b80ae760 2023-10-16T08:51:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.710+0000 7f00b5d9b640 1 -- 172.21.15.94:0/1709708683 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245685903 0 0) 0x7f00b806c640 con 0x7f00b80b3e70 2023-10-16T08:51:20.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.711+0000 7f00b6d9d640 1 --2- 172.21.15.94:0/1709708683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80ae760 0x7f00b80b42e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009e50 tx=0x7f00b002e190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dfca6465444ec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:20.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.711+0000 7f00b5d9b640 1 -- 172.21.15.94:0/1709708683 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b002ed30 con 0x7f00b80ae760 2023-10-16T08:51:20.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.711+0000 7f00b5d9b640 1 -- 172.21.15.94:0/1709708683 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b002ee90 con 0x7f00b80ae760 2023-10-16T08:51:20.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.711+0000 7f00b5d9b640 1 -- 172.21.15.94:0/1709708683 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0036610 con 0x7f00b80ae760 2023-10-16T08:51:20.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 -- 172.21.15.94:0/1709708683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80ae760 msgr2=0x7f00b80b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:20.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 --2- 172.21.15.94:0/1709708683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80ae760 0x7f00b80b42e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009e50 tx=0x7f00b002e190 comp rx=0 tx=0).stop 2023-10-16T08:51:20.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 -- 172.21.15.94:0/1709708683 shutdown_connections 2023-10-16T08:51:20.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 --2- 172.21.15.94:0/1709708683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80ae760 0x7f00b80b42e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 -- 172.21.15.94:0/1709708683 >> 172.21.15.94:0/1709708683 conn(0x7f00b806a410 msgr2=0x7f00b80ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:20.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 -- 172.21.15.94:0/1709708683 shutdown_connections 2023-10-16T08:51:20.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.712+0000 7f00bcc96640 1 -- 172.21.15.94:0/1709708683 wait complete. 2023-10-16T08:51:20.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.714+0000 7f00bcc96640 1 Processor -- start 2023-10-16T08:51:20.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.714+0000 7f00bcc96640 1 -- start start 2023-10-16T08:51:20.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00bcc96640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b80ae760 0x7f00b80c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:20.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00bcc96640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 0x7f00b81f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:20.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00bcc96640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8159860 0x7f00b80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:20.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00bcc96640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b81f2550 con 0x7f00b80b3e70 2023-10-16T08:51:20.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00bcc96640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b81f2830 con 0x7f00b80ae760 2023-10-16T08:51:20.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00bcc96640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b81f2b10 con 0x7f00b8159860 2023-10-16T08:51:20.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 0x7f00b81f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:20.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 0x7f00b81f1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58736/0 (socket says 172.21.15.94:58736) 2023-10-16T08:51:20.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 -- 172.21.15.94:0/2171202523 learned_addr learned my addr 172.21.15.94:0/2171202523 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:20.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00b659c640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b80ae760 0x7f00b80c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:20.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00b6d9d640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8159860 0x7f00b80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:20.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 -- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8159860 msgr2=0x7f00b80c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:20.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8159860 0x7f00b80c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 -- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b80ae760 msgr2=0x7f00b80c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:20.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b80ae760 0x7f00b80c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:20.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.715+0000 7f00affff640 1 -- 172.21.15.94:0/2171202523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0009b30 con 0x7f00b80b3e70 2023-10-16T08:51:20.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00b659c640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b80ae760 0x7f00b80c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:20.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00affff640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 0x7f00b81f1c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c4b0 tx=0x7f00a000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:20.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0005480 con 0x7f00b80b3e70 2023-10-16T08:51:20.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a00035f0 con 0x7f00b80b3e70 2023-10-16T08:51:20.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a00039e0 con 0x7f00b80b3e70 2023-10-16T08:51:20.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b81f2df0 con 0x7f00b80b3e70 2023-10-16T08:51:20.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.716+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b81f2150 con 0x7f00b80b3e70 2023-10-16T08:51:20.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.717+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b8159c40 con 0x7f00b80b3e70 2023-10-16T08:51:20.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.718+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f00a0003b40 con 0x7f00b80b3e70 2023-10-16T08:51:20.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.719+0000 7f00aeffd640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f009806ae70 0x7f009806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:20.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.719+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f00a0088cd0 con 0x7f00b80b3e70 2023-10-16T08:51:20.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.719+0000 7f00b659c640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f009806ae70 0x7f009806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:20.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.720+0000 7f00b659c640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f009806ae70 0x7f009806d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00a8003eb0 tx=0x7f00a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:20.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.724+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00b8159c40 con 0x7f00b80b3e70 2023-10-16T08:51:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:20.914+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f00b8159c40 con 0x7f00b80b3e70 2023-10-16T08:51:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.642+0000 7f00aeffd640 1 -- 172.21.15.94:0/2171202523 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f00b8159c40 con 0x7f00b80b3e70 2023-10-16T08:51:22.644 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data_ec' created 2023-10-16T08:51:22.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.647+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f009806ae70 msgr2=0x7f009806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:22.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.647+0000 7f00bcc96640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f009806ae70 0x7f009806d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00a8003eb0 tx=0x7f00a8009040 comp rx=0 tx=0).stop 2023-10-16T08:51:22.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.647+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 msgr2=0x7f00b81f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:22.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.647+0000 7f00bcc96640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 0x7f00b81f1c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c4b0 tx=0x7f00a000c970 comp rx=0 tx=0).stop 2023-10-16T08:51:22.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.648+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 shutdown_connections 2023-10-16T08:51:22.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.648+0000 7f00bcc96640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00b8159860 0x7f00b80c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.648+0000 7f00bcc96640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00b80b3e70 0x7f00b81f1c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.648+0000 7f00bcc96640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f009806ae70 0x7f009806d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.648+0000 7f00bcc96640 1 --2- 172.21.15.94:0/2171202523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00b80ae760 0x7f00b80c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.648+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 >> 172.21.15.94:0/2171202523 conn(0x7f00b806a410 msgr2=0x7f00b806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.649+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 shutdown_connections 2023-10-16T08:51:22.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.649+0000 7f00bcc96640 1 -- 172.21.15.94:0/2171202523 wait complete. 2023-10-16T08:51:22.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-16T08:51:22.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.866+0000 7fbdddf97640 1 Processor -- start 2023-10-16T08:51:22.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.867+0000 7fbdddf97640 1 -- start start 2023-10-16T08:51:22.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdddf97640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbdd80aff50 0x7fbdd80b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:22.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdddf97640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbdd815e440 0x7fbdd80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:22.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdddf97640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80ca190 con 0x7fbdd815ab30 2023-10-16T08:51:22.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdddf97640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80c9660 con 0x7fbdd815e440 2023-10-16T08:51:22.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdddf97640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80b0870 con 0x7fbdd80aff50 2023-10-16T08:51:22.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbdd815e440 0x7fbdd80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:22.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbdd815e440 0x7fbdd80b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58738/0 (socket says 172.21.15.94:58738) 2023-10-16T08:51:22.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 -- 172.21.15.94:0/3522067825 learned_addr learned my addr 172.21.15.94:0/3522067825 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:22.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 -- 172.21.15.94:0/3522067825 >> v2:172.21.15.130:3300/0 conn(0x7fbdd80aff50 msgr2=0x7fbdd80b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:22.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd77fe640 1 --2- 172.21.15.94:0/3522067825 >> v2:172.21.15.130:3300/0 conn(0x7fbdd80aff50 0x7fbdd80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:22.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 --2- 172.21.15.94:0/3522067825 >> v2:172.21.15.130:3300/0 conn(0x7fbdd80aff50 0x7fbdd80b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 -- 172.21.15.94:0/3522067825 >> v1:172.21.15.130:6789/0 conn(0x7fbdd815ab30 legacy=0x7fbdd80c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:22.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.869+0000 7fbdd7fff640 1 -- 172.21.15.94:0/3522067825 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd815ee20 con 0x7fbdd815e440 2023-10-16T08:51:22.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.870+0000 7fbdd7fff640 1 --2- 172.21.15.94:0/3522067825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd815e440 0x7fbdd80b1320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdd815e350 tx=0x7fbdd002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532464caa81a1dea server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:22.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.870+0000 7fbdd6ffd640 1 -- 172.21.15.94:0/3522067825 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd002c9f0 con 0x7fbdd815e440 2023-10-16T08:51:22.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.870+0000 7fbdd6ffd640 1 -- 172.21.15.94:0/3522067825 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd002cb50 con 0x7fbdd815e440 2023-10-16T08:51:22.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.870+0000 7fbdd6ffd640 1 -- 172.21.15.94:0/3522067825 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00343f0 con 0x7fbdd815e440 2023-10-16T08:51:22.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 -- 172.21.15.94:0/3522067825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd815e440 msgr2=0x7fbdd80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:22.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3522067825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd815e440 0x7fbdd80b1320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdd815e350 tx=0x7fbdd002be50 comp rx=0 tx=0).stop 2023-10-16T08:51:22.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 -- 172.21.15.94:0/3522067825 shutdown_connections 2023-10-16T08:51:22.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3522067825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd815e440 0x7fbdd80b1320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3522067825 >> v2:172.21.15.130:3300/0 conn(0x7fbdd80aff50 0x7fbdd80b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 -- 172.21.15.94:0/3522067825 >> 172.21.15.94:0/3522067825 conn(0x7fbdd806c190 msgr2=0x7fbdd806c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:22.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 -- 172.21.15.94:0/3522067825 shutdown_connections 2023-10-16T08:51:22.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.871+0000 7fbdddf97640 1 -- 172.21.15.94:0/3522067825 wait complete. 2023-10-16T08:51:22.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.873+0000 7fbdddf97640 1 Processor -- start 2023-10-16T08:51:22.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.873+0000 7fbdddf97640 1 -- start start 2023-10-16T08:51:22.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdddf97640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 0x7fbdd8157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:22.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdddf97640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdd815ab30 0x7fbdd80b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:22.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdddf97640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdd815e440 0x7fbdd815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:22.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdddf97640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80cc440 con 0x7fbdd80aff50 2023-10-16T08:51:22.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdddf97640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80cc140 con 0x7fbdd815e440 2023-10-16T08:51:22.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdddf97640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8158040 con 0x7fbdd815ab30 2023-10-16T08:51:22.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 0x7fbdd8157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:22.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdd77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 0x7fbdd8157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58744/0 (socket says 172.21.15.94:58744) 2023-10-16T08:51:22.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.874+0000 7fbdd77fe640 1 -- 172.21.15.94:0/3081787083 learned_addr learned my addr 172.21.15.94:0/3081787083 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:22.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd7fff640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdd815e440 0x7fbdd815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd77fe640 1 -- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdd815ab30 msgr2=0x7fbdd80b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd77fe640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdd815ab30 0x7fbdd80b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd77fe640 1 -- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdd815e440 msgr2=0x7fbdd815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd77fe640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdd815e440 0x7fbdd815d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:22.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd77fe640 1 -- 172.21.15.94:0/3081787083 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0009b30 con 0x7fbdd80aff50 2023-10-16T08:51:22.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd77fe640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 0x7fbdd8157b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c7f0 tx=0x7fbdc800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:22.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8004220 con 0x7fbdd80aff50 2023-10-16T08:51:22.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8004380 con 0x7fbdd80aff50 2023-10-16T08:51:22.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd80b3700 con 0x7fbdd80aff50 2023-10-16T08:51:22.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007840 con 0x7fbdd80aff50 2023-10-16T08:51:22.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.875+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd80b3cc0 con 0x7fbdd80aff50 2023-10-16T08:51:22.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.876+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8073ef0 con 0x7fbdd80aff50 2023-10-16T08:51:22.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.877+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbdc8007bb0 con 0x7fbdd80aff50 2023-10-16T08:51:22.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.878+0000 7fbdd4ff9640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbdb806aea0 0x7fbdb806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:22.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.878+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fbdc80898a0 con 0x7fbdd80aff50 2023-10-16T08:51:22.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.878+0000 7fbdcffff640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbdb806aea0 0x7fbdb806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:22.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.879+0000 7fbdcffff640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbdb806aea0 0x7fbdb806d360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80719b0 tx=0x7fbdc0007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:22.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:22.884+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbdc80545e0 con 0x7fbdd80aff50 2023-10-16T08:51:23.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.072+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fbdd80c9250 con 0x7fbdd80aff50 2023-10-16T08:51:23.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.647+0000 7fbdd4ff9640 1 -- 172.21.15.94:0/3081787083 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbdc801e0c0 con 0x7fbdd80aff50 2023-10-16T08:51:23.649 INFO:teuthology.orchestra.run.smithi094.stderr:set pool 4 allow_ec_overwrites to true 2023-10-16T08:51:23.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbdb806aea0 msgr2=0x7fbdb806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:23.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbdb806aea0 0x7fbdb806d360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80719b0 tx=0x7fbdc0007990 comp rx=0 tx=0).stop 2023-10-16T08:51:23.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 msgr2=0x7fbdd8157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:23.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 0x7fbdd8157b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c7f0 tx=0x7fbdc800ccb0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 shutdown_connections 2023-10-16T08:51:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbdb806aea0 0x7fbdb806d360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdd815e440 0x7fbdd815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbdd815ab30 0x7fbdd80b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 --2- 172.21.15.94:0/3081787083 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdd80aff50 0x7fbdd8157b00 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c7f0 tx=0x7fbdc800ccb0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 >> 172.21.15.94:0/3081787083 conn(0x7fbdd806c190 msgr2=0x7fbdd8159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.651+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 shutdown_connections 2023-10-16T08:51:23.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.652+0000 7fbdddf97640 1 -- 172.21.15.94:0/3081787083 wait complete. 2023-10-16T08:51:23.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-16T08:51:23.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.878+0000 7fdd48cc2640 1 Processor -- start 2023-10-16T08:51:23.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.878+0000 7fdd48cc2640 1 -- start start 2023-10-16T08:51:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.879+0000 7fdd48cc2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdd4415a830 0x7fdd440cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd48cc2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdd440ca550 0x7fdd44070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd48cc2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440cf040 con 0x7fdd44070860 2023-10-16T08:51:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd48cc2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd44070cf0 con 0x7fdd440ca550 2023-10-16T08:51:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd48cc2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd440ca9e0 con 0x7fdd4415a830 2023-10-16T08:51:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdd440ca550 0x7fdd44070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdd440ca550 0x7fdd44070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58760/0 (socket says 172.21.15.94:58760) 2023-10-16T08:51:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 -- 172.21.15.94:0/2594597737 learned_addr learned my addr 172.21.15.94:0/2594597737 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd4259c640 1 --2- 172.21.15.94:0/2594597737 >> v2:172.21.15.130:3300/0 conn(0x7fdd4415a830 0x7fdd440cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 -- 172.21.15.94:0/2594597737 >> v2:172.21.15.130:3300/0 conn(0x7fdd4415a830 msgr2=0x7fdd440cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 --2- 172.21.15.94:0/2594597737 >> v2:172.21.15.130:3300/0 conn(0x7fdd4415a830 0x7fdd440cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 -- 172.21.15.94:0/2594597737 >> v1:172.21.15.94:6789/0 conn(0x7fdd44070860 legacy=0x7fdd4415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.880+0000 7fdd39d9b640 1 -- 172.21.15.94:0/2594597737 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440ce430 con 0x7fdd440ca550 2023-10-16T08:51:23.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.881+0000 7fdd39d9b640 1 --2- 172.21.15.94:0/2594597737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440ca550 0x7fdd44070320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd440cf570 tx=0x7fdd2c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1088fc7260c7e336 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:23.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd41d9b640 1 -- 172.21.15.94:0/2594597737 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c030860 con 0x7fdd440ca550 2023-10-16T08:51:23.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd41d9b640 1 -- 172.21.15.94:0/2594597737 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c0309c0 con 0x7fdd440ca550 2023-10-16T08:51:23.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd41d9b640 1 -- 172.21.15.94:0/2594597737 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c030d50 con 0x7fdd440ca550 2023-10-16T08:51:23.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 -- 172.21.15.94:0/2594597737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440ca550 msgr2=0x7fdd44070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:23.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/2594597737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440ca550 0x7fdd44070320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd440cf570 tx=0x7fdd2c02b9a0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 -- 172.21.15.94:0/2594597737 shutdown_connections 2023-10-16T08:51:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/2594597737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440ca550 0x7fdd44070320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/2594597737 >> v2:172.21.15.130:3300/0 conn(0x7fdd4415a830 0x7fdd440cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 -- 172.21.15.94:0/2594597737 >> 172.21.15.94:0/2594597737 conn(0x7fdd440b0030 msgr2=0x7fdd440b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 -- 172.21.15.94:0/2594597737 shutdown_connections 2023-10-16T08:51:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.882+0000 7fdd48cc2640 1 -- 172.21.15.94:0/2594597737 wait complete. 2023-10-16T08:51:23.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.884+0000 7fdd48cc2640 1 Processor -- start 2023-10-16T08:51:23.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.884+0000 7fdd48cc2640 1 -- start start 2023-10-16T08:51:23.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd48cc2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd44070860 0x7fdd44158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:23.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd48cc2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd440ca550 0x7fdd4415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:23.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd48cc2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 0x7fdd440c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:23.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd48cc2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440c7940 con 0x7fdd4415a830 2023-10-16T08:51:23.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd48cc2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440c7c20 con 0x7fdd440ca550 2023-10-16T08:51:23.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd48cc2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440c7f00 con 0x7fdd44070860 2023-10-16T08:51:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd42d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 0x7fdd440c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd42d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 0x7fdd440c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58764/0 (socket says 172.21.15.94:58764) 2023-10-16T08:51:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.885+0000 7fdd42d9d640 1 -- 172.21.15.94:0/1499607707 learned_addr learned my addr 172.21.15.94:0/1499607707 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd4259c640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd44070860 0x7fdd44158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd39d9b640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd440ca550 0x7fdd4415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd42d9d640 1 -- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd44070860 msgr2=0x7fdd44158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd42d9d640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd44070860 0x7fdd44158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd42d9d640 1 -- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd440ca550 msgr2=0x7fdd4415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd42d9d640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd440ca550 0x7fdd4415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd42d9d640 1 -- 172.21.15.94:0/1499607707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0094d0 con 0x7fdd4415a830 2023-10-16T08:51:23.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd39d9b640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd440ca550 0x7fdd4415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:23.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd42d9d640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 0x7fdd440c89e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00c7a0 tx=0x7fdd3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:23.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c003b70 con 0x7fdd4415a830 2023-10-16T08:51:23.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c003cf0 con 0x7fdd4415a830 2023-10-16T08:51:23.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440c81e0 con 0x7fdd4415a830 2023-10-16T08:51:23.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c003ea0 con 0x7fdd4415a830 2023-10-16T08:51:23.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.886+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4415dca0 con 0x7fdd4415a830 2023-10-16T08:51:23.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.887+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd440c8700 con 0x7fdd4415a830 2023-10-16T08:51:23.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.889+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd3c00aa90 con 0x7fdd4415a830 2023-10-16T08:51:23.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.889+0000 7fdd3b7fe640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdd2406ae70 0x7fdd2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:23.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.890+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fdd3c089790 con 0x7fdd4415a830 2023-10-16T08:51:23.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.890+0000 7fdd4259c640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdd2406ae70 0x7fdd2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:23.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.890+0000 7fdd4259c640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdd2406ae70 0x7fdd2406d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdd34006fd0 tx=0x7fdd34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:23.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:23.894+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd440c8700 con 0x7fdd4415a830 2023-10-16T08:51:24.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.119+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fdd440c8700 con 0x7fdd4415a830 2023-10-16T08:51:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.677+0000 7fdd3b7fe640 1 -- 172.21.15.94:0/1499607707 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fdd440c8700 con 0x7fdd4415a830 2023-10-16T08:51:24.679 INFO:teuthology.orchestra.run.smithi094.stderr:added data pool 4 to fsmap 2023-10-16T08:51:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdd2406ae70 msgr2=0x7fdd2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdd2406ae70 0x7fdd2406d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdd34006fd0 tx=0x7fdd34008040 comp rx=0 tx=0).stop 2023-10-16T08:51:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 msgr2=0x7fdd440c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:24.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 0x7fdd440c89e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00c7a0 tx=0x7fdd3c00cc60 comp rx=0 tx=0).stop 2023-10-16T08:51:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 shutdown_connections 2023-10-16T08:51:24.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd4415a830 0x7fdd440c89e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdd2406ae70 0x7fdd2406d330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd440ca550 0x7fdd4415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 --2- 172.21.15.94:0/1499607707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd44070860 0x7fdd44158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 >> 172.21.15.94:0/1499607707 conn(0x7fdd440b0030 msgr2=0x7fdd440b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:24.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.681+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 shutdown_connections 2023-10-16T08:51:24.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.682+0000 7fdd48cc2640 1 -- 172.21.15.94:0/1499607707 wait complete. 2023-10-16T08:51:24.702 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:51:24.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.911+0000 7fc9b41b0640 1 Processor -- start 2023-10-16T08:51:24.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.911+0000 7fc9b41b0640 1 -- start start 2023-10-16T08:51:24.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.912+0000 7fc9b41b0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9ac0c9e00 0x7fc9ac0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:24.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.912+0000 7fc9b41b0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9ac071800 0x7fc9ac0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:24.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.912+0000 7fc9b41b0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac071c10 con 0x7fc9ac0ca1e0 2023-10-16T08:51:24.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.912+0000 7fc9b41b0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac0cde00 con 0x7fc9ac071800 2023-10-16T08:51:24.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.912+0000 7fc9b41b0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac071e40 con 0x7fc9ac0c9e00 2023-10-16T08:51:24.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b174b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc9ac0ca1e0 0x7fc9ac0710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55808/0 (socket says 172.21.15.94:55808) 2023-10-16T08:51:24.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b174b640 1 -- 172.21.15.94:0/1594786969 learned_addr learned my addr 172.21.15.94:0/1594786969 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:24.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b274d640 1 --2- 172.21.15.94:0/1594786969 >> v2:172.21.15.94:3300/0 conn(0x7fc9ac071800 0x7fc9ac0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:24.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b1f4c640 1 --2- 172.21.15.94:0/1594786969 >> v2:172.21.15.130:3300/0 conn(0x7fc9ac0c9e00 0x7fc9ac0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:24.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b0f4a640 1 -- 172.21.15.94:0/1594786969 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765052695 0 0) 0x7fc9ac071c10 con 0x7fc9ac0ca1e0 2023-10-16T08:51:24.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b0f4a640 1 -- 172.21.15.94:0/1594786969 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc998005730 con 0x7fc9ac0ca1e0 2023-10-16T08:51:24.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b274d640 1 -- 172.21.15.94:0/1594786969 >> v2:172.21.15.130:3300/0 conn(0x7fc9ac0c9e00 msgr2=0x7fc9ac0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:24.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b274d640 1 --2- 172.21.15.94:0/1594786969 >> v2:172.21.15.130:3300/0 conn(0x7fc9ac0c9e00 0x7fc9ac0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b274d640 1 -- 172.21.15.94:0/1594786969 >> v1:172.21.15.94:6789/0 conn(0x7fc9ac0ca1e0 legacy=0x7fc9ac0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:24.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.913+0000 7fc9b274d640 1 -- 172.21.15.94:0/1594786969 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac072120 con 0x7fc9ac071800 2023-10-16T08:51:24.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.914+0000 7fc9b274d640 1 --2- 172.21.15.94:0/1594786969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0cca00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ce3b0 tx=0x7fc9a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c20a005935214b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:24.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.914+0000 7fc9b0f4a640 1 -- 172.21.15.94:0/1594786969 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a402cc80 con 0x7fc9ac071800 2023-10-16T08:51:24.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.914+0000 7fc9b0f4a640 1 -- 172.21.15.94:0/1594786969 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a402cde0 con 0x7fc9ac071800 2023-10-16T08:51:24.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.914+0000 7fc9b0f4a640 1 -- 172.21.15.94:0/1594786969 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4034660 con 0x7fc9ac071800 2023-10-16T08:51:24.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 -- 172.21.15.94:0/1594786969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 msgr2=0x7fc9ac0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:24.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/1594786969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0cca00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ce3b0 tx=0x7fc9a402bed0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 -- 172.21.15.94:0/1594786969 shutdown_connections 2023-10-16T08:51:24.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/1594786969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0cca00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/1594786969 >> v2:172.21.15.130:3300/0 conn(0x7fc9ac0c9e00 0x7fc9ac0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 -- 172.21.15.94:0/1594786969 >> 172.21.15.94:0/1594786969 conn(0x7fc9ac06c1c0 msgr2=0x7fc9ac06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:24.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 -- 172.21.15.94:0/1594786969 shutdown_connections 2023-10-16T08:51:24.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.915+0000 7fc9b41b0640 1 -- 172.21.15.94:0/1594786969 wait complete. 2023-10-16T08:51:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.917+0000 7fc9b41b0640 1 Processor -- start 2023-10-16T08:51:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.917+0000 7fc9b41b0640 1 -- start start 2023-10-16T08:51:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b41b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b41b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ac0c9e00 0x7fc9ac1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:24.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b41b0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ac0ca1e0 0x7fc9ac1f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:24.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b41b0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac156380 con 0x7fc9ac071800 2023-10-16T08:51:24.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b41b0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac1565d0 con 0x7fc9ac0c9e00 2023-10-16T08:51:24.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b41b0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac1568b0 con 0x7fc9ac0ca1e0 2023-10-16T08:51:24.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b1f4c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:24.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b1f4c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0a7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33030/0 (socket says 172.21.15.94:33030) 2023-10-16T08:51:24.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.918+0000 7fc9b1f4c640 1 -- 172.21.15.94:0/3585271799 learned_addr learned my addr 172.21.15.94:0/3585271799 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:24.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b274d640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ac0ca1e0 0x7fc9ac1f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:24.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b174b640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ac0c9e00 0x7fc9ac1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:24.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b1f4c640 1 -- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ac0ca1e0 msgr2=0x7fc9ac1f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:24.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b1f4c640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ac0ca1e0 0x7fc9ac1f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b1f4c640 1 -- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ac0c9e00 msgr2=0x7fc9ac1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:24.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b1f4c640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ac0c9e00 0x7fc9ac1f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:24.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b1f4c640 1 -- 172.21.15.94:0/3585271799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009a70 con 0x7fc9ac071800 2023-10-16T08:51:24.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b1f4c640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0a7df0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800d800 tx=0x7fc9a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:24.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800b6c0 con 0x7fc9ac071800 2023-10-16T08:51:24.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a800b820 con 0x7fc9ac071800 2023-10-16T08:51:24.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac156b90 con 0x7fc9ac071800 2023-10-16T08:51:24.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800bbb0 con 0x7fc9ac071800 2023-10-16T08:51:24.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.919+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac0a8330 con 0x7fc9ac071800 2023-10-16T08:51:24.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.921+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac0a84f0 con 0x7fc9ac071800 2023-10-16T08:51:24.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.921+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc9a800bd10 con 0x7fc9ac071800 2023-10-16T08:51:24.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.923+0000 7fc9a27fc640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc99006ae70 0x7fc99006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:24.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.923+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9a8089e60 con 0x7fc9ac071800 2023-10-16T08:51:24.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.923+0000 7fc9b174b640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc99006ae70 0x7fc99006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:24.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.924+0000 7fc9b174b640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc99006ae70 0x7fc99006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac155030 tx=0x7fc99c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:24.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:24.927+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9a8054c20 con 0x7fc9ac071800 2023-10-16T08:51:25.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.155+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9ac073ef0 con 0x7fc9ac071800 2023-10-16T08:51:25.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.156+0000 7fc9a27fc640 1 -- 172.21.15.94:0/3585271799 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fc9a8058240 con 0x7fc9ac071800 2023-10-16T08:51:25.157 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:25.157 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:24.120464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T08:51:25.158 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2023-10-16T08:51:25.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.158+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc99006ae70 msgr2=0x7fc99006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.158+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc99006ae70 0x7fc99006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac155030 tx=0x7fc99c009040 comp rx=0 tx=0).stop 2023-10-16T08:51:25.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.158+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 msgr2=0x7fc9ac0a7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.158+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0a7df0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800d800 tx=0x7fc9a800dcc0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 shutdown_connections 2023-10-16T08:51:25.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ac0ca1e0 0x7fc9ac1f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc99006ae70 0x7fc99006d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ac0c9e00 0x7fc9ac1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 --2- 172.21.15.94:0/3585271799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9ac071800 0x7fc9ac0a7df0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 >> 172.21.15.94:0/3585271799 conn(0x7fc9ac06c1c0 msgr2=0x7fc9ac0aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:25.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 shutdown_connections 2023-10-16T08:51:25.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.159+0000 7fc9b41b0640 1 -- 172.21.15.94:0/3585271799 wait complete. 2023-10-16T08:51:25.179 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:25.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.382+0000 7f1e07fa5640 1 Processor -- start 2023-10-16T08:51:25.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.382+0000 7f1e07fa5640 1 -- start start 2023-10-16T08:51:25.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e07fa5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1e0015ad00 0x7f1e000701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e07fa5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000707f0 con 0x7f1e0015f040 2023-10-16T08:51:25.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e07fa5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e00070ad0 con 0x7f1e000b0010 2023-10-16T08:51:25.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e07fa5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0015b1d0 con 0x7f1e0015ad00 2023-10-16T08:51:25.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e06542640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1e0015f040 0x7f1e0015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55822/0 (socket says 172.21.15.94:55822) 2023-10-16T08:51:25.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e06542640 1 -- 172.21.15.94:0/375810405 learned_addr learned my addr 172.21.15.94:0/375810405 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:25.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840235811 0 0) 0x7f1e000707f0 con 0x7f1e0015f040 2023-10-16T08:51:25.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e05540640 1 --2- 172.21.15.94:0/375810405 >> v2:172.21.15.130:3300/0 conn(0x7f1e0015ad00 0x7f1e000701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.384+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec003520 con 0x7f1e0015f040 2023-10-16T08:51:25.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7208697 0 0) 0x7f1dec003520 con 0x7f1e0015f040 2023-10-16T08:51:25.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 >> v2:172.21.15.130:3300/0 conn(0x7f1e0015ad00 msgr2=0x7f1e000701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:25.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 --2- 172.21.15.94:0/375810405 >> v2:172.21.15.130:3300/0 conn(0x7f1e0015ad00 0x7f1e000701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 >> v1:172.21.15.130:6789/0 conn(0x7f1e000b0010 legacy=0x7f1e000b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0015b4b0 con 0x7f1e0015f040 2023-10-16T08:51:25.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f1df80019f0 con 0x7f1e0015f040 2023-10-16T08:51:25.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 >> v1:172.21.15.94:6789/0 conn(0x7f1e0015f040 legacy=0x7f1e0015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec003a30 0x7f1dec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dec0047c0 0x7f1dec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dec0052a0 0x7f1dec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0015b1d0 con 0x7f1dec0052a0 2023-10-16T08:51:25.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec00c1a0 con 0x7f1dec0047c0 2023-10-16T08:51:25.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec00c360 con 0x7f1dec003a30 2023-10-16T08:51:25.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e05540640 1 --2- 172.21.15.94:0/375810405 >> v2:172.21.15.130:3300/0 conn(0x7f1e0015ad00 0x7f1e000701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:25.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e06542640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dec0052a0 0x7f1dec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e06542640 1 -- 172.21.15.94:0/375810405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec003a30 msgr2=0x7f1dec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:25.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e06542640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec003a30 0x7f1dec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e06542640 1 -- 172.21.15.94:0/375810405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dec0047c0 msgr2=0x7f1dec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:25.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e06542640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dec0047c0 0x7f1dec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.385+0000 7f1e06542640 1 -- 172.21.15.94:0/375810405 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec003520 con 0x7f1dec0052a0 2023-10-16T08:51:25.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.386+0000 7f1e06542640 1 -- 172.21.15.94:0/375810405 reap_dead start 2023-10-16T08:51:25.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.386+0000 7f1e06542640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dec0052a0 0x7f1dec00b980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1df8002230 tx=0x7f1dec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41d9075117e2f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:25.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8034630 con 0x7f1dec0052a0 2023-10-16T08:51:25.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df802f070 con 0x7f1dec0052a0 2023-10-16T08:51:25.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e04d3f640 1 -- 172.21.15.94:0/375810405 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80349d0 con 0x7f1dec0052a0 2023-10-16T08:51:25.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e07fa5640 1 -- 172.21.15.94:0/375810405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dec0052a0 msgr2=0x7f1dec00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dec0052a0 0x7f1dec00b980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1df8002230 tx=0x7f1dec0057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e07fa5640 1 -- 172.21.15.94:0/375810405 shutdown_connections 2023-10-16T08:51:25.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/375810405 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dec0052a0 0x7f1dec00b980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e07fa5640 1 -- 172.21.15.94:0/375810405 >> 172.21.15.94:0/375810405 conn(0x7f1e0006c1c0 msgr2=0x7f1e0006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:25.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.387+0000 7f1e07fa5640 1 -- 172.21.15.94:0/375810405 shutdown_connections 2023-10-16T08:51:25.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.388+0000 7f1e07fa5640 1 -- 172.21.15.94:0/375810405 wait complete. 2023-10-16T08:51:25.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.389+0000 7f1e07fa5640 1 Processor -- start 2023-10-16T08:51:25.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.389+0000 7f1e07fa5640 1 -- start start 2023-10-16T08:51:25.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.390+0000 7f1e07fa5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec0052a0 0x7f1e000c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.390+0000 7f1e07fa5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 0x7f1e000aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.390+0000 7f1e07fa5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e00157840 0x7f1e000abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.390+0000 7f1e07fa5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000c3af0 con 0x7f1e001573e0 2023-10-16T08:51:25.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.390+0000 7f1e07fa5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000c2ee0 con 0x7f1e00157840 2023-10-16T08:51:25.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.390+0000 7f1e07fa5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000c31c0 con 0x7f1dec0052a0 2023-10-16T08:51:25.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 0x7f1e000aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 0x7f1e000aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33044/0 (socket says 172.21.15.94:33044) 2023-10-16T08:51:25.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 -- 172.21.15.94:0/1380961448 learned_addr learned my addr 172.21.15.94:0/1380961448 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:25.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 -- 172.21.15.94:0/1380961448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec0052a0 msgr2=0x7f1e000c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec0052a0 0x7f1e000c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 -- 172.21.15.94:0/1380961448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e00157840 msgr2=0x7f1e000abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e00157840 0x7f1e000abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 -- 172.21.15.94:0/1380961448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000c34a0 con 0x7f1e001573e0 2023-10-16T08:51:25.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1e05540640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 0x7f1e000aba70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df000e5d0 tx=0x7f1df000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:25.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0004230 con 0x7f1e001573e0 2023-10-16T08:51:25.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.391+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0004390 con 0x7f1e001573e0 2023-10-16T08:51:25.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.392+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0003850 con 0x7f1e001573e0 2023-10-16T08:51:25.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.392+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e000c3780 con 0x7f1e001573e0 2023-10-16T08:51:25.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.392+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e000cc8c0 con 0x7f1e001573e0 2023-10-16T08:51:25.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.393+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e00073ef0 con 0x7f1e001573e0 2023-10-16T08:51:25.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.394+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1df00039b0 con 0x7f1e001573e0 2023-10-16T08:51:25.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.394+0000 7f1df67fc640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1de406aea0 0x7f1de406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.395+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1df00893f0 con 0x7f1e001573e0 2023-10-16T08:51:25.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.395+0000 7f1e05d41640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1de406aea0 0x7f1de406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.395+0000 7f1e05d41640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1de406aea0 0x7f1de406d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc000f60 tx=0x7f1dfc0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:25.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.398+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1df0057cd0 con 0x7f1e001573e0 2023-10-16T08:51:25.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.590+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e000ae070 con 0x7f1e001573e0 2023-10-16T08:51:25.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.592+0000 7f1df67fc640 1 -- 172.21.15.94:0/1380961448 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f1df0057860 con 0x7f1e001573e0 2023-10-16T08:51:25.594 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:25.594 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:25.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1de406aea0 msgr2=0x7f1de406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1de406aea0 0x7f1de406d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc000f60 tx=0x7f1dfc0079b0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 msgr2=0x7f1e000aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 0x7f1e000aba70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df000e5d0 tx=0x7f1df000ea90 comp rx=0 tx=0).stop 2023-10-16T08:51:25.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 shutdown_connections 2023-10-16T08:51:25.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1de406aea0 0x7f1de406d360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e00157840 0x7f1e000abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1e001573e0 0x7f1e000aba70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 --2- 172.21.15.94:0/1380961448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1dec0052a0 0x7f1e000c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 >> 172.21.15.94:0/1380961448 conn(0x7f1e0006c1c0 msgr2=0x7f1e0006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:25.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 shutdown_connections 2023-10-16T08:51:25.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.595+0000 7f1e07fa5640 1 -- 172.21.15.94:0/1380961448 wait complete. 2023-10-16T08:51:25.616 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:25.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.833+0000 7ff0ea44b640 1 Processor -- start 2023-10-16T08:51:25.835 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.833+0000 7ff0ea44b640 1 -- start start 2023-10-16T08:51:25.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0ea44b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e40c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0ea44b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff0e4071800 0x7ff0e40cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0ea44b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e4071e40 con 0x7ff0e40ca1e0 2023-10-16T08:51:25.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0ea44b640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e4071c30 con 0x7ff0e4071800 2023-10-16T08:51:25.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0ea44b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40cde00 con 0x7ff0e40c9e00 2023-10-16T08:51:25.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0e89e8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff0e4071800 0x7ff0e40cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0e89e8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff0e4071800 0x7ff0e40cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33056/0 (socket says 172.21.15.94:33056) 2023-10-16T08:51:25.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.835+0000 7ff0e89e8640 1 -- 172.21.15.94:0/1381440883 learned_addr learned my addr 172.21.15.94:0/1381440883 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:25.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.836+0000 7ff0e3fff640 1 --2- 172.21.15.94:0/1381440883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e40c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.836+0000 7ff0e89e8640 1 -- 172.21.15.94:0/1381440883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 msgr2=0x7ff0e40c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:25.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.836+0000 7ff0e89e8640 1 --2- 172.21.15.94:0/1381440883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e40c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.836+0000 7ff0e89e8640 1 -- 172.21.15.94:0/1381440883 >> v1:172.21.15.130:6789/0 conn(0x7ff0e40ca1e0 legacy=0x7ff0e40710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.836+0000 7ff0e89e8640 1 -- 172.21.15.94:0/1381440883 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4072120 con 0x7ff0e4071800 2023-10-16T08:51:25.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.837+0000 7ff0e89e8640 1 --2- 172.21.15.94:0/1381440883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40cca00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009e50 tx=0x7ff0dc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f9ab01dab09192 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:25.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.837+0000 7ff0e2ffd640 1 -- 172.21.15.94:0/1381440883 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc02caf0 con 0x7ff0e4071800 2023-10-16T08:51:25.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.837+0000 7ff0e2ffd640 1 -- 172.21.15.94:0/1381440883 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc02cc50 con 0x7ff0e4071800 2023-10-16T08:51:25.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.837+0000 7ff0e2ffd640 1 -- 172.21.15.94:0/1381440883 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0343f0 con 0x7ff0e4071800 2023-10-16T08:51:25.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 -- 172.21.15.94:0/1381440883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 msgr2=0x7ff0e40cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/1381440883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40cca00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009e50 tx=0x7ff0dc02bf50 comp rx=0 tx=0).stop 2023-10-16T08:51:25.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 -- 172.21.15.94:0/1381440883 shutdown_connections 2023-10-16T08:51:25.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/1381440883 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40cca00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/1381440883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e40c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 -- 172.21.15.94:0/1381440883 >> 172.21.15.94:0/1381440883 conn(0x7ff0e406c1c0 msgr2=0x7ff0e406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:25.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 -- 172.21.15.94:0/1381440883 shutdown_connections 2023-10-16T08:51:25.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.838+0000 7ff0ea44b640 1 -- 172.21.15.94:0/1381440883 wait complete. 2023-10-16T08:51:25.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.840+0000 7ff0ea44b640 1 Processor -- start 2023-10-16T08:51:25.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.840+0000 7ff0ea44b640 1 -- start start 2023-10-16T08:51:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0ea44b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0ea44b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0ea44b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0e40ca1e0 0x7ff0e40accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0ea44b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40b3eb0 con 0x7ff0e4071800 2023-10-16T08:51:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0ea44b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40c5790 con 0x7ff0e40ca1e0 2023-10-16T08:51:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0ea44b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40b3610 con 0x7ff0e40c9e00 2023-10-16T08:51:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33066/0 (socket says 172.21.15.94:33066) 2023-10-16T08:51:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.841+0000 7ff0e3fff640 1 -- 172.21.15.94:0/436731496 learned_addr learned my addr 172.21.15.94:0/436731496 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e3fff640 1 -- 172.21.15.94:0/436731496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 msgr2=0x7ff0e41557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e3fff640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e3fff640 1 -- 172.21.15.94:0/436731496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0e40ca1e0 msgr2=0x7ff0e40accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:25.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e3fff640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0e40ca1e0 0x7ff0e40accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:25.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e3fff640 1 -- 172.21.15.94:0/436731496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009b30 con 0x7ff0e4071800 2023-10-16T08:51:25.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e3fff640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40af9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400d5f0 tx=0x7ff0d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:25.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40125f0 con 0x7ff0e4071800 2023-10-16T08:51:25.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d4012750 con 0x7ff0e4071800 2023-10-16T08:51:25.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4012b00 con 0x7ff0e4071800 2023-10-16T08:51:25.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e40b38f0 con 0x7ff0e4071800 2023-10-16T08:51:25.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.842+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40ad210 con 0x7ff0e4071800 2023-10-16T08:51:25.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.843+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e4073ef0 con 0x7ff0e4071800 2023-10-16T08:51:25.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.844+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff0d4012c60 con 0x7ff0e4071800 2023-10-16T08:51:25.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.845+0000 7ff0e0ff9640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff0d006ae70 0x7ff0d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:25.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.845+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0d4089de0 con 0x7ff0e4071800 2023-10-16T08:51:25.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.846+0000 7ff0e37fe640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff0d006ae70 0x7ff0d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:25.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.846+0000 7ff0e37fe640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff0d006ae70 0x7ff0d006d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8000f60 tx=0x7ff0d80079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:25.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:25.850+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0d4054b90 con 0x7ff0e4071800 2023-10-16T08:51:26.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.040+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0e40cc4b0 con 0x7ff0e4071800 2023-10-16T08:51:26.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.043+0000 7ff0e0ff9640 1 -- 172.21.15.94:0/436731496 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff0d40581b0 con 0x7ff0e4071800 2023-10-16T08:51:26.044 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:26.045 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:26.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.045+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff0d006ae70 msgr2=0x7ff0d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.045+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff0d006ae70 0x7ff0d006d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8000f60 tx=0x7ff0d80079b0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.045+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 msgr2=0x7ff0e40af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.045+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40af9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400d5f0 tx=0x7ff0d400dab0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 shutdown_connections 2023-10-16T08:51:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff0d006ae70 0x7ff0d006d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0e40ca1e0 0x7ff0e40accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0e40c9e00 0x7ff0e41557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 --2- 172.21.15.94:0/436731496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0e4071800 0x7ff0e40af9e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 >> 172.21.15.94:0/436731496 conn(0x7ff0e406c1c0 msgr2=0x7ff0e4157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 shutdown_connections 2023-10-16T08:51:26.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.046+0000 7ff0ea44b640 1 -- 172.21.15.94:0/436731496 wait complete. 2023-10-16T08:51:26.078 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:51:26.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.285+0000 7f74cba7c640 1 Processor -- start 2023-10-16T08:51:26.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.285+0000 7f74cba7c640 1 -- start start 2023-10-16T08:51:26.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.286+0000 7f74cba7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74c40c9e00 0x7f74c40c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.286+0000 7f74cba7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 0x7f74c40710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.286+0000 7f74cba7c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c4071e40 con 0x7f74c4071630 2023-10-16T08:51:26.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.286+0000 7f74cba7c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40cde00 con 0x7f74c40c9e00 2023-10-16T08:51:26.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.286+0000 7f74cba7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4072120 con 0x7f74c40ca1e0 2023-10-16T08:51:26.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74ca019640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f74c4071630 0x7f74c40cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55828/0 (socket says 172.21.15.94:55828) 2023-10-16T08:51:26.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74ca019640 1 -- 172.21.15.94:0/565058840 learned_addr learned my addr 172.21.15.94:0/565058840 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:26.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c9017640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 0x7f74c40710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c9818640 1 --2- 172.21.15.94:0/565058840 >> v2:172.21.15.130:3300/0 conn(0x7f74c40c9e00 0x7f74c40c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248625395 0 0) 0x7f74c4071e40 con 0x7f74c4071630 2023-10-16T08:51:26.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b0003520 con 0x7f74c4071630 2023-10-16T08:51:26.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3300338830 0 0) 0x7f74b0003520 con 0x7f74c4071630 2023-10-16T08:51:26.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 msgr2=0x7f74c40710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:26.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 0x7f74c40710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 >> v2:172.21.15.130:3300/0 conn(0x7f74c40c9e00 msgr2=0x7f74c40c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:26.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 --2- 172.21.15.94:0/565058840 >> v2:172.21.15.130:3300/0 conn(0x7f74c40c9e00 0x7f74c40c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4072400 con 0x7f74c4071630 2023-10-16T08:51:26.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f74bc0019f0 con 0x7f74c4071630 2023-10-16T08:51:26.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.287+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 >> v1:172.21.15.94:6789/0 conn(0x7f74c4071630 legacy=0x7f74c40cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c8816640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b00039e0 0x7f74b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c8816640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00047c0 0x7f74b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c8816640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 0x7f74b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40cde00 con 0x7f74b00039e0 2023-10-16T08:51:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4072120 con 0x7f74b00047c0 2023-10-16T08:51:26.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b000bb30 con 0x7f74c40ca1e0 2023-10-16T08:51:26.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 --2- 172.21.15.94:0/565058840 >> v2:172.21.15.130:3300/0 conn(0x7f74c40c9e00 0x7f74c40c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:26.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b00039e0 0x7f74b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9017640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00047c0 0x7f74b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74ca019640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 0x7f74b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 -- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 msgr2=0x7f74b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c40ca1e0 0x7f74b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 -- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00047c0 msgr2=0x7f74b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00047c0 0x7f74b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.288+0000 7f74c9818640 1 -- 172.21.15.94:0/565058840 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0003520 con 0x7f74b00039e0 2023-10-16T08:51:26.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.289+0000 7f74c9818640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b00039e0 0x7f74b0003e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f74c00098a0 tx=0x7f74b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2301b9780068abe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0037600 con 0x7f74b00039e0 2023-10-16T08:51:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0037760 con 0x7f74b00039e0 2023-10-16T08:51:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74c8816640 1 -- 172.21.15.94:0/565058840 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0037ad0 con 0x7f74b00039e0 2023-10-16T08:51:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74cba7c640 1 -- 172.21.15.94:0/565058840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b00039e0 msgr2=0x7f74b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74cba7c640 1 --2- 172.21.15.94:0/565058840 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74b00039e0 0x7f74b0003e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f74c00098a0 tx=0x7f74b00057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74ca019640 1 -- 172.21.15.94:0/565058840 reap_dead start 2023-10-16T08:51:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74cba7c640 1 -- 172.21.15.94:0/565058840 shutdown_connections 2023-10-16T08:51:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74cba7c640 1 -- 172.21.15.94:0/565058840 >> 172.21.15.94:0/565058840 conn(0x7f74c406c1c0 msgr2=0x7f74c406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.290+0000 7f74cba7c640 1 -- 172.21.15.94:0/565058840 shutdown_connections 2023-10-16T08:51:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.291+0000 7f74cba7c640 1 -- 172.21.15.94:0/565058840 wait complete. 2023-10-16T08:51:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.292+0000 7f74cba7c640 1 Processor -- start 2023-10-16T08:51:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.292+0000 7f74cba7c640 1 -- start start 2023-10-16T08:51:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.293+0000 7f74cba7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00039e0 0x7f74c41556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.293+0000 7f74cba7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c41e63d0 0x7f74c41e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.293+0000 7f74cba7c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 0x7f74c40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.293+0000 7f74cba7c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40c89b0 con 0x7f74c40c8030 2023-10-16T08:51:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.293+0000 7f74cba7c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41f65b0 con 0x7f74b00039e0 2023-10-16T08:51:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.293+0000 7f74cba7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41e6eb0 con 0x7f74c41e63d0 2023-10-16T08:51:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 0x7f74c40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 0x7f74c40c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33086/0 (socket says 172.21.15.94:33086) 2023-10-16T08:51:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 -- 172.21.15.94:0/598884272 learned_addr learned my addr 172.21.15.94:0/598884272 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 -- 172.21.15.94:0/598884272 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c41e63d0 msgr2=0x7f74c41e6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c41e63d0 0x7f74c41e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 -- 172.21.15.94:0/598884272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00039e0 msgr2=0x7f74c41556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00039e0 0x7f74c41556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 -- 172.21.15.94:0/598884272 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c41f57f0 con 0x7f74c40c8030 2023-10-16T08:51:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ca019640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 0x7f74c40c8470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001330 tx=0x7f74bc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.294+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00ea80 con 0x7f74c40c8030 2023-10-16T08:51:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.295+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc00ebe0 con 0x7f74c40c8030 2023-10-16T08:51:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.295+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc013420 con 0x7f74c40c8030 2023-10-16T08:51:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.295+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c41f5ad0 con 0x7f74c40c8030 2023-10-16T08:51:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.295+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41f6090 con 0x7f74c40c8030 2023-10-16T08:51:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.296+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c4073ef0 con 0x7f74c40c8030 2023-10-16T08:51:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.297+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74bc013580 con 0x7f74c40c8030 2023-10-16T08:51:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.297+0000 7f74ba7fc640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74a806ae70 0x7f74a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.298+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74bc089cb0 con 0x7f74c40c8030 2023-10-16T08:51:26.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.298+0000 7f74c9818640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74a806ae70 0x7f74a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.299+0000 7f74c9818640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74a806ae70 0x7f74a806d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74c0036000 tx=0x7f74c0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:26.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.302+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74bc0549d0 con 0x7f74c40c8030 2023-10-16T08:51:26.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.531+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c40ae090 con 0x7f74c40c8030 2023-10-16T08:51:26.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.532+0000 7f74ba7fc640 1 -- 172.21.15.94:0/598884272 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f74bc057ff0 con 0x7f74c40c8030 2023-10-16T08:51:26.533 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:26.534 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:24.120464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T08:51:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2023-10-16T08:51:26.536 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.534+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74a806ae70 msgr2=0x7f74a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.536 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74a806ae70 0x7f74a806d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74c0036000 tx=0x7f74c0030000 comp rx=0 tx=0).stop 2023-10-16T08:51:26.536 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 msgr2=0x7f74c40c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.536 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 0x7f74c40c8470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001330 tx=0x7f74bc007bc0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.537 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 shutdown_connections 2023-10-16T08:51:26.537 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74c40c8030 0x7f74c40c8470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.537 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74c41e63d0 0x7f74c41e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.537 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74a806ae70 0x7f74a806d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.537 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 --2- 172.21.15.94:0/598884272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74b00039e0 0x7f74c41556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 >> 172.21.15.94:0/598884272 conn(0x7f74c406c1c0 msgr2=0x7f74c4158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:26.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 shutdown_connections 2023-10-16T08:51:26.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.535+0000 7f74cba7c640 1 -- 172.21.15.94:0/598884272 wait complete. 2023-10-16T08:51:26.554 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:26.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.765+0000 7fde699e2640 1 Processor -- start 2023-10-16T08:51:26.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.765+0000 7fde699e2640 1 -- start start 2023-10-16T08:51:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde699e2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fde640c20e0 0x7fde640710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde699e2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde64071630 0x7fde640cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde699e2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640c2570 con 0x7fde640c9e00 2023-10-16T08:51:26.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde699e2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640cde00 con 0x7fde64071630 2023-10-16T08:51:26.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde699e2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde64071e40 con 0x7fde640c20e0 2023-10-16T08:51:26.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde64071630 0x7fde640cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde64071630 0x7fde640cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33096/0 (socket says 172.21.15.94:33096) 2023-10-16T08:51:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 -- 172.21.15.94:0/557983 learned_addr learned my addr 172.21.15.94:0/557983 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde5a7fc640 1 --2- 172.21.15.94:0/557983 >> v2:172.21.15.130:3300/0 conn(0x7fde640c20e0 0x7fde640710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 -- 172.21.15.94:0/557983 >> v2:172.21.15.130:3300/0 conn(0x7fde640c20e0 msgr2=0x7fde640710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 --2- 172.21.15.94:0/557983 >> v2:172.21.15.130:3300/0 conn(0x7fde640c20e0 0x7fde640710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 -- 172.21.15.94:0/557983 >> v1:172.21.15.130:6789/0 conn(0x7fde640c9e00 legacy=0x7fde640ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:26.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.767+0000 7fde637fe640 1 -- 172.21.15.94:0/557983 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64072120 con 0x7fde64071630 2023-10-16T08:51:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.768+0000 7fde637fe640 1 --2- 172.21.15.94:0/557983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde640cca00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde640c55f0 tx=0x7fde5c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d670c98933bf0ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.769+0000 7fde627fc640 1 -- 172.21.15.94:0/557983 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c02ca80 con 0x7fde64071630 2023-10-16T08:51:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.769+0000 7fde627fc640 1 -- 172.21.15.94:0/557983 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c02cbe0 con 0x7fde64071630 2023-10-16T08:51:26.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.769+0000 7fde627fc640 1 -- 172.21.15.94:0/557983 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0343f0 con 0x7fde64071630 2023-10-16T08:51:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.769+0000 7fde699e2640 1 -- 172.21.15.94:0/557983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 msgr2=0x7fde640cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.769+0000 7fde699e2640 1 --2- 172.21.15.94:0/557983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde640cca00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde640c55f0 tx=0x7fde5c02bee0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.770+0000 7fde699e2640 1 -- 172.21.15.94:0/557983 shutdown_connections 2023-10-16T08:51:26.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.770+0000 7fde699e2640 1 --2- 172.21.15.94:0/557983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde640cca00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.770+0000 7fde699e2640 1 --2- 172.21.15.94:0/557983 >> v2:172.21.15.130:3300/0 conn(0x7fde640c20e0 0x7fde640710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.770+0000 7fde699e2640 1 -- 172.21.15.94:0/557983 >> 172.21.15.94:0/557983 conn(0x7fde6406c1c0 msgr2=0x7fde6406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:26.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.770+0000 7fde699e2640 1 -- 172.21.15.94:0/557983 shutdown_connections 2023-10-16T08:51:26.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.770+0000 7fde699e2640 1 -- 172.21.15.94:0/557983 wait complete. 2023-10-16T08:51:26.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.771+0000 7fde699e2640 1 Processor -- start 2023-10-16T08:51:26.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.772+0000 7fde699e2640 1 -- start start 2023-10-16T08:51:26.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.772+0000 7fde699e2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde641f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.772+0000 7fde699e2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde640c20e0 0x7fde641f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde699e2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde640c9e00 0x7fde640af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde699e2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde641f2e60 con 0x7fde64071630 2023-10-16T08:51:26.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde699e2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde641f1ce0 con 0x7fde640c9e00 2023-10-16T08:51:26.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde699e2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde641f58c0 con 0x7fde640c20e0 2023-10-16T08:51:26.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde641f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde641f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33100/0 (socket says 172.21.15.94:33100) 2023-10-16T08:51:26.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 -- 172.21.15.94:0/2413871387 learned_addr learned my addr 172.21.15.94:0/2413871387 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 -- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde640c20e0 msgr2=0x7fde641f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde5a7fc640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde640c20e0 0x7fde641f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde637fe640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde640c9e00 0x7fde640af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde640c20e0 0x7fde641f17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 -- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde640c9e00 msgr2=0x7fde640af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde640c9e00 0x7fde640af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.773+0000 7fde62ffd640 1 -- 172.21.15.94:0/2413871387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009b30 con 0x7fde64071630 2023-10-16T08:51:26.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.774+0000 7fde62ffd640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde641f2920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde5400c430 tx=0x7fde5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:26.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.774+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011790 con 0x7fde64071630 2023-10-16T08:51:26.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.774+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde540118f0 con 0x7fde64071630 2023-10-16T08:51:26.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.774+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011ce0 con 0x7fde64071630 2023-10-16T08:51:26.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.774+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde641f5ba0 con 0x7fde64071630 2023-10-16T08:51:26.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.774+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde641f6160 con 0x7fde64071630 2023-10-16T08:51:26.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.775+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde64073ef0 con 0x7fde64071630 2023-10-16T08:51:26.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.776+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde5401c460 con 0x7fde64071630 2023-10-16T08:51:26.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.777+0000 7fde60ff9640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fde4406ae70 0x7fde4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:26.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.777+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde54089860 con 0x7fde64071630 2023-10-16T08:51:26.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.777+0000 7fde5a7fc640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fde4406ae70 0x7fde4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:26.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.778+0000 7fde5a7fc640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fde4406ae70 0x7fde4406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde4c006fd0 tx=0x7fde4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:26.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.781+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde54054620 con 0x7fde64071630 2023-10-16T08:51:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.975+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde640cb070 con 0x7fde64071630 2023-10-16T08:51:26.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.978+0000 7fde60ff9640 1 -- 172.21.15.94:0/2413871387 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fde5405e020 con 0x7fde64071630 2023-10-16T08:51:26.980 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:26.980 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fde4406ae70 msgr2=0x7fde4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fde4406ae70 0x7fde4406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde4c006fd0 tx=0x7fde4c008040 comp rx=0 tx=0).stop 2023-10-16T08:51:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 msgr2=0x7fde641f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde641f2920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde5400c430 tx=0x7fde5400c8f0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 shutdown_connections 2023-10-16T08:51:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fde4406ae70 0x7fde4406d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde640c9e00 0x7fde640af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde640c20e0 0x7fde641f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 --2- 172.21.15.94:0/2413871387 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde64071630 0x7fde641f2920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.981+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 >> 172.21.15.94:0/2413871387 conn(0x7fde6406c1c0 msgr2=0x7fde640c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.982+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 shutdown_connections 2023-10-16T08:51:26.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:26.982+0000 7fde699e2640 1 -- 172.21.15.94:0/2413871387 wait complete. 2023-10-16T08:51:27.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T08:51:18.896750+0000', 'modified': '2023-10-16T08:51:24.120464+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6835/3616835354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 3616835354}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 3616835354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-16T08:51:27.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T08:51:27.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T08:51:27.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.629+0000 7fd03d918640 1 Processor -- start 2023-10-16T08:51:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.630+0000 7fd03d918640 1 -- start start 2023-10-16T08:51:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.631+0000 7fd03d918640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd03815d700 0x7fd038159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.631+0000 7fd03d918640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd03815dae0 0x7fd03806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.631+0000 7fd03d918640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03815a2c0 con 0x7fd03806d440 2023-10-16T08:51:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.631+0000 7fd03d918640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03815a5a0 con 0x7fd03815dae0 2023-10-16T08:51:27.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.631+0000 7fd03d918640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03815a880 con 0x7fd03815d700 2023-10-16T08:51:27.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd03815dae0 0x7fd03806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd03815dae0 0x7fd03806cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33104/0 (socket says 172.21.15.94:33104) 2023-10-16T08:51:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 -- 172.21.15.94:0/1848665832 learned_addr learned my addr 172.21.15.94:0/1848665832 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd036ffd640 1 --2- 172.21.15.94:0/1848665832 >> v2:172.21.15.130:3300/0 conn(0x7fd03815d700 0x7fd038159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 -- 172.21.15.94:0/1848665832 >> v2:172.21.15.130:3300/0 conn(0x7fd03815d700 msgr2=0x7fd038159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 --2- 172.21.15.94:0/1848665832 >> v2:172.21.15.130:3300/0 conn(0x7fd03815d700 0x7fd038159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 -- 172.21.15.94:0/1848665832 >> v1:172.21.15.130:6789/0 conn(0x7fd03806d440 legacy=0x7fd0380b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.632+0000 7fd0367fc640 1 -- 172.21.15.94:0/1848665832 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03815ab60 con 0x7fd03815dae0 2023-10-16T08:51:27.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.633+0000 7fd0367fc640 1 --2- 172.21.15.94:0/1848665832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03806cf00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0380cc290 tx=0x7fd02002db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff0096c503603bf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.633+0000 7fd035ffb640 1 -- 172.21.15.94:0/1848665832 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02002f8e0 con 0x7fd03815dae0 2023-10-16T08:51:27.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd035ffb640 1 -- 172.21.15.94:0/1848665832 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02002fa40 con 0x7fd03815dae0 2023-10-16T08:51:27.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd035ffb640 1 -- 172.21.15.94:0/1848665832 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02002fdd0 con 0x7fd03815dae0 2023-10-16T08:51:27.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 -- 172.21.15.94:0/1848665832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 msgr2=0x7fd03806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 --2- 172.21.15.94:0/1848665832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03806cf00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0380cc290 tx=0x7fd02002db20 comp rx=0 tx=0).stop 2023-10-16T08:51:27.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 -- 172.21.15.94:0/1848665832 shutdown_connections 2023-10-16T08:51:27.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 --2- 172.21.15.94:0/1848665832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03806cf00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 --2- 172.21.15.94:0/1848665832 >> v2:172.21.15.130:3300/0 conn(0x7fd03815d700 0x7fd038159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 -- 172.21.15.94:0/1848665832 >> 172.21.15.94:0/1848665832 conn(0x7fd0380cb1b0 msgr2=0x7fd0380cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 -- 172.21.15.94:0/1848665832 shutdown_connections 2023-10-16T08:51:27.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.634+0000 7fd03d918640 1 -- 172.21.15.94:0/1848665832 wait complete. 2023-10-16T08:51:27.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.636+0000 7fd03d918640 1 Processor -- start 2023-10-16T08:51:27.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.636+0000 7fd03d918640 1 -- start start 2023-10-16T08:51:27.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd03d918640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd03806d440 0x7fd0381f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd03d918640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd03815d700 0x7fd0380c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd03d918640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd03d918640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380c31c0 con 0x7fd03815dae0 2023-10-16T08:51:27.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd03d918640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380c2260 con 0x7fd03806d440 2023-10-16T08:51:27.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd03d918640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380c2540 con 0x7fd03815d700 2023-10-16T08:51:27.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.637+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33108/0 (socket says 172.21.15.94:33108) 2023-10-16T08:51:27.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 -- 172.21.15.94:0/2856307694 learned_addr learned my addr 172.21.15.94:0/2856307694 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd036ffd640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd03806d440 0x7fd0381f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0367fc640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd03815d700 0x7fd0380c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 -- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd03815d700 msgr2=0x7fd0380c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd03815d700 0x7fd0380c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 -- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd03806d440 msgr2=0x7fd0381f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd03806d440 0x7fd0381f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 -- 172.21.15.94:0/2856307694 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200094d0 con 0x7fd03815dae0 2023-10-16T08:51:27.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd0377fe640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03815bee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c410 tx=0x7fd03000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.638+0000 7fd02ffff640 1 -- 172.21.15.94:0/2856307694 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011790 con 0x7fd03815dae0 2023-10-16T08:51:27.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.639+0000 7fd02ffff640 1 -- 172.21.15.94:0/2856307694 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300118f0 con 0x7fd03815dae0 2023-10-16T08:51:27.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.639+0000 7fd02ffff640 1 -- 172.21.15.94:0/2856307694 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011ce0 con 0x7fd03815dae0 2023-10-16T08:51:27.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.639+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0380c2820 con 0x7fd03815dae0 2023-10-16T08:51:27.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.639+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0380c2de0 con 0x7fd03815dae0 2023-10-16T08:51:27.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.641+0000 7fd02ffff640 1 -- 172.21.15.94:0/2856307694 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd03001c460 con 0x7fd03815dae0 2023-10-16T08:51:27.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.642+0000 7fd02ffff640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd01806ae70 0x7fd01806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.642+0000 7fd02ffff640 1 -- 172.21.15.94:0/2856307694 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd030089670 con 0x7fd03815dae0 2023-10-16T08:51:27.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.642+0000 7fd036ffd640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd01806ae70 0x7fd01806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.643+0000 7fd040583740 1 Processor -- start 2023-10-16T08:51:27.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.643+0000 7fd040583740 1 -- start start 2023-10-16T08:51:27.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.643+0000 7fd036ffd640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd01806ae70 0x7fd01806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd028009a60 tx=0x7fd028003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94123f80 0x55fc940f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 0x55fc94126d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd040583740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 0x55fc94127250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd040583740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc940177a0 con 0x55fc940f73c0 2023-10-16T08:51:27.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc94069740 con 0x55fc94123f80 2023-10-16T08:51:27.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc94066e30 con 0x55fc94124360 2023-10-16T08:51:27.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 0x55fc94127250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 0x55fc94127250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33114/0 (socket says 172.21.15.94:33114) 2023-10-16T08:51:27.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 -- 172.21.15.94:0/2872142838 learned_addr learned my addr 172.21.15.94:0/2872142838 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 -- 172.21.15.94:0/2872142838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 msgr2=0x55fc94126d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 0x55fc94126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 -- 172.21.15.94:0/2872142838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94123f80 msgr2=0x55fc940f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94123f80 0x55fc940f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 -- 172.21.15.94:0/2872142838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc94026910 con 0x55fc940f73c0 2023-10-16T08:51:27.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.644+0000 7fd0377fe640 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 0x55fc94127250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0300877b0 tx=0x7fd030011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d04b163ca28bee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd02d7fa640 1 -- 172.21.15.94:0/2872142838 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030060350 con 0x55fc940f73c0 2023-10-16T08:51:27.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd02d7fa640 1 -- 172.21.15.94:0/2872142838 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030087920 con 0x55fc940f73c0 2023-10-16T08:51:27.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd02d7fa640 1 -- 172.21.15.94:0/2872142838 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300582b0 con 0x55fc940f73c0 2023-10-16T08:51:27.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 -- 172.21.15.94:0/2872142838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 msgr2=0x55fc94127250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 0x55fc94127250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0300877b0 tx=0x7fd030011f80 comp rx=0 tx=0).stop 2023-10-16T08:51:27.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 -- 172.21.15.94:0/2872142838 shutdown_connections 2023-10-16T08:51:27.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc940f73c0 0x55fc94127250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 0x55fc94126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 --2- 172.21.15.94:0/2872142838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94123f80 0x55fc940f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.645+0000 7fd040583740 1 -- 172.21.15.94:0/2872142838 >> 172.21.15.94:0/2872142838 conn(0x55fc940f9190 msgr2=0x55fc94141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.646+0000 7fd040583740 1 -- 172.21.15.94:0/2872142838 shutdown_connections 2023-10-16T08:51:27.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.646+0000 7fd040583740 1 -- 172.21.15.94:0/2872142838 wait complete. 2023-10-16T08:51:27.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.646+0000 7fd040583740 1 -- start start 2023-10-16T08:51:27.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.647+0000 7fd040583740 1 Processor -- start 2023-10-16T08:51:27.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 0x55fc9413c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 0x55fc94155810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 0x55fc94111890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc94062720 con 0x55fc94123f80 2023-10-16T08:51:27.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc94000970 con 0x55fc94129760 2023-10-16T08:51:27.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc94000610 con 0x55fc94124360 2023-10-16T08:51:27.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd040583740 10 client.0 _ll_register_callbacks cb 0x55fc940229d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T08:51:27.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 0x55fc9413c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 0x55fc9413c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33128/0 (socket says 172.21.15.94:33128) 2023-10-16T08:51:27.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 -- 172.21.15.94:0/2593966702 learned_addr learned my addr 172.21.15.94:0/2593966702 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 -- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 msgr2=0x55fc94155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 0x55fc94155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 -- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 msgr2=0x55fc94111890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 0x55fc94111890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 -- 172.21.15.94:0/2593966702 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0380c2de0 con 0x55fc94123f80 2023-10-16T08:51:27.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd036ffd640 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 0x55fc9413c490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd028016a30 tx=0x7fd028016e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b32078c3653d422 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.648+0000 7fd0167fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-10-16T08:51:27.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd0167fc640 1 -- 172.21.15.94:0/2593966702 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd028014ce0 con 0x55fc94123f80 2023-10-16T08:51:27.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd0167fc640 1 -- 172.21.15.94:0/2593966702 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd028014e40 con 0x55fc94123f80 2023-10-16T08:51:27.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc94089160 con 0x55fc94123f80 2023-10-16T08:51:27.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd0167fc640 1 -- 172.21.15.94:0/2593966702 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0280096f0 con 0x55fc94123f80 2023-10-16T08:51:27.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd040583740 10 client.4434 fetch_fsmap learned FSMap version 6 2023-10-16T08:51:27.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fc94060da0 con 0x55fc94123f80 2023-10-16T08:51:27.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd0167fc640 1 -- 172.21.15.94:0/2593966702 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc94089160 con 0x55fc94123f80 2023-10-16T08:51:27.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd0167fc640 1 -- 172.21.15.94:0/2593966702 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd0280083a0 con 0x55fc94123f80 2023-10-16T08:51:27.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd040583740 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2023-10-16T08:51:27.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.649+0000 7fd040583740 10 client.4434 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T08:51:27.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.650+0000 7fd040583740 20 client.4434 populate_metadata read hostname 'smithi094' 2023-10-16T08:51:27.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.650+0000 7fd040583740 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc9413be70 0x55fc941146f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.650+0000 7fd040583740 4 client.4434 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T08:51:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.650+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 --> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc94034cc0 con 0x55fc9413be70 2023-10-16T08:51:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.650+0000 7fd0367fc640 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc9413be70 0x55fc941146f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.651+0000 7fd0367fc640 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc9413be70 0x55fc941146f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7663d664cf9369e1 server_cookie=d3a5683fd22c4c16 in_seq=0 out_seq=0 2023-10-16T08:51:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.651+0000 7fd0167fc640 10 client.4434 ms_handle_connect on v2:172.21.15.130:6834/3616835354 2023-10-16T08:51:27.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd0167fc640 1 -- 172.21.15.94:0/2593966702 <== mds.0 v2:172.21.15.130:6834/3616835354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc94034cc0 con 0x55fc9413be70 2023-10-16T08:51:27.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd0167fc640 10 client.4434 handle_command_reply: tid=0 2023-10-16T08:51:27.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd040583740 1 client.4434 shutdown 2023-10-16T08:51:27.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 msgr2=0x55fc9413c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd040583740 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 0x55fc9413c490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd028016a30 tx=0x7fd028016e30 comp rx=0 tx=0).stop 2023-10-16T08:51:27.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 shutdown_connections 2023-10-16T08:51:27.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.653+0000 7fd040583740 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc9413be70 0x55fc941146f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 0x55fc94111890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94124360 0x55fc94155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 1 --2- 172.21.15.94:0/2593966702 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94123f80 0x55fc9413c490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd0167fc640 0 client.4434 ms_handle_reset on v2:172.21.15.130:6834/3616835354 2023-10-16T08:51:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 >> 172.21.15.94:0/2593966702 conn(0x55fc940f73c0 msgr2=0x55fc940fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 shutdown_connections 2023-10-16T08:51:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 1 -- 172.21.15.94:0/2593966702 wait complete. 2023-10-16T08:51:27.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.654+0000 7fd040583740 20 client.4434 trim_cache size 0 max 16384 2023-10-16T08:51:27.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.670+0000 7fd040583740 1 Processor -- start 2023-10-16T08:51:27.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.670+0000 7fd040583740 1 -- start start 2023-10-16T08:51:27.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc9413cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd040583740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 0x55fc94111720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 0x55fc940f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd040583740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc941459d0 con 0x55fc94124360 2023-10-16T08:51:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc93dc6f20 con 0x55fc94129760 2023-10-16T08:51:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc94145880 con 0x55fc94123f80 2023-10-16T08:51:27.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd0367fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 0x55fc94111720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd0367fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 0x55fc94111720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33132/0 (socket says 172.21.15.94:33132) 2023-10-16T08:51:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.671+0000 7fd0367fc640 1 -- 172.21.15.94:0/1658259069 learned_addr learned my addr 172.21.15.94:0/1658259069 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd0367fc640 1 -- 172.21.15.94:0/1658259069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 msgr2=0x55fc9413cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd0367fc640 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc9413cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd0367fc640 1 -- 172.21.15.94:0/1658259069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 msgr2=0x55fc940f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd0367fc640 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 0x55fc940f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd0367fc640 1 -- 172.21.15.94:0/1658259069 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc93fffb80 con 0x55fc94124360 2023-10-16T08:51:27.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd0367fc640 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 0x55fc94111720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd02002db60 tx=0x7fd020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ecd1ca7bcffd9f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd02dffb640 1 -- 172.21.15.94:0/1658259069 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02002f8e0 con 0x55fc94124360 2023-10-16T08:51:27.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd02dffb640 1 -- 172.21.15.94:0/1658259069 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02002fbb0 con 0x55fc94124360 2023-10-16T08:51:27.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.672+0000 7fd02dffb640 1 -- 172.21.15.94:0/1658259069 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020037420 con 0x55fc94124360 2023-10-16T08:51:27.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 -- 172.21.15.94:0/1658259069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 msgr2=0x55fc94111720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 0x55fc94111720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd02002db60 tx=0x7fd020004730 comp rx=0 tx=0).stop 2023-10-16T08:51:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 -- 172.21.15.94:0/1658259069 shutdown_connections 2023-10-16T08:51:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94129760 0x55fc940f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94124360 0x55fc94111720 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 --2- 172.21.15.94:0/1658259069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc9413cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 -- 172.21.15.94:0/1658259069 >> 172.21.15.94:0/1658259069 conn(0x55fc940f73c0 msgr2=0x55fc94142160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 -- 172.21.15.94:0/1658259069 shutdown_connections 2023-10-16T08:51:27.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.673+0000 7fd040583740 1 -- 172.21.15.94:0/1658259069 wait complete. 2023-10-16T08:51:27.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.674+0000 7fd040583740 1 -- start start 2023-10-16T08:51:27.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.674+0000 7fd040583740 1 Processor -- start 2023-10-16T08:51:27.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc94150be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94124360 0x55fc940f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 0x55fc940f6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc941ab3f0 con 0x55fc94129760 2023-10-16T08:51:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc94121e10 con 0x55fc94124360 2023-10-16T08:51:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc94151120 con 0x55fc94123f80 2023-10-16T08:51:27.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd040583740 10 client.0 _ll_register_callbacks cb 0x7fd028003f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T08:51:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 0x55fc940f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 0x55fc940f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33140/0 (socket says 172.21.15.94:33140) 2023-10-16T08:51:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.675+0000 7fd0377fe640 1 -- 172.21.15.94:0/1387412700 learned_addr learned my addr 172.21.15.94:0/1387412700 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd036ffd640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc94150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0367fc640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94124360 0x55fc940f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0377fe640 1 -- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 msgr2=0x55fc94150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0377fe640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc94150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0377fe640 1 -- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94124360 msgr2=0x55fc940f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0377fe640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94124360 0x55fc940f5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0377fe640 1 -- 172.21.15.94:0/1387412700 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03815ab60 con 0x55fc94129760 2023-10-16T08:51:27.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0377fe640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 0x55fc940f6380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd03001b000 tx=0x7fd030056600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f9224ca492cbbd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0167fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-10-16T08:51:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0167fc640 1 -- 172.21.15.94:0/1387412700 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030057740 con 0x55fc94129760 2023-10-16T08:51:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd0167fc640 1 -- 172.21.15.94:0/1387412700 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd030060350 con 0x55fc94129760 2023-10-16T08:51:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.676+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd030087920 con 0x55fc94129760 2023-10-16T08:51:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd0167fc640 1 -- 172.21.15.94:0/1387412700 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0300582b0 con 0x55fc94129760 2023-10-16T08:51:27.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 10 client.4440 fetch_fsmap learned FSMap version 6 2023-10-16T08:51:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fc94025170 con 0x55fc94129760 2023-10-16T08:51:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd0167fc640 1 -- 172.21.15.94:0/1387412700 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030087920 con 0x55fc94129760 2023-10-16T08:51:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd0167fc640 1 -- 172.21.15.94:0/1387412700 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd03005fec0 con 0x55fc94129760 2023-10-16T08:51:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 10 client.4440 fetch_fsmap finished waiting for FSMap version 6 2023-10-16T08:51:27.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 10 client.4440 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T08:51:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 20 client.4440 populate_metadata read hostname 'smithi094' 2023-10-16T08:51:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc941aa480 0x55fc941aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 4 client.4440 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T08:51:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.677+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 --> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fc9405b700 con 0x55fc941aa480 2023-10-16T08:51:27.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.678+0000 7fd036ffd640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc941aa480 0x55fc941aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd0167fc640 10 client.4440 ms_handle_connect on v2:172.21.15.130:6834/3616835354 2023-10-16T08:51:27.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd036ffd640 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc941aa480 0x55fc941aa860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a6d0e5f31e2cbee server_cookie=528280f7a1b94946 in_seq=0 out_seq=0 2023-10-16T08:51:27.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd0167fc640 1 -- 172.21.15.94:0/1387412700 <== mds.0 v2:172.21.15.130:6834/3616835354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55fc9405b700 con 0x55fc941aa480 2023-10-16T08:51:27.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd0167fc640 10 client.4440 handle_command_reply: tid=0 2023-10-16T08:51:27.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 client.4440 shutdown 2023-10-16T08:51:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 msgr2=0x55fc940f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 0x55fc940f6380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd03001b000 tx=0x7fd030056600 comp rx=0 tx=0).stop 2023-10-16T08:51:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 shutdown_connections 2023-10-16T08:51:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x55fc941aa480 0x55fc941aa860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55fc94129760 0x55fc940f6380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc94124360 0x55fc940f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 --2- 172.21.15.94:0/1387412700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc94123f80 0x55fc94150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 >> 172.21.15.94:0/1387412700 conn(0x55fc940f73c0 msgr2=0x55fc94151600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.679+0000 7fd0167fc640 0 client.4440 ms_handle_reset on v2:172.21.15.130:6834/3616835354 2023-10-16T08:51:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 shutdown_connections 2023-10-16T08:51:27.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd040583740 1 -- 172.21.15.94:0/1387412700 wait complete. 2023-10-16T08:51:27.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd040583740 20 client.4440 trim_cache size 0 max 16384 2023-10-16T08:51:27.692 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:51:27.692 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "d7b7598f-7f16-4780-92e5-7e8a731f0195", 2023-10-16T08:51:27.692 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2023-10-16T08:51:27.693 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4293, 2023-10-16T08:51:27.693 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2023-10-16T08:51:27.693 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2023-10-16T08:51:27.693 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2023-10-16T08:51:27.693 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 8.2253366299999993, 2023-10-16T08:51:27.694 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 6, 2023-10-16T08:51:27.694 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 26, 2023-10-16T08:51:27.694 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 26, 2023-10-16T08:51:27.694 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 13.26095316 2023-10-16T08:51:27.695 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:51:27.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd01806ae70 msgr2=0x7fd01806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd01806ae70 0x7fd01806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd028009a60 tx=0x7fd028003990 comp rx=0 tx=0).stop 2023-10-16T08:51:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 msgr2=0x7fd03815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03815bee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c410 tx=0x7fd03000c8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 shutdown_connections 2023-10-16T08:51:27.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd03815dae0 0x7fd03815bee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd03815d700 0x7fd0380c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd01806ae70 0x7fd01806d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 --2- 172.21.15.94:0/2856307694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd03806d440 0x7fd0381f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.680+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 >> 172.21.15.94:0/2856307694 conn(0x7fd0380cb1b0 msgr2=0x7fd03815ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.681+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 shutdown_connections 2023-10-16T08:51:27.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.681+0000 7fd03d918640 1 -- 172.21.15.94:0/2856307694 wait complete. 2023-10-16T08:51:27.699 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T08:51:27.699 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:27.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T08:51:27.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.910+0000 7fe769755640 1 Processor -- start 2023-10-16T08:51:27.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.911+0000 7fe769755640 1 -- start start 2023-10-16T08:51:27.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.912+0000 7fe769755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 0x7fe7640d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.912+0000 7fe769755640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640cfee0 con 0x7fe7640af960 2023-10-16T08:51:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.912+0000 7fe769755640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640cf680 con 0x7fe7640cd730 2023-10-16T08:51:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.912+0000 7fe769755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640cf920 con 0x7fe76415ce00 2023-10-16T08:51:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe7627fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe7640af960 0x7fe7640cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55832/0 (socket says 172.21.15.94:55832) 2023-10-16T08:51:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe7627fc640 1 -- 172.21.15.94:0/2451719658 learned_addr learned my addr 172.21.15.94:0/2451719658 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:27.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe762ffd640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 0x7fe7640d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402233703 0 0) 0x7fe7640cfee0 con 0x7fe7640af960 2023-10-16T08:51:27.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe750003520 con 0x7fe7640af960 2023-10-16T08:51:27.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760322868 0 0) 0x7fe750003520 con 0x7fe7640af960 2023-10-16T08:51:27.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 msgr2=0x7fe7640d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 0x7fe7640d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 >> v1:172.21.15.130:6789/0 conn(0x7fe7640cd730 legacy=0x7fe7640cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640cfc00 con 0x7fe7640af960 2023-10-16T08:51:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fe74c001670 con 0x7fe7640af960 2023-10-16T08:51:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 >> v1:172.21.15.94:6789/0 conn(0x7fe7640af960 legacy=0x7fe7640cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.913+0000 7fe761ffb640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 0x7fe750003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe761ffb640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750003fe0 0x7fe7500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe761ffb640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe750004d00 0x7fe750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640cf920 con 0x7fe750004d00 2023-10-16T08:51:27.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75000bbc0 con 0x7fe750003fe0 2023-10-16T08:51:27.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75000bd80 con 0x7fe76415ce00 2023-10-16T08:51:27.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7637fe640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe750004d00 0x7fe750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7627fc640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750003fe0 0x7fe7500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe762ffd640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 0x7fe750003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7637fe640 1 -- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 msgr2=0x7fe750003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7637fe640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe76415ce00 0x7fe750003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7637fe640 1 -- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750003fe0 msgr2=0x7fe7500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7637fe640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750003fe0 0x7fe7500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.914+0000 7fe7637fe640 1 -- 172.21.15.94:0/2451719658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750003520 con 0x7fe750004d00 2023-10-16T08:51:27.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.915+0000 7fe7637fe640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe750004d00 0x7fe750005180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe75c001750 tx=0x7fe7500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2e4959a8ee18e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0052d0 con 0x7fe750004d00 2023-10-16T08:51:27.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c02e050 con 0x7fe750004d00 2023-10-16T08:51:27.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe761ffb640 1 -- 172.21.15.94:0/2451719658 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c003830 con 0x7fe750004d00 2023-10-16T08:51:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe769755640 1 -- 172.21.15.94:0/2451719658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe750004d00 msgr2=0x7fe750005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe769755640 1 --2- 172.21.15.94:0/2451719658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe750004d00 0x7fe750005180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe75c001750 tx=0x7fe7500057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe7637fe640 1 -- 172.21.15.94:0/2451719658 reap_dead start 2023-10-16T08:51:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe769755640 1 -- 172.21.15.94:0/2451719658 shutdown_connections 2023-10-16T08:51:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe769755640 1 -- 172.21.15.94:0/2451719658 >> 172.21.15.94:0/2451719658 conn(0x7fe7640d07a0 msgr2=0x7fe7640d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:27.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe769755640 1 -- 172.21.15.94:0/2451719658 shutdown_connections 2023-10-16T08:51:27.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.916+0000 7fe769755640 1 -- 172.21.15.94:0/2451719658 wait complete. 2023-10-16T08:51:27.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.918+0000 7fe769755640 1 Processor -- start 2023-10-16T08:51:27.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.918+0000 7fe769755640 1 -- start start 2023-10-16T08:51:27.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe769755640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750004d00 0x7fe764159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe769755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7641e6ff0 0x7fe7641e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe769755640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 0x7fe7640b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe769755640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640b33a0 con 0x7fe7641e5b50 2023-10-16T08:51:27.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe769755640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641e6b90 con 0x7fe750004d00 2023-10-16T08:51:27.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe769755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641e6010 con 0x7fe7641e6ff0 2023-10-16T08:51:27.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.919+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 0x7fe7640b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 0x7fe7640b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33160/0 (socket says 172.21.15.94:33160) 2023-10-16T08:51:27.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 -- 172.21.15.94:0/3444082799 learned_addr learned my addr 172.21.15.94:0/3444082799 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:27.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe762ffd640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750004d00 0x7fe764159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7627fc640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7641e6ff0 0x7fe7641e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 -- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7641e6ff0 msgr2=0x7fe7641e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7641e6ff0 0x7fe7641e5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 -- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750004d00 msgr2=0x7fe764159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750004d00 0x7fe764159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 -- 172.21.15.94:0/3444082799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7641e62f0 con 0x7fe7641e5b50 2023-10-16T08:51:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe7637fe640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 0x7fe7640b1e60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe75c034040 tx=0x7fe75c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.920+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c007a30 con 0x7fe7641e5b50 2023-10-16T08:51:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.921+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0067d0 con 0x7fe7641e5b50 2023-10-16T08:51:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.921+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c006b80 con 0x7fe7641e5b50 2023-10-16T08:51:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.921+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7641e65d0 con 0x7fe7641e5b50 2023-10-16T08:51:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.921+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7640b23a0 con 0x7fe7641e5b50 2023-10-16T08:51:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.922+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7641e2200 con 0x7fe7641e5b50 2023-10-16T08:51:27.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.923+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe75c006ce0 con 0x7fe7641e5b50 2023-10-16T08:51:27.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.924+0000 7fe75b7fe640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe74406ae70 0x7fe74406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:27.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.924+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe75c0aaef0 con 0x7fe7641e5b50 2023-10-16T08:51:27.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.924+0000 7fe762ffd640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe74406ae70 0x7fe74406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:27.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.925+0000 7fe762ffd640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe74406ae70 0x7fe74406d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe76415c810 tx=0x7fe75400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:27.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:27.929+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7641e2200 con 0x7fe7641e5b50 2023-10-16T08:51:28.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.157+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe7641e2200 con 0x7fe7641e5b50 2023-10-16T08:51:28.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.157+0000 7fe75b7fe640 1 -- 172.21.15.94:0/3444082799 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe75c04a070 con 0x7fe7641e5b50 2023-10-16T08:51:28.159 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T08:51:28.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe74406ae70 msgr2=0x7fe74406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:28.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe74406ae70 0x7fe74406d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe76415c810 tx=0x7fe75400b040 comp rx=0 tx=0).stop 2023-10-16T08:51:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 msgr2=0x7fe7640b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 0x7fe7640b1e60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe75c034040 tx=0x7fe75c001120 comp rx=0 tx=0).stop 2023-10-16T08:51:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 shutdown_connections 2023-10-16T08:51:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe7641e5b50 0x7fe7640b1e60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:28.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7641e6ff0 0x7fe7641e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe74406ae70 0x7fe74406d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 --2- 172.21.15.94:0/3444082799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe750004d00 0x7fe764159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 >> 172.21.15.94:0/3444082799 conn(0x7fe7640d07a0 msgr2=0x7fe76406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 shutdown_connections 2023-10-16T08:51:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:28.160+0000 7fe769755640 1 -- 172.21.15.94:0/3444082799 wait complete. 2023-10-16T08:51:28.178 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T08:51:28.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T08:51:28.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2023-10-16T08:51:28.179 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-16T08:51:28.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:28.180 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T08:51:28.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T08:51:28.181 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T08:51:28.181 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T08:51:28.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:28.182 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2023-10-16T08:51:28.238 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:51:28.238 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:51:28.238 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:51:28.239 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:51:28.239 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-16T08:51:28.239 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:51:28.239 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:51:28.239 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2023-10-16T08:51:28.240 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2023-10-16T08:51:28.240 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:51:28.240 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2023-10-16T08:51:28.240 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2023-10-16T08:51:28.240 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:51:28.240 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:51:28.241 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T08:51:28.241 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:51:28.241 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T08:51:28.241 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-10-16T08:51:28.241 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2023-10-16T08:51:28.242 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:51:28.242 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T08:51:28.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:28.243 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:51:28.243 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:51:28.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2023-10-16T08:51:28.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2023-10-16T08:51:28.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2023-10-16T08:51:28.245 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T08:51:28.245 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:51:28.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:28.693 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T08:51:28.772 INFO:teuthology.orchestra.run.smithi094.stdout:1 2023-10-16T08:51:28.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:28.776 DEBUG:teuthology.orchestra.run.smithi094:> route 2023-10-16T08:51:28.837 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2023-10-16T08:51:28.838 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T08:51:28.838 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T08:51:28.838 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T08:51:28.838 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T08:51:28.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:28.839 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:51:28.839 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:51:28.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T08:51:28.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T08:51:28.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T08:51:28.841 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:51:29.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:29.630 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-16T08:51:29.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:29.691 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2023-10-16T08:51:29.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:29.743 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:51:29.744 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:51:29.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T08:51:29.745 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-16T08:51:29.745 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:51:29.881 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-16T08:51:29.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:29.883 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:51:29.883 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:51:29.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-16T08:51:29.884 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T08:51:29.884 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-16T08:51:29.884 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-16T08:51:29.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-16T08:51:29.885 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:51:30.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:30.174 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:51:30.175 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:51:30.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2023-10-16T08:51:30.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T08:51:30.176 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:51:30.345 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-16T08:51:30.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:51:30.350 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T08:51:30.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:51:30.398 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:30.497 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:51:30.596 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:51:30.648 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:51:30.648 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:51:30.648 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:51:30.648 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:51:30.649 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:51:30.649 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:51:30.649 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:51:30.649 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:51:30.649 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:51:30.650 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:51:30.650 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:51:30.650 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:51:30.650 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:51:30.651 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:51:30.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:51:30.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:51:30.651 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:51:30.651 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:51:30.652 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:51:30.652 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:51:30.652 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:51:30.652 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:51:30.652 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:51:30.653 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:51:30.653 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:51:30.653 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:51:30.653 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:51:30.653 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:51:30.654 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:51:30.654 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T08:51:30.654 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T08:51:30.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:30.657 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:51:30.709 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T08:51:30.709 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-16T08:51:30.715 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:51:30.789 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:51:30.831 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:51:30.831 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:51:30.831 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:51:30.832 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:51:30.832 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:51:30.832 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:51:30.832 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:51:30.832 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:51:30.833 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:51:30.833 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:51:30.833 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:51:30.833 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:51:30.833 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:51:30.834 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:51:30.834 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:51:30.834 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:51:30.834 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:51:30.834 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:51:30.835 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:51:30.835 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:51:30.835 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:51:30.835 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:51:30.835 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:51:30.836 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:51:30.836 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:51:30.836 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:51:30.836 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:51:30.836 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:51:30.837 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:51:30.837 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T08:51:30.837 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T08:51:30.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:30.838 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:51:30.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:2023-10-16T08:51:30.903+0000 7fc099e54480 -1 init, newargv = 0x55c671503cf0 newargc=15 2023-10-16T08:51:30.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[92520]: starting ceph client 2023-10-16T08:51:30.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[92520]: starting fuse 2023-10-16T08:51:30.926 INFO:teuthology.orchestra.run.smithi094.stdout:39 2023-10-16T08:51:30.926 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-16T08:51:30.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2023-10-16T08:51:30.927 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2023-10-16T08:51:30.927 DEBUG:teuthology.orchestra.run.smithi094:> import re 2023-10-16T08:51:30.928 DEBUG:teuthology.orchestra.run.smithi094:> import os 2023-10-16T08:51:30.928 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2023-10-16T08:51:30.928 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:51:30.929 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2023-10-16T08:51:30.929 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-16T08:51:30.929 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2023-10-16T08:51:30.930 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-16T08:51:30.930 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:51:30.930 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2023-10-16T08:51:30.931 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2023-10-16T08:51:30.931 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2023-10-16T08:51:30.931 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2023-10-16T08:51:30.932 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:51:30.932 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2023-10-16T08:51:30.932 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T08:51:30.933 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T08:51:30.933 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T08:51:30.933 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2023-10-16T08:51:30.934 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2023-10-16T08:51:30.934 DEBUG:teuthology.orchestra.run.smithi094:> return f 2023-10-16T08:51:30.934 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T08:51:30.935 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:51:30.935 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.admin")) 2023-10-16T08:51:30.935 DEBUG:teuthology.orchestra.run.smithi094:> ' 2023-10-16T08:51:31.125 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.admin.92520.asok 2023-10-16T08:51:31.129 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T08:51:31.141 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.92520.asok 2023-10-16T08:51:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:31.142 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.92520.asok status 2023-10-16T08:51:31.380 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:51:31.381 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2023-10-16T08:51:31.381 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T08:51:31.381 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T08:51:31.381 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "admin", 2023-10-16T08:51:31.381 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2023-10-16T08:51:31.382 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-16T08:51:31.382 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "92520", 2023-10-16T08:51:31.382 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2023-10-16T08:51:31.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:51:31.383 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2023-10-16T08:51:31.383 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2023-10-16T08:51:31.383 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4452, 2023-10-16T08:51:31.383 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2023-10-16T08:51:31.383 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2023-10-16T08:51:31.384 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2023-10-16T08:51:31.384 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4452 2023-10-16T08:51:31.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:51:31.384 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:51:31.384 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:51:31.385 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:51:31.385 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3355966340 2023-10-16T08:51:31.385 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:51:31.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:51:31.385 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:51:31.385 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:51:31.386 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:51:31.386 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3355966340 2023-10-16T08:51:31.386 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:51:31.386 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4452 192.168.0.1:0/3355966340", 2023-10-16T08:51:31.387 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/3355966340", 2023-10-16T08:51:31.387 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2023-10-16T08:51:31.387 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 6, 2023-10-16T08:51:31.387 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 26, 2023-10-16T08:51:31.387 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2023-10-16T08:51:31.387 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2023-10-16T08:51:31.388 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2023-10-16T08:51:31.388 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:51:31.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:31.396 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2023-10-16T08:51:31.396 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:31.452 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2023-10-16T08:51:31.452 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:31.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:31.453 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:31.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:31.554 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-16T08:51:31.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:51:31.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:51:31.665 INFO:teuthology.orchestra.run.smithi094.stdout:# file: . 2023-10-16T08:51:31.665 INFO:teuthology.orchestra.run.smithi094.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-16T08:51:31.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:31.666 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:51:31.666 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:51:31.751 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.011+0000 7f728f052640 1 Processor -- start 2023-10-16T08:51:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.011+0000 7f728f052640 1 -- start start 2023-10-16T08:51:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.012+0000 7f728f052640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f72880b0010 0x7f72880701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.012+0000 7f728f052640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 0x7f728815f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f728f052640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728815f580 con 0x7f72880b03f0 2023-10-16T08:51:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f728f052640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72880707f0 con 0x7f72880b0010 2023-10-16T08:51:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f728f052640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7288070ad0 con 0x7f728815ad00 2023-10-16T08:51:32.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f728d5ef640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f72880b03f0 0x7f728815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55836/0 (socket says 172.21.15.94:55836) 2023-10-16T08:51:32.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f728d5ef640 1 -- 172.21.15.94:0/782010259 learned_addr learned my addr 172.21.15.94:0/782010259 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:32.017 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f728cdee640 1 --2- 172.21.15.94:0/782010259 >> v2:172.21.15.130:3300/0 conn(0x7f72880b0010 0x7f72880701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f7287fff640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 0x7f728815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438219313 0 0) 0x7f7280001490 con 0x7f72880b03f0 2023-10-16T08:51:32.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.013+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7278003520 con 0x7f72880b03f0 2023-10-16T08:51:32.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734637240 0 0) 0x7f7278003520 con 0x7f72880b03f0 2023-10-16T08:51:32.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 msgr2=0x7f728815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 0x7f728815f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 >> v2:172.21.15.130:3300/0 conn(0x7f72880b0010 msgr2=0x7f72880701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 --2- 172.21.15.94:0/782010259 >> v2:172.21.15.130:3300/0 conn(0x7f72880b0010 0x7f72880701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728815b1d0 con 0x7f72880b03f0 2023-10-16T08:51:32.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f7280001b80 con 0x7f72880b03f0 2023-10-16T08:51:32.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 >> v1:172.21.15.94:6789/0 conn(0x7f72880b03f0 legacy=0x7f728815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f7278003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 0x7f72780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7278004d00 0x7f7278005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880707f0 con 0x7f72780039e0 2023-10-16T08:51:32.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288070ad0 con 0x7f7278004d00 2023-10-16T08:51:32.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727800b980 con 0x7f728815ad00 2023-10-16T08:51:32.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.014+0000 7f728cdee640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f7278003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728d5ef640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7278004d00 0x7f7278005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f7287fff640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 0x7f72780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728cdee640 1 -- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 msgr2=0x7f72780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728cdee640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f728815ad00 0x7f72780047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728cdee640 1 -- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7278004d00 msgr2=0x7f7278005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728cdee640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7278004d00 0x7f7278005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728cdee640 1 -- 172.21.15.94:0/782010259 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278003520 con 0x7f72780039e0 2023-10-16T08:51:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.015+0000 7f728d5ef640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7278004d00 0x7f7278005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.016+0000 7f728cdee640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f7278003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f727c009ac0 tx=0x7f72780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d980d539cc5dc05c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.016+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c02c710 con 0x7f72780039e0 2023-10-16T08:51:32.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.016+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c02c870 con 0x7f72780039e0 2023-10-16T08:51:32.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.016+0000 7f72877fe640 1 -- 172.21.15.94:0/782010259 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c02cc00 con 0x7f72780039e0 2023-10-16T08:51:32.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728f052640 1 -- 172.21.15.94:0/782010259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 msgr2=0x7f7278003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728f052640 1 --2- 172.21.15.94:0/782010259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f7278003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f727c009ac0 tx=0x7f72780057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728d5ef640 1 -- 172.21.15.94:0/782010259 reap_dead start 2023-10-16T08:51:32.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728f052640 1 -- 172.21.15.94:0/782010259 shutdown_connections 2023-10-16T08:51:32.025 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728f052640 1 -- 172.21.15.94:0/782010259 >> 172.21.15.94:0/782010259 conn(0x7f728806c1c0 msgr2=0x7f728806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:32.025 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728f052640 1 -- 172.21.15.94:0/782010259 shutdown_connections 2023-10-16T08:51:32.025 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.017+0000 7f728f052640 1 -- 172.21.15.94:0/782010259 wait complete. 2023-10-16T08:51:32.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.019+0000 7f728f052640 1 Processor -- start 2023-10-16T08:51:32.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.019+0000 7f728f052640 1 -- start start 2023-10-16T08:51:32.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728f052640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f72881530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728f052640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72880cab30 0x7f72880cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728f052640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72881547b0 0x7f7288154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728f052640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288155170 con 0x7f72780039e0 2023-10-16T08:51:32.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728f052640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880ce1c0 con 0x7f72881547b0 2023-10-16T08:51:32.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728f052640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880cdc00 con 0x7f72880cab30 2023-10-16T08:51:32.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f72881530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f72881530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33184/0 (socket says 172.21.15.94:33184) 2023-10-16T08:51:32.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 -- 172.21.15.94:0/3546716901 learned_addr learned my addr 172.21.15.94:0/3546716901 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:32.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 -- 172.21.15.94:0/3546716901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72880cab30 msgr2=0x7f72880cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72880cab30 0x7f72880cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 -- 172.21.15.94:0/3546716901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72881547b0 msgr2=0x7f7288154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72881547b0 0x7f7288154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.020+0000 7f728cdee640 1 -- 172.21.15.94:0/3546716901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880cdee0 con 0x7f72780039e0 2023-10-16T08:51:32.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.021+0000 7f728cdee640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f72881530a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f727c02c2b0 tx=0x7f727c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.021+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c003810 con 0x7f72780039e0 2023-10-16T08:51:32.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.021+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c02de90 con 0x7f72780039e0 2023-10-16T08:51:32.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.021+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72880acb60 con 0x7f72780039e0 2023-10-16T08:51:32.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.021+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c003b70 con 0x7f72780039e0 2023-10-16T08:51:32.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.021+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72880c92d0 con 0x7f72780039e0 2023-10-16T08:51:32.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.022+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72880ad360 con 0x7f72780039e0 2023-10-16T08:51:32.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.023+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f727c003cd0 con 0x7f72780039e0 2023-10-16T08:51:32.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.024+0000 7f72857fa640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f726c06ae70 0x7f726c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.024+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f727c0ab830 con 0x7f72780039e0 2023-10-16T08:51:32.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.024+0000 7f7287fff640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f726c06ae70 0x7f726c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.025+0000 7f7287fff640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f726c06ae70 0x7f726c06d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f728815b100 tx=0x7f7274008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.029+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f727c0765e0 con 0x7f72780039e0 2023-10-16T08:51:32.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.222+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7288073ef0 con 0x7f72780039e0 2023-10-16T08:51:32.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.225+0000 7f72857fa640 1 -- 172.21.15.94:0/3546716901 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f727c079c00 con 0x7f72780039e0 2023-10-16T08:51:32.226 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:32.226 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f726c06ae70 msgr2=0x7f726c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f726c06ae70 0x7f726c06d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f728815b100 tx=0x7f7274008040 comp rx=0 tx=0).stop 2023-10-16T08:51:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 msgr2=0x7f72881530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f72881530a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f727c02c2b0 tx=0x7f727c004730 comp rx=0 tx=0).stop 2023-10-16T08:51:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 shutdown_connections 2023-10-16T08:51:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f726c06ae70 0x7f726c06d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72881547b0 0x7f7288154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72880cab30 0x7f72880cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 --2- 172.21.15.94:0/3546716901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72780039e0 0x7f72881530a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 >> 172.21.15.94:0/3546716901 conn(0x7f728806c1c0 msgr2=0x7f7288159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:32.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 shutdown_connections 2023-10-16T08:51:32.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.228+0000 7f728f052640 1 -- 172.21.15.94:0/3546716901 wait complete. 2023-10-16T08:51:32.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:51:32.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:51:32.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.462+0000 7f58455d7640 1 Processor -- start 2023-10-16T08:51:32.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.463+0000 7f58455d7640 1 -- start start 2023-10-16T08:51:32.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.464+0000 7f58455d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.464+0000 7f58455d7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f58400c8ea0 0x7f58400c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.464+0000 7f58455d7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5840072480 con 0x7f5840159890 2023-10-16T08:51:32.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.464+0000 7f58455d7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58400cd0c0 con 0x7f58400c8ea0 2023-10-16T08:51:32.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.464+0000 7f58455d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58400cc540 con 0x7f58400ca820 2023-10-16T08:51:32.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.464+0000 7f583f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f58400c8ea0 0x7f58400c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f583f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f58400c8ea0 0x7f58400c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33200/0 (socket says 172.21.15.94:33200) 2023-10-16T08:51:32.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f583f7fe640 1 -- 172.21.15.94:0/3617770335 learned_addr learned my addr 172.21.15.94:0/3617770335 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:32.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f5837fff640 1 --2- 172.21.15.94:0/3617770335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f583f7fe640 1 -- 172.21.15.94:0/3617770335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 msgr2=0x7f5840071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f583f7fe640 1 --2- 172.21.15.94:0/3617770335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f583f7fe640 1 -- 172.21.15.94:0/3617770335 >> v1:172.21.15.130:6789/0 conn(0x7f5840159890 legacy=0x7f58400ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.465+0000 7f583f7fe640 1 -- 172.21.15.94:0/3617770335 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400cc820 con 0x7f58400c8ea0 2023-10-16T08:51:32.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.466+0000 7f583f7fe640 1 --2- 172.21.15.94:0/3617770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400c9330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5838009e50 tx=0x7f583802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc823804c051e110 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.466+0000 7f583e7fc640 1 -- 172.21.15.94:0/3617770335 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583802ca70 con 0x7f58400c8ea0 2023-10-16T08:51:32.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.466+0000 7f583e7fc640 1 -- 172.21.15.94:0/3617770335 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583802cbd0 con 0x7f58400c8ea0 2023-10-16T08:51:32.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.466+0000 7f583e7fc640 1 -- 172.21.15.94:0/3617770335 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380343f0 con 0x7f58400c8ea0 2023-10-16T08:51:32.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 -- 172.21.15.94:0/3617770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 msgr2=0x7f58400c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 --2- 172.21.15.94:0/3617770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400c9330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5838009e50 tx=0x7f583802bed0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 -- 172.21.15.94:0/3617770335 shutdown_connections 2023-10-16T08:51:32.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 --2- 172.21.15.94:0/3617770335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400c9330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 --2- 172.21.15.94:0/3617770335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 -- 172.21.15.94:0/3617770335 >> 172.21.15.94:0/3617770335 conn(0x7f58400b0030 msgr2=0x7f58400b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:32.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 -- 172.21.15.94:0/3617770335 shutdown_connections 2023-10-16T08:51:32.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.467+0000 7f58455d7640 1 -- 172.21.15.94:0/3617770335 wait complete. 2023-10-16T08:51:32.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.469+0000 7f58455d7640 1 Processor -- start 2023-10-16T08:51:32.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.469+0000 7f58455d7640 1 -- start start 2023-10-16T08:51:32.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f58455d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f58455d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f58455d7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5840159890 0x7f58400c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f58455d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5840157060 con 0x7f58400c8ea0 2023-10-16T08:51:32.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f58455d7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401f2230 con 0x7f5840159890 2023-10-16T08:51:32.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f58455d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58401f2510 con 0x7f58400ca820 2023-10-16T08:51:32.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f583effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f583effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33210/0 (socket says 172.21.15.94:33210) 2023-10-16T08:51:32.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.470+0000 7f583effd640 1 -- 172.21.15.94:0/2205108767 learned_addr learned my addr 172.21.15.94:0/2205108767 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:32.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583f7fe640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5840159890 0x7f58400c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f5837fff640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583effd640 1 -- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 msgr2=0x7f5840156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583effd640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583effd640 1 -- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5840159890 msgr2=0x7f58400c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583effd640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5840159890 0x7f58400c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583effd640 1 -- 172.21.15.94:0/2205108767 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838009b30 con 0x7f58400c8ea0 2023-10-16T08:51:32.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583f7fe640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5840159890 0x7f58400c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:32.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f583effd640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400b0fd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f583000b3f0 tx=0x7f583000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830011830 con 0x7f58400c8ea0 2023-10-16T08:51:32.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830011990 con 0x7f58400c8ea0 2023-10-16T08:51:32.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830011d40 con 0x7f58400c8ea0 2023-10-16T08:51:32.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58401f27f0 con 0x7f58400c8ea0 2023-10-16T08:51:32.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.471+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58401f1d30 con 0x7f58400c8ea0 2023-10-16T08:51:32.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.472+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58401f2d10 con 0x7f58400c8ea0 2023-10-16T08:51:32.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.473+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f583001a400 con 0x7f58400c8ea0 2023-10-16T08:51:32.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.474+0000 7f58377fe640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f582006ae70 0x7f582006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.474+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5830089700 con 0x7f58400c8ea0 2023-10-16T08:51:32.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.475+0000 7f5837fff640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f582006ae70 0x7f582006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.475+0000 7f5837fff640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f582006ae70 0x7f582006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5828006fd0 tx=0x7f5828008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.479+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58300544c0 con 0x7f58400c8ea0 2023-10-16T08:51:32.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.667+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5840073ef0 con 0x7f58400c8ea0 2023-10-16T08:51:32.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.668+0000 7f58377fe640 1 -- 172.21.15.94:0/2205108767 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5830057ae0 con 0x7f58400c8ea0 2023-10-16T08:51:32.671 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:51:32.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f582006ae70 msgr2=0x7f582006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f582006ae70 0x7f582006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5828006fd0 tx=0x7f5828008040 comp rx=0 tx=0).stop 2023-10-16T08:51:32.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 msgr2=0x7f58400b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400b0fd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f583000b3f0 tx=0x7f583000b8b0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 shutdown_connections 2023-10-16T08:51:32.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f582006ae70 0x7f582006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5840159890 0x7f58400c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58400ca820 0x7f5840156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 --2- 172.21.15.94:0/2205108767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f58400c8ea0 0x7f58400b0fd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 >> 172.21.15.94:0/2205108767 conn(0x7f58400b0030 msgr2=0x7f58400ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:32.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 shutdown_connections 2023-10-16T08:51:32.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.671+0000 7f58455d7640 1 -- 172.21.15.94:0/2205108767 wait complete. 2023-10-16T08:51:32.690 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:51:32.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.902+0000 7fb1c9687640 1 Processor -- start 2023-10-16T08:51:32.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.902+0000 7fb1c9687640 1 -- start start 2023-10-16T08:51:32.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c9687640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1c40cb180 0x7fb1c415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c9687640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c415ec80 con 0x7fb1c40cb560 2023-10-16T08:51:32.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c9687640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c415ef60 con 0x7fb1c40cba10 2023-10-16T08:51:32.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c9687640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c415f240 con 0x7fb1c40cb180 2023-10-16T08:51:32.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1ba7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb1c40cb560 0x7fb1c415b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55848/0 (socket says 172.21.15.94:55848) 2023-10-16T08:51:32.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1ba7fc640 1 -- 172.21.15.94:0/985850727 learned_addr learned my addr 172.21.15.94:0/985850727 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:32.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396331773 0 0) 0x7fb1c415ec80 con 0x7fb1c40cb560 2023-10-16T08:51:32.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c2ffd640 1 --2- 172.21.15.94:0/985850727 >> v2:172.21.15.130:3300/0 conn(0x7fb1c40cb180 0x7fb1c415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.904+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b0003520 con 0x7fb1c40cb560 2023-10-16T08:51:32.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2312417134 0 0) 0x7fb1b0003520 con 0x7fb1c40cb560 2023-10-16T08:51:32.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 >> v2:172.21.15.130:3300/0 conn(0x7fb1c40cb180 msgr2=0x7fb1c415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 --2- 172.21.15.94:0/985850727 >> v2:172.21.15.130:3300/0 conn(0x7fb1c40cb180 0x7fb1c415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 >> v1:172.21.15.130:6789/0 conn(0x7fb1c40cba10 legacy=0x7fb1c4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c415b150 con 0x7fb1c40cb560 2023-10-16T08:51:32.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fb1ac001670 con 0x7fb1c40cb560 2023-10-16T08:51:32.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 >> v1:172.21.15.94:6789/0 conn(0x7fb1c40cb560 legacy=0x7fb1c415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1b00039c0 0x7fb1b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b00047c0 0x7fb1b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1b0005180 0x7fb1b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c415f240 con 0x7fb1b0005180 2023-10-16T08:51:32.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b000c050 con 0x7fb1b00047c0 2023-10-16T08:51:32.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b000c210 con 0x7fb1b00039c0 2023-10-16T08:51:32.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1b0005180 0x7fb1b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1ba7fc640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b00047c0 0x7fb1b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.905+0000 7fb1c2ffd640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1b00039c0 0x7fb1b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.906+0000 7fb1c37fe640 1 -- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1b00039c0 msgr2=0x7fb1b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.906+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1b00039c0 0x7fb1b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.906+0000 7fb1c37fe640 1 -- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b00047c0 msgr2=0x7fb1b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:32.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.906+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b00047c0 0x7fb1b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.906+0000 7fb1c37fe640 1 -- 172.21.15.94:0/985850727 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b0003520 con 0x7fb1b0005180 2023-10-16T08:51:32.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.907+0000 7fb1c37fe640 1 -- 172.21.15.94:0/985850727 reap_dead start 2023-10-16T08:51:32.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.907+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1b0005180 0x7fb1b000b980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc004480 tx=0x7fb1b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5111fbc7a345f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.907+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc030400 con 0x7fb1b0005180 2023-10-16T08:51:32.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.907+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc030560 con 0x7fb1b0005180 2023-10-16T08:51:32.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.907+0000 7fb1c27fc640 1 -- 172.21.15.94:0/985850727 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0308f0 con 0x7fb1b0005180 2023-10-16T08:51:32.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 -- 172.21.15.94:0/985850727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1b0005180 msgr2=0x7fb1b000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1b0005180 0x7fb1b000b980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc004480 tx=0x7fb1b00057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 -- 172.21.15.94:0/985850727 shutdown_connections 2023-10-16T08:51:32.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 --2- 172.21.15.94:0/985850727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1b0005180 0x7fb1b000b980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 -- 172.21.15.94:0/985850727 >> 172.21.15.94:0/985850727 conn(0x7fb1c40b0030 msgr2=0x7fb1c40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:32.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 -- 172.21.15.94:0/985850727 shutdown_connections 2023-10-16T08:51:32.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.908+0000 7fb1c9687640 1 -- 172.21.15.94:0/985850727 wait complete. 2023-10-16T08:51:32.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.910+0000 7fb1c9687640 1 Processor -- start 2023-10-16T08:51:32.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.910+0000 7fb1c9687640 1 -- start start 2023-10-16T08:51:32.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c9687640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b0005180 0x7fb1c40c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c9687640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1c4152470 0x7fb1c40cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c9687640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 0x7fb1c40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c9687640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4151710 con 0x7fb1c41528f0 2023-10-16T08:51:32.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c9687640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40b2f50 con 0x7fb1b0005180 2023-10-16T08:51:32.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c9687640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c41519b0 con 0x7fb1c4152470 2023-10-16T08:51:32.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 0x7fb1c40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 0x7fb1c40cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33218/0 (socket says 172.21.15.94:33218) 2023-10-16T08:51:32.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 -- 172.21.15.94:0/929895072 learned_addr learned my addr 172.21.15.94:0/929895072 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:32.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c2ffd640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b0005180 0x7fb1c40c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 -- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1c4152470 msgr2=0x7fb1c40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1ba7fc640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1c4152470 0x7fb1c40cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1c4152470 0x7fb1c40cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 -- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b0005180 msgr2=0x7fb1c40c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:32.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b0005180 0x7fb1c40c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:32.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.911+0000 7fb1c37fe640 1 -- 172.21.15.94:0/929895072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4151c90 con 0x7fb1c41528f0 2023-10-16T08:51:32.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1c2ffd640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b0005180 0x7fb1c40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:32.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1c37fe640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 0x7fb1c40cc610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc000f80 tx=0x7fb1bc003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc006b50 con 0x7fb1c41528f0 2023-10-16T08:51:32.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc006cd0 con 0x7fb1c41528f0 2023-10-16T08:51:32.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c4151f70 con 0x7fb1c41528f0 2023-10-16T08:51:32.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0399e0 con 0x7fb1c41528f0 2023-10-16T08:51:32.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.912+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c40ca370 con 0x7fb1c41528f0 2023-10-16T08:51:32.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.913+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c4152100 con 0x7fb1c41528f0 2023-10-16T08:51:32.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.914+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1bc039b40 con 0x7fb1c41528f0 2023-10-16T08:51:32.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.915+0000 7fb1bbfff640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:32.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.915+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1bc0ab300 con 0x7fb1c41528f0 2023-10-16T08:51:32.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.916+0000 7fb1c2ffd640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:32.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.916+0000 7fb1c2ffd640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1a406ae70 0x7fb1a406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009980 tx=0x7fb1b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:32.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:32.920+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1bc076020 con 0x7fb1c41528f0 2023-10-16T08:51:33.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.110+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1c40ca370 con 0x7fb1c41528f0 2023-10-16T08:51:33.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.111+0000 7fb1bbfff640 1 -- 172.21.15.94:0/929895072 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1c40ca370 con 0x7fb1c41528f0 2023-10-16T08:51:33.113 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:33.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1a406ae70 msgr2=0x7fb1a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1a406ae70 0x7fb1a406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009980 tx=0x7fb1b4008040 comp rx=0 tx=0).stop 2023-10-16T08:51:33.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 msgr2=0x7fb1c40cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 0x7fb1c40cc610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc000f80 tx=0x7fb1bc003ae0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 shutdown_connections 2023-10-16T08:51:33.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1c41528f0 0x7fb1c40cc610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1c4152470 0x7fb1c40cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 --2- 172.21.15.94:0/929895072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1b0005180 0x7fb1c40c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 >> 172.21.15.94:0/929895072 conn(0x7fb1c40b0030 msgr2=0x7fb1c406c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:33.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 shutdown_connections 2023-10-16T08:51:33.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.114+0000 7fb1c9687640 1 -- 172.21.15.94:0/929895072 wait complete. 2023-10-16T08:51:33.133 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:51:33.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.347+0000 7f61912da640 1 Processor -- start 2023-10-16T08:51:33.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.347+0000 7f61912da640 1 -- start start 2023-10-16T08:51:33.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f61912da640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f618c0ca820 0x7f618c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f61912da640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f61912da640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618c072480 con 0x7f618c159890 2023-10-16T08:51:33.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f61912da640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c0cd0c0 con 0x7f618c0ca820 2023-10-16T08:51:33.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f61912da640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0cc540 con 0x7f618c0c8ea0 2023-10-16T08:51:33.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f6183fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f618c0ca820 0x7f618c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f6183fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f618c0ca820 0x7f618c071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33228/0 (socket says 172.21.15.94:33228) 2023-10-16T08:51:33.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.349+0000 7f6183fff640 1 -- 172.21.15.94:0/28339410 learned_addr learned my addr 172.21.15.94:0/28339410 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:33.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.350+0000 7f618b7fe640 1 --2- 172.21.15.94:0/28339410 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.350+0000 7f6183fff640 1 -- 172.21.15.94:0/28339410 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 msgr2=0x7f618c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:33.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.350+0000 7f6183fff640 1 --2- 172.21.15.94:0/28339410 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.350+0000 7f6183fff640 1 -- 172.21.15.94:0/28339410 >> v1:172.21.15.130:6789/0 conn(0x7f618c159890 legacy=0x7f618c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:33.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.350+0000 7f6183fff640 1 -- 172.21.15.94:0/28339410 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0cc820 con 0x7f618c0ca820 2023-10-16T08:51:33.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.351+0000 7f6183fff640 1 --2- 172.21.15.94:0/28339410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c0ca820 0x7f618c071f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f618c0b0fd0 tx=0x7f617402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e74aca3a21f9a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:33.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.351+0000 7f618a7fc640 1 -- 172.21.15.94:0/28339410 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174031830 con 0x7f618c0ca820 2023-10-16T08:51:33.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.351+0000 7f618a7fc640 1 -- 172.21.15.94:0/28339410 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174031990 con 0x7f618c0ca820 2023-10-16T08:51:33.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.351+0000 7f618a7fc640 1 -- 172.21.15.94:0/28339410 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174031d20 con 0x7f618c0ca820 2023-10-16T08:51:33.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 -- 172.21.15.94:0/28339410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c0ca820 msgr2=0x7f618c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 --2- 172.21.15.94:0/28339410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c0ca820 0x7f618c071f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f618c0b0fd0 tx=0x7f617402b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 -- 172.21.15.94:0/28339410 shutdown_connections 2023-10-16T08:51:33.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 --2- 172.21.15.94:0/28339410 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 --2- 172.21.15.94:0/28339410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c0ca820 0x7f618c071f40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 -- 172.21.15.94:0/28339410 >> 172.21.15.94:0/28339410 conn(0x7f618c0b0030 msgr2=0x7f618c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:33.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 -- 172.21.15.94:0/28339410 shutdown_connections 2023-10-16T08:51:33.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.352+0000 7f61912da640 1 -- 172.21.15.94:0/28339410 wait complete. 2023-10-16T08:51:33.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.353+0000 7f61912da640 1 Processor -- start 2023-10-16T08:51:33.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.354+0000 7f61912da640 1 -- start start 2023-10-16T08:51:33.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.354+0000 7f61912da640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.354+0000 7f61912da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c0ca820 0x7f618c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f61912da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 0x7f618c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f61912da640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c15ac60 con 0x7f618c159890 2023-10-16T08:51:33.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f61912da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c15af40 con 0x7f618c0ca820 2023-10-16T08:51:33.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f61912da640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c15b220 con 0x7f618c0c8ea0 2023-10-16T08:51:33.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 0x7f618c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 0x7f618c155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33244/0 (socket says 172.21.15.94:33244) 2023-10-16T08:51:33.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 -- 172.21.15.94:0/956473412 learned_addr learned my addr 172.21.15.94:0/956473412 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:33.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f6183fff640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c0ca820 0x7f618c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 -- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 msgr2=0x7f618c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618affd640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 -- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c0ca820 msgr2=0x7f618c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c0ca820 0x7f618c156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.355+0000 7f618b7fe640 1 -- 172.21.15.94:0/956473412 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740094d0 con 0x7f618c159890 2023-10-16T08:51:33.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.356+0000 7f618b7fe640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 0x7f618c155e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6184007e60 tx=0x7f618400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:33.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.356+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184014420 con 0x7f618c159890 2023-10-16T08:51:33.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.356+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61840145a0 con 0x7f618c159890 2023-10-16T08:51:33.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.356+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c15b500 con 0x7f618c159890 2023-10-16T08:51:33.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.356+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184014950 con 0x7f618c159890 2023-10-16T08:51:33.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.356+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c156ba0 con 0x7f618c159890 2023-10-16T08:51:33.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.357+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c15ba20 con 0x7f618c159890 2023-10-16T08:51:33.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.358+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6184014ab0 con 0x7f618c159890 2023-10-16T08:51:33.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.359+0000 7f61837fe640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f616c06ae70 0x7f616c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.359+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f618408a2f0 con 0x7f618c159890 2023-10-16T08:51:33.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.359+0000 7f618affd640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f616c06ae70 0x7f616c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.360+0000 7f618affd640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f616c06ae70 0x7f616c06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f618c0c4610 tx=0x7f617c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:33.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.364+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f618c15ba20 con 0x7f618c159890 2023-10-16T08:51:33.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.555+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f618c15ba20 con 0x7f618c159890 2023-10-16T08:51:33.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.555+0000 7f61837fe640 1 -- 172.21.15.94:0/956473412 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f618c15ba20 con 0x7f618c159890 2023-10-16T08:51:33.557 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:51:33.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f616c06ae70 msgr2=0x7f616c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f616c06ae70 0x7f616c06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f618c0c4610 tx=0x7f617c009040 comp rx=0 tx=0).stop 2023-10-16T08:51:33.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 msgr2=0x7f618c155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 0x7f618c155e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6184007e60 tx=0x7f618400e4b0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 shutdown_connections 2023-10-16T08:51:33.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f618c159890 0x7f618c155e30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f616c06ae70 0x7f616c06d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f618c0ca820 0x7f618c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 --2- 172.21.15.94:0/956473412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f618c0c8ea0 0x7f618c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 >> 172.21.15.94:0/956473412 conn(0x7f618c0b0030 msgr2=0x7f618c0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:33.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.558+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 shutdown_connections 2023-10-16T08:51:33.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.559+0000 7f61912da640 1 -- 172.21.15.94:0/956473412 wait complete. 2023-10-16T08:51:33.578 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:51:33.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.795+0000 7f7c3213c640 1 Processor -- start 2023-10-16T08:51:33.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.795+0000 7f7c3213c640 1 -- start start 2023-10-16T08:51:33.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.796+0000 7f7c3213c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.796+0000 7f7c3213c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7c2c06d530 0x7f7c2c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.796+0000 7f7c3213c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c1550f0 con 0x7f7c2c0cee60 2023-10-16T08:51:33.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.796+0000 7f7c3213c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c0cf2e0 con 0x7f7c2c06d530 2023-10-16T08:51:33.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.796+0000 7f7c3213c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c06db50 con 0x7f7c2c154d10 2023-10-16T08:51:33.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.797+0000 7f7c3113a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.797+0000 7f7c3193b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7c2c06d530 0x7f7c2c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.797+0000 7f7c3113a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:39704/0 (socket says 172.21.15.94:39704) 2023-10-16T08:51:33.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.797+0000 7f7c3113a640 1 -- 172.21.15.94:0/1136437303 learned_addr learned my addr 172.21.15.94:0/1136437303 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:33.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.798+0000 7f7c3113a640 1 -- 172.21.15.94:0/1136437303 >> v2:172.21.15.130:3300/0 conn(0x7f7c2c06d530 msgr2=0x7f7c2c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:33.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.798+0000 7f7c3113a640 1 --2- 172.21.15.94:0/1136437303 >> v2:172.21.15.130:3300/0 conn(0x7f7c2c06d530 0x7f7c2c0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.798+0000 7f7c3113a640 1 -- 172.21.15.94:0/1136437303 >> v1:172.21.15.130:6789/0 conn(0x7f7c2c0cee60 legacy=0x7f7c2c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.798+0000 7f7c3113a640 1 -- 172.21.15.94:0/1136437303 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0b13f0 con 0x7f7c2c154d10 2023-10-16T08:51:33.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.799+0000 7f7c3113a640 1 --2- 172.21.15.94:0/1136437303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0ce920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009e50 tx=0x7f7c1c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb20f41b7474762e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:33.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.800+0000 7f7c2bfff640 1 -- 172.21.15.94:0/1136437303 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c02cb00 con 0x7f7c2c154d10 2023-10-16T08:51:33.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.800+0000 7f7c2bfff640 1 -- 172.21.15.94:0/1136437303 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c02cc60 con 0x7f7c2c154d10 2023-10-16T08:51:33.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.800+0000 7f7c2bfff640 1 -- 172.21.15.94:0/1136437303 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0343f0 con 0x7f7c2c154d10 2023-10-16T08:51:33.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 -- 172.21.15.94:0/1136437303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 msgr2=0x7f7c2c0ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 --2- 172.21.15.94:0/1136437303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0ce920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009e50 tx=0x7f7c1c02bf60 comp rx=0 tx=0).stop 2023-10-16T08:51:33.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 -- 172.21.15.94:0/1136437303 shutdown_connections 2023-10-16T08:51:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 --2- 172.21.15.94:0/1136437303 >> v2:172.21.15.130:3300/0 conn(0x7f7c2c06d530 0x7f7c2c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 --2- 172.21.15.94:0/1136437303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0ce920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 -- 172.21.15.94:0/1136437303 >> 172.21.15.94:0/1136437303 conn(0x7f7c2c06a200 msgr2=0x7f7c2c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 -- 172.21.15.94:0/1136437303 shutdown_connections 2023-10-16T08:51:33.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.801+0000 7f7c3213c640 1 -- 172.21.15.94:0/1136437303 wait complete. 2023-10-16T08:51:33.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.803+0000 7f7c3213c640 1 Processor -- start 2023-10-16T08:51:33.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.803+0000 7f7c3213c640 1 -- start start 2023-10-16T08:51:33.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c3213c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c2c06d530 0x7f7c2c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c3213c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 0x7f7c2c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c3213c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c3213c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c156cc0 con 0x7f7c2c0cee60 2023-10-16T08:51:33.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c3213c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c158d20 con 0x7f7c2c06d530 2023-10-16T08:51:33.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c3213c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c158fa0 con 0x7f7c2c154d10 2023-10-16T08:51:33.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c30939640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 0x7f7c2c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c30939640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 0x7f7c2c1587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33250/0 (socket says 172.21.15.94:33250) 2023-10-16T08:51:33.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.804+0000 7f7c30939640 1 -- 172.21.15.94:0/2048995044 learned_addr learned my addr 172.21.15.94:0/2048995044 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:33.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c3113a640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c2c06d530 0x7f7c2c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c3193b640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c30939640 1 -- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 msgr2=0x7f7c2c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c30939640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c30939640 1 -- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c2c06d530 msgr2=0x7f7c2c0c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:33.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c30939640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c2c06d530 0x7f7c2c0c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:33.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c30939640 1 -- 172.21.15.94:0/2048995044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009b30 con 0x7f7c2c0cee60 2023-10-16T08:51:33.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c3113a640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c2c06d530 0x7f7c2c0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:33.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c3193b640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:33.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c30939640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 0x7f7c2c1587e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c3c0 tx=0x7f7c2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:33.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200052d0 con 0x7f7c2c0cee60 2023-10-16T08:51:33.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20005450 con 0x7f7c2c0cee60 2023-10-16T08:51:33.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c159280 con 0x7f7c2c0cee60 2023-10-16T08:51:33.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20007260 con 0x7f7c2c0cee60 2023-10-16T08:51:33.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.805+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c159840 con 0x7f7c2c0cee60 2023-10-16T08:51:33.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.806+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c156e30 con 0x7f7c2c0cee60 2023-10-16T08:51:33.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.807+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c200073c0 con 0x7f7c2c0cee60 2023-10-16T08:51:33.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.808+0000 7f7c29ffb640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7c1806ae70 0x7f7c1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:33.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.808+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c20088c10 con 0x7f7c2c0cee60 2023-10-16T08:51:33.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.808+0000 7f7c3113a640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7c1806ae70 0x7f7c1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:33.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.809+0000 7f7c3113a640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7c1806ae70 0x7f7c1806d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c035000 tx=0x7f7c1c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:33.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:33.812+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c20053a60 con 0x7f7c2c0cee60 2023-10-16T08:51:34.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.002+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7c2c04e9b0 con 0x7f7c2c0cee60 2023-10-16T08:51:34.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.003+0000 7f7c29ffb640 1 -- 172.21.15.94:0/2048995044 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7c20057080 con 0x7f7c2c0cee60 2023-10-16T08:51:34.004 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:34.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.005+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7c1806ae70 msgr2=0x7f7c1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.005+0000 7f7c3213c640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7c1806ae70 0x7f7c1806d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c035000 tx=0x7f7c1c030000 comp rx=0 tx=0).stop 2023-10-16T08:51:34.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 msgr2=0x7f7c2c1587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 0x7f7c2c1587e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c3c0 tx=0x7f7c2000c880 comp rx=0 tx=0).stop 2023-10-16T08:51:34.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 shutdown_connections 2023-10-16T08:51:34.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c2c154d10 0x7f7c2c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c2c0cee60 0x7f7c2c1587e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7c1806ae70 0x7f7c1806d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 --2- 172.21.15.94:0/2048995044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c2c06d530 0x7f7c2c0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 >> 172.21.15.94:0/2048995044 conn(0x7f7c2c06a200 msgr2=0x7f7c2c0ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:34.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 shutdown_connections 2023-10-16T08:51:34.010 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.006+0000 7f7c3213c640 1 -- 172.21.15.94:0/2048995044 wait complete. 2023-10-16T08:51:34.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:51:34.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.238+0000 7f0a54cea640 1 Processor -- start 2023-10-16T08:51:34.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.239+0000 7f0a54cea640 1 -- start start 2023-10-16T08:51:34.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a54cea640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0a5015cc90 0x7f0a500d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a54cea640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500d3760 con 0x7f0a500cfe70 2023-10-16T08:51:34.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a54cea640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500cf9e0 con 0x7f0a500d05c0 2023-10-16T08:51:34.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a54cea640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5015d070 con 0x7f0a5015cc90 2023-10-16T08:51:34.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a4f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0a5015cc90 0x7f0a500d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a47fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0a500cfe70 0x7f0a5006af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55862/0 (socket says 172.21.15.94:55862) 2023-10-16T08:51:34.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.240+0000 7f0a47fff640 1 -- 172.21.15.94:0/4062698477 learned_addr learned my addr 172.21.15.94:0/4062698477 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:34.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.241+0000 7f0a4f7fe640 1 -- 172.21.15.94:0/4062698477 >> v1:172.21.15.130:6789/0 conn(0x7f0a500d05c0 legacy=0x7f0a5006b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:34.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.241+0000 7f0a4f7fe640 1 -- 172.21.15.94:0/4062698477 >> v1:172.21.15.94:6789/0 conn(0x7f0a500cfe70 legacy=0x7f0a5006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.241+0000 7f0a4f7fe640 1 -- 172.21.15.94:0/4062698477 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5006bd80 con 0x7f0a5015cc90 2023-10-16T08:51:34.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.241+0000 7f0a4effd640 1 -- 172.21.15.94:0/4062698477 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936167508 0 0) 0x7f0a500d3760 con 0x7f0a500cfe70 2023-10-16T08:51:34.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.242+0000 7f0a4f7fe640 1 --2- 172.21.15.94:0/4062698477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a5015cc90 0x7f0a500d0dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a400097d0 tx=0x7f0a4002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11695304edede1f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:34.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.242+0000 7f0a4effd640 1 -- 172.21.15.94:0/4062698477 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40031780 con 0x7f0a5015cc90 2023-10-16T08:51:34.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.242+0000 7f0a4effd640 1 -- 172.21.15.94:0/4062698477 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400318e0 con 0x7f0a5015cc90 2023-10-16T08:51:34.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.242+0000 7f0a4effd640 1 -- 172.21.15.94:0/4062698477 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40031c70 con 0x7f0a5015cc90 2023-10-16T08:51:34.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 -- 172.21.15.94:0/4062698477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a5015cc90 msgr2=0x7f0a500d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 --2- 172.21.15.94:0/4062698477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a5015cc90 0x7f0a500d0dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a400097d0 tx=0x7f0a4002b820 comp rx=0 tx=0).stop 2023-10-16T08:51:34.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 -- 172.21.15.94:0/4062698477 shutdown_connections 2023-10-16T08:51:34.247 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 --2- 172.21.15.94:0/4062698477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a5015cc90 0x7f0a500d0dc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.247 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 -- 172.21.15.94:0/4062698477 >> 172.21.15.94:0/4062698477 conn(0x7f0a500d27e0 msgr2=0x7f0a500d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:34.247 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 -- 172.21.15.94:0/4062698477 shutdown_connections 2023-10-16T08:51:34.247 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.243+0000 7f0a54cea640 1 -- 172.21.15.94:0/4062698477 wait complete. 2023-10-16T08:51:34.247 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.244+0000 7f0a54cea640 1 Processor -- start 2023-10-16T08:51:34.248 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.245+0000 7f0a54cea640 1 -- start start 2023-10-16T08:51:34.250 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.245+0000 7f0a54cea640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0a500cfe70 0x7f0a5014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.250 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a54cea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 0x7f0a5015f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.250 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a54cea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a5015cc90 0x7f0a5015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a54cea640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500b2e60 con 0x7f0a500d05c0 2023-10-16T08:51:34.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a54cea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5014f180 con 0x7f0a5015cc90 2023-10-16T08:51:34.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a54cea640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500b3280 con 0x7f0a500cfe70 2023-10-16T08:51:34.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 0x7f0a5015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 0x7f0a5015f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33282/0 (socket says 172.21.15.94:33282) 2023-10-16T08:51:34.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 -- 172.21.15.94:0/774760479 learned_addr learned my addr 172.21.15.94:0/774760479 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:34.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a4f7fe640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0a500cfe70 0x7f0a5014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 -- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0a500cfe70 msgr2=0x7f0a5014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0a500cfe70 0x7f0a5014ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a4ffff640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a5015cc90 0x7f0a5015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 -- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a5015cc90 msgr2=0x7f0a5015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a5015cc90 0x7f0a5015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a47fff640 1 -- 172.21.15.94:0/774760479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009400 con 0x7f0a500d05c0 2023-10-16T08:51:34.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.246+0000 7f0a4ffff640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a5015cc90 0x7f0a5015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:34.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.247+0000 7f0a47fff640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 0x7f0a5015f630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c440 tx=0x7f0a3800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:34.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.247+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380074e0 con 0x7f0a500d05c0 2023-10-16T08:51:34.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.247+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38007640 con 0x7f0a500d05c0 2023-10-16T08:51:34.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.247+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a500b21e0 con 0x7f0a500d05c0 2023-10-16T08:51:34.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.247+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38004a20 con 0x7f0a500d05c0 2023-10-16T08:51:34.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.247+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a500b27a0 con 0x7f0a500d05c0 2023-10-16T08:51:34.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.248+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a500b2fa0 con 0x7f0a500d05c0 2023-10-16T08:51:34.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.249+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a38004b80 con 0x7f0a500d05c0 2023-10-16T08:51:34.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.250+0000 7f0a4cff9640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0a3406ae70 0x7f0a3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.250+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a38088a40 con 0x7f0a500d05c0 2023-10-16T08:51:34.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.251+0000 7f0a4f7fe640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0a3406ae70 0x7f0a3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.251+0000 7f0a4f7fe640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0a3406ae70 0x7f0a3406d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a40036000 tx=0x7f0a4003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:34.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.255+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a500b2fa0 con 0x7f0a500d05c0 2023-10-16T08:51:34.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.458+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0a500b2fa0 con 0x7f0a500d05c0 2023-10-16T08:51:34.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.459+0000 7f0a4cff9640 1 -- 172.21.15.94:0/774760479 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0a500b2fa0 con 0x7f0a500d05c0 2023-10-16T08:51:34.460 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:51:34.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.461+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0a3406ae70 msgr2=0x7f0a3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.461+0000 7f0a54cea640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0a3406ae70 0x7f0a3406d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a40036000 tx=0x7f0a4003d040 comp rx=0 tx=0).stop 2023-10-16T08:51:34.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.461+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 msgr2=0x7f0a5015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.461+0000 7f0a54cea640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 0x7f0a5015f630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c440 tx=0x7f0a3800c900 comp rx=0 tx=0).stop 2023-10-16T08:51:34.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 shutdown_connections 2023-10-16T08:51:34.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0a3406ae70 0x7f0a3406d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a5015cc90 0x7f0a5015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a500d05c0 0x7f0a5015f630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 --2- 172.21.15.94:0/774760479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0a500cfe70 0x7f0a5014ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 >> 172.21.15.94:0/774760479 conn(0x7f0a500d27e0 msgr2=0x7f0a5006af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 shutdown_connections 2023-10-16T08:51:34.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.462+0000 7f0a54cea640 1 -- 172.21.15.94:0/774760479 wait complete. 2023-10-16T08:51:34.483 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:51:34.483 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:51:34.538 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:34.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.758+0000 7facc9664640 1 Processor -- start 2023-10-16T08:51:34.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.759+0000 7facc9664640 1 -- start start 2023-10-16T08:51:34.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc9664640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7facc40701a0 0x7facc415f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc9664640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc415f580 con 0x7facc40b0010 2023-10-16T08:51:34.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc9664640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc40707f0 con 0x7facc415ad00 2023-10-16T08:51:34.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc9664640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc40705d0 con 0x7facc40701a0 2023-10-16T08:51:34.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc37fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7facc40701a0 0x7facc415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc2ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7facc40b0010 0x7facc40b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48690/0 (socket says 172.21.15.94:48690) 2023-10-16T08:51:34.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc2ffd640 1 -- 172.21.15.94:0/2268898525 learned_addr learned my addr 172.21.15.94:0/2268898525 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:34.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.760+0000 7facc37fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7facc40701a0 0x7facc415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37880/0 (socket says 172.21.15.94:37880) 2023-10-16T08:51:34.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.761+0000 7facc37fe640 1 -- 172.21.15.94:0/2268898525 >> v1:172.21.15.130:6789/0 conn(0x7facc415ad00 legacy=0x7facc415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:34.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.761+0000 7facc37fe640 1 -- 172.21.15.94:0/2268898525 >> v1:172.21.15.94:6789/0 conn(0x7facc40b0010 legacy=0x7facc40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.761+0000 7facc37fe640 1 -- 172.21.15.94:0/2268898525 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4070ad0 con 0x7facc40701a0 2023-10-16T08:51:34.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.762+0000 7facc37fe640 1 --2- 172.21.15.94:0/2268898525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40701a0 0x7facc415f040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facbc009d90 tx=0x7facbc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5423d168a7e4fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:34.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.762+0000 7facc27fc640 1 -- 172.21.15.94:0/2268898525 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc02cc60 con 0x7facc40701a0 2023-10-16T08:51:34.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.762+0000 7facc27fc640 1 -- 172.21.15.94:0/2268898525 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc02cdc0 con 0x7facc40701a0 2023-10-16T08:51:34.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.762+0000 7facc27fc640 1 -- 172.21.15.94:0/2268898525 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc034660 con 0x7facc40701a0 2023-10-16T08:51:34.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 -- 172.21.15.94:0/2268898525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40701a0 msgr2=0x7facc415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 --2- 172.21.15.94:0/2268898525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40701a0 0x7facc415f040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facbc009d90 tx=0x7facbc02beb0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 -- 172.21.15.94:0/2268898525 shutdown_connections 2023-10-16T08:51:34.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 --2- 172.21.15.94:0/2268898525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40701a0 0x7facc415f040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 -- 172.21.15.94:0/2268898525 >> 172.21.15.94:0/2268898525 conn(0x7facc406c1c0 msgr2=0x7facc406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:34.767 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 -- 172.21.15.94:0/2268898525 shutdown_connections 2023-10-16T08:51:34.767 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.763+0000 7facc9664640 1 -- 172.21.15.94:0/2268898525 wait complete. 2023-10-16T08:51:34.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.765+0000 7facc9664640 1 Processor -- start 2023-10-16T08:51:34.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.765+0000 7facc9664640 1 -- start start 2023-10-16T08:51:34.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc9664640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7facc40701a0 0x7facc415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc9664640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 0x7facc41f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc9664640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facc415ad00 0x7facc415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc9664640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40af640 con 0x7facc40b0010 2023-10-16T08:51:34.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc9664640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40acc40 con 0x7facc415ad00 2023-10-16T08:51:34.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc9664640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc415ea70 con 0x7facc40701a0 2023-10-16T08:51:34.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 0x7facc41f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 0x7facc41f1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37896/0 (socket says 172.21.15.94:37896) 2023-10-16T08:51:34.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 -- 172.21.15.94:0/1548815460 learned_addr learned my addr 172.21.15.94:0/1548815460 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:34.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc2ffd640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7facc40701a0 0x7facc415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facc37fe640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facc415ad00 0x7facc415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 -- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7facc40701a0 msgr2=0x7facc415e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7facc40701a0 0x7facc415e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 -- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facc415ad00 msgr2=0x7facc415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facc415ad00 0x7facc415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.766+0000 7facba7fc640 1 -- 172.21.15.94:0/1548815460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc009a70 con 0x7facc40b0010 2023-10-16T08:51:34.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.767+0000 7facba7fc640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 0x7facc41f1d30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facac00b3c0 tx=0x7facac00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:34.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.767+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011830 con 0x7facc40b0010 2023-10-16T08:51:34.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.767+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac011990 con 0x7facc40b0010 2023-10-16T08:51:34.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.767+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc40ac310 con 0x7facc40b0010 2023-10-16T08:51:34.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.767+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011d80 con 0x7facc40b0010 2023-10-16T08:51:34.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.767+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc40ac8d0 con 0x7facc40b0010 2023-10-16T08:51:34.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.768+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc4073ef0 con 0x7facc40b0010 2023-10-16T08:51:34.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.769+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7facac01b460 con 0x7facc40b0010 2023-10-16T08:51:34.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.770+0000 7facbbfff640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faca406ae70 0x7faca406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:34.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.770+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facac0894e0 con 0x7facc40b0010 2023-10-16T08:51:34.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.770+0000 7facc2ffd640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faca406ae70 0x7faca406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:34.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.771+0000 7facc2ffd640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faca406ae70 0x7faca406d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facb4005880 tx=0x7facb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:34.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.775+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7facac054290 con 0x7facc40b0010 2023-10-16T08:51:34.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.967+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facc406ca00 con 0x7facc40b0010 2023-10-16T08:51:34.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.970+0000 7facbbfff640 1 -- 172.21.15.94:0/1548815460 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7facac0578b0 con 0x7facc40b0010 2023-10-16T08:51:34.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:34.972 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:34.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faca406ae70 msgr2=0x7faca406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faca406ae70 0x7faca406d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facb4005880 tx=0x7facb4009040 comp rx=0 tx=0).stop 2023-10-16T08:51:34.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 msgr2=0x7facc41f1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 0x7facc41f1d30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facac00b3c0 tx=0x7facac00b880 comp rx=0 tx=0).stop 2023-10-16T08:51:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 shutdown_connections 2023-10-16T08:51:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faca406ae70 0x7faca406d330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7facc415ad00 0x7facc415c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facc40b0010 0x7facc41f1d30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 --2- 172.21.15.94:0/1548815460 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7facc40701a0 0x7facc415e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 >> 172.21.15.94:0/1548815460 conn(0x7facc406c1c0 msgr2=0x7facc40ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 shutdown_connections 2023-10-16T08:51:34.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:34.973+0000 7facc9664640 1 -- 172.21.15.94:0/1548815460 wait complete. 2023-10-16T08:51:34.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:51:34.994 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:51:35.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.208+0000 7fc107ec9640 1 Processor -- start 2023-10-16T08:51:35.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.209+0000 7fc107ec9640 1 -- start start 2023-10-16T08:51:35.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc107ec9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc10015a830 0x7fc1000cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc107ec9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc1000ca550 0x7fc100070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc107ec9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000cf040 con 0x7fc100070860 2023-10-16T08:51:35.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc107ec9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc100070cf0 con 0x7fc1000ca550 2023-10-16T08:51:35.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc107ec9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000ca9e0 con 0x7fc10015a830 2023-10-16T08:51:35.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc105464640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc1000ca550 0x7fc100070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc106466640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc100070860 0x7fc10015e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48694/0 (socket says 172.21.15.94:48694) 2023-10-16T08:51:35.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.210+0000 7fc106466640 1 -- 172.21.15.94:0/1985691428 learned_addr learned my addr 172.21.15.94:0/1985691428 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:35.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.211+0000 7fc105c65640 1 --2- 172.21.15.94:0/1985691428 >> v2:172.21.15.130:3300/0 conn(0x7fc10015a830 0x7fc1000cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.211+0000 7fc105464640 1 -- 172.21.15.94:0/1985691428 >> v2:172.21.15.130:3300/0 conn(0x7fc10015a830 msgr2=0x7fc1000cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.211+0000 7fc105464640 1 --2- 172.21.15.94:0/1985691428 >> v2:172.21.15.130:3300/0 conn(0x7fc10015a830 0x7fc1000cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.211+0000 7fc105464640 1 -- 172.21.15.94:0/1985691428 >> v1:172.21.15.94:6789/0 conn(0x7fc100070860 legacy=0x7fc10015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.211+0000 7fc105464640 1 -- 172.21.15.94:0/1985691428 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000ce430 con 0x7fc1000ca550 2023-10-16T08:51:35.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.212+0000 7fc105464640 1 --2- 172.21.15.94:0/1985691428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1000ca550 0x7fc100070320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc1000cf570 tx=0x7fc0f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6804d83a8d967e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:35.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.212+0000 7fc104c63640 1 -- 172.21.15.94:0/1985691428 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0031830 con 0x7fc1000ca550 2023-10-16T08:51:35.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.212+0000 7fc104c63640 1 -- 172.21.15.94:0/1985691428 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0031990 con 0x7fc1000ca550 2023-10-16T08:51:35.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.212+0000 7fc104c63640 1 -- 172.21.15.94:0/1985691428 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0031d20 con 0x7fc1000ca550 2023-10-16T08:51:35.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 -- 172.21.15.94:0/1985691428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1000ca550 msgr2=0x7fc100070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 --2- 172.21.15.94:0/1985691428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1000ca550 0x7fc100070320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc1000cf570 tx=0x7fc0f002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 -- 172.21.15.94:0/1985691428 shutdown_connections 2023-10-16T08:51:35.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 --2- 172.21.15.94:0/1985691428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1000ca550 0x7fc100070320 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 --2- 172.21.15.94:0/1985691428 >> v2:172.21.15.130:3300/0 conn(0x7fc10015a830 0x7fc1000cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 -- 172.21.15.94:0/1985691428 >> 172.21.15.94:0/1985691428 conn(0x7fc1000b0030 msgr2=0x7fc1000b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:35.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 -- 172.21.15.94:0/1985691428 shutdown_connections 2023-10-16T08:51:35.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.213+0000 7fc107ec9640 1 -- 172.21.15.94:0/1985691428 wait complete. 2023-10-16T08:51:35.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.215+0000 7fc107ec9640 1 Processor -- start 2023-10-16T08:51:35.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.215+0000 7fc107ec9640 1 -- start start 2023-10-16T08:51:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc107ec9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc100070860 0x7fc1000c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc107ec9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1000ca550 0x7fc1000ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc107ec9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 0x7fc1001f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc107ec9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100150e20 con 0x7fc10015a830 2023-10-16T08:51:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc107ec9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000a8440 con 0x7fc1000ca550 2023-10-16T08:51:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc107ec9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000a8160 con 0x7fc100070860 2023-10-16T08:51:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc106466640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 0x7fc1001f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc106466640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 0x7fc1001f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37918/0 (socket says 172.21.15.94:37918) 2023-10-16T08:51:35.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.216+0000 7fc106466640 1 -- 172.21.15.94:0/4127886802 learned_addr learned my addr 172.21.15.94:0/4127886802 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:35.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc105464640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1000ca550 0x7fc1000ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc105c65640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc100070860 0x7fc1000c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc106466640 1 -- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc100070860 msgr2=0x7fc1000c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc106466640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc100070860 0x7fc1000c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc106466640 1 -- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1000ca550 msgr2=0x7fc1000ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc106466640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1000ca550 0x7fc1000ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc106466640 1 -- 172.21.15.94:0/4127886802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0009400 con 0x7fc10015a830 2023-10-16T08:51:35.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc106466640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 0x7fc1001f1660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800cbc0 tx=0x7fc0f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:35.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800ad40 con 0x7fc10015a830 2023-10-16T08:51:35.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8012400 con 0x7fc10015a830 2023-10-16T08:51:35.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1000c7c40 con 0x7fc10015a830 2023-10-16T08:51:35.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800aea0 con 0x7fc10015a830 2023-10-16T08:51:35.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.217+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1000c8200 con 0x7fc10015a830 2023-10-16T08:51:35.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.219+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1000c83f0 con 0x7fc10015a830 2023-10-16T08:51:35.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.220+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc0f8007070 con 0x7fc10015a830 2023-10-16T08:51:35.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.220+0000 7fc0f67fc640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc0e406ae70 0x7fc0e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.221+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0f80897e0 con 0x7fc10015a830 2023-10-16T08:51:35.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.221+0000 7fc105c65640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc0e406ae70 0x7fc0e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.221+0000 7fc105c65640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc0e406ae70 0x7fc0e406d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006fd0 tx=0x7fc0fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:35.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.225+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0f8054650 con 0x7fc10015a830 2023-10-16T08:51:35.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.414+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1000ceca0 con 0x7fc10015a830 2023-10-16T08:51:35.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.414+0000 7fc0f67fc640 1 -- 172.21.15.94:0/4127886802 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0f80170a0 con 0x7fc10015a830 2023-10-16T08:51:35.416 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:51:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc0e406ae70 msgr2=0x7fc0e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc0e406ae70 0x7fc0e406d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006fd0 tx=0x7fc0fc008040 comp rx=0 tx=0).stop 2023-10-16T08:51:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 msgr2=0x7fc1001f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 0x7fc1001f1660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800cbc0 tx=0x7fc0f800a430 comp rx=0 tx=0).stop 2023-10-16T08:51:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 shutdown_connections 2023-10-16T08:51:35.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc10015a830 0x7fc1001f1660 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc0e406ae70 0x7fc0e406d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1000ca550 0x7fc1000ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 --2- 172.21.15.94:0/4127886802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc100070860 0x7fc1000c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 >> 172.21.15.94:0/4127886802 conn(0x7fc1000b0030 msgr2=0x7fc1000af840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:35.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 shutdown_connections 2023-10-16T08:51:35.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.417+0000 7fc107ec9640 1 -- 172.21.15.94:0/4127886802 wait complete. 2023-10-16T08:51:35.437 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:51:35.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.655+0000 7f12b2d39640 1 Processor -- start 2023-10-16T08:51:35.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.655+0000 7f12b2d39640 1 -- start start 2023-10-16T08:51:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12b2d39640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12ac0ca820 0x7f12ac071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12b2d39640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f12ac0c8ea0 0x7f12ac0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12b2d39640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac072480 con 0x7f12ac159890 2023-10-16T08:51:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12b2d39640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0cd0c0 con 0x7f12ac0ca820 2023-10-16T08:51:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12b2d39640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0cc540 con 0x7f12ac0c8ea0 2023-10-16T08:51:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12abfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12ac0ca820 0x7f12ac071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12abfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f12ac0ca820 0x7f12ac071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37924/0 (socket says 172.21.15.94:37924) 2023-10-16T08:51:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12abfff640 1 -- 172.21.15.94:0/4075727 learned_addr learned my addr 172.21.15.94:0/4075727 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.657+0000 7f12b12d6640 1 --2- 172.21.15.94:0/4075727 >> v2:172.21.15.130:3300/0 conn(0x7f12ac0c8ea0 0x7f12ac0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.658+0000 7f12abfff640 1 -- 172.21.15.94:0/4075727 >> v2:172.21.15.130:3300/0 conn(0x7f12ac0c8ea0 msgr2=0x7f12ac0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.658+0000 7f12abfff640 1 --2- 172.21.15.94:0/4075727 >> v2:172.21.15.130:3300/0 conn(0x7f12ac0c8ea0 0x7f12ac0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.658+0000 7f12abfff640 1 -- 172.21.15.94:0/4075727 >> v1:172.21.15.130:6789/0 conn(0x7f12ac159890 legacy=0x7f12ac0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.658+0000 7f12abfff640 1 -- 172.21.15.94:0/4075727 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0cc820 con 0x7f12ac0ca820 2023-10-16T08:51:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.659+0000 7f12abfff640 1 --2- 172.21.15.94:0/4075727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0ca820 0x7f12ac071f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0b0fd0 tx=0x7f129802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f424e82f757f38cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.659+0000 7f12ab7fe640 1 -- 172.21.15.94:0/4075727 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298031870 con 0x7f12ac0ca820 2023-10-16T08:51:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.659+0000 7f12ab7fe640 1 -- 172.21.15.94:0/4075727 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980319d0 con 0x7f12ac0ca820 2023-10-16T08:51:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.659+0000 7f12ab7fe640 1 -- 172.21.15.94:0/4075727 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298031d60 con 0x7f12ac0ca820 2023-10-16T08:51:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 -- 172.21.15.94:0/4075727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0ca820 msgr2=0x7f12ac071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 --2- 172.21.15.94:0/4075727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0ca820 0x7f12ac071f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0b0fd0 tx=0x7f129802b910 comp rx=0 tx=0).stop 2023-10-16T08:51:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 -- 172.21.15.94:0/4075727 shutdown_connections 2023-10-16T08:51:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 --2- 172.21.15.94:0/4075727 >> v2:172.21.15.130:3300/0 conn(0x7f12ac0c8ea0 0x7f12ac0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 --2- 172.21.15.94:0/4075727 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac0ca820 0x7f12ac071f40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 -- 172.21.15.94:0/4075727 >> 172.21.15.94:0/4075727 conn(0x7f12ac0b0030 msgr2=0x7f12ac0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 -- 172.21.15.94:0/4075727 shutdown_connections 2023-10-16T08:51:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.660+0000 7f12b2d39640 1 -- 172.21.15.94:0/4075727 wait complete. 2023-10-16T08:51:35.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.662+0000 7f12b2d39640 1 Processor -- start 2023-10-16T08:51:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.662+0000 7f12b2d39640 1 -- start start 2023-10-16T08:51:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b2d39640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12ac0c8ea0 0x7f12ac153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b2d39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12ac0ca820 0x7f12ac1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b2d39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 0x7f12ac1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b2d39640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac154350 con 0x7f12ac159890 2023-10-16T08:51:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b2d39640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0ad1f0 con 0x7f12ac0ca820 2023-10-16T08:51:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b2d39640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0acf10 con 0x7f12ac0c8ea0 2023-10-16T08:51:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b12d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 0x7f12ac1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b12d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 0x7f12ac1f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37934/0 (socket says 172.21.15.94:37934) 2023-10-16T08:51:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.663+0000 7f12b12d6640 1 -- 172.21.15.94:0/456482217 learned_addr learned my addr 172.21.15.94:0/456482217 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b0ad5640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12ac0c8ea0 0x7f12ac153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12abfff640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12ac0ca820 0x7f12ac1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b12d6640 1 -- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12ac0c8ea0 msgr2=0x7f12ac153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b12d6640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12ac0c8ea0 0x7f12ac153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b12d6640 1 -- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12ac0ca820 msgr2=0x7f12ac1f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b12d6640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12ac0ca820 0x7f12ac1f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b12d6640 1 -- 172.21.15.94:0/456482217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980094d0 con 0x7f12ac159890 2023-10-16T08:51:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b0ad5640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12ac0c8ea0 0x7f12ac153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12abfff640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12ac0ca820 0x7f12ac1f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b12d6640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 0x7f12ac1f5ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12a4007e60 tx=0x7f12a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4014420 con 0x7f12ac159890 2023-10-16T08:51:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40145a0 con 0x7f12ac159890 2023-10-16T08:51:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4014950 con 0x7f12ac159890 2023-10-16T08:51:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.664+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac159da0 con 0x7f12ac159890 2023-10-16T08:51:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.665+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac15a360 con 0x7f12ac159890 2023-10-16T08:51:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.666+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac15a550 con 0x7f12ac159890 2023-10-16T08:51:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.667+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f12a4014ab0 con 0x7f12ac159890 2023-10-16T08:51:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.668+0000 7f12a97fa640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f129006ae70 0x7f129006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.668+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12a408a250 con 0x7f12ac159890 2023-10-16T08:51:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.668+0000 7f12b0ad5640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f129006ae70 0x7f129006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.669+0000 7f12b0ad5640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f129006ae70 0x7f129006d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12a0007fd0 tx=0x7f12a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:35.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.672+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12a4055000 con 0x7f12ac159890 2023-10-16T08:51:35.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.862+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12ac073ef0 con 0x7f12ac159890 2023-10-16T08:51:35.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.863+0000 7f12a97fa640 1 -- 172.21.15.94:0/456482217 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12a4058620 con 0x7f12ac159890 2023-10-16T08:51:35.864 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.865+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f129006ae70 msgr2=0x7f129006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.865+0000 7f12b2d39640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f129006ae70 0x7f129006d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12a0007fd0 tx=0x7f12a0009040 comp rx=0 tx=0).stop 2023-10-16T08:51:35.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 msgr2=0x7f12ac1f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:35.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 0x7f12ac1f5ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12a4007e60 tx=0x7f12a400e4b0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 shutdown_connections 2023-10-16T08:51:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12ac159890 0x7f12ac1f5ff0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f129006ae70 0x7f129006d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12ac0ca820 0x7f12ac1f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 --2- 172.21.15.94:0/456482217 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12ac0c8ea0 0x7f12ac153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:35.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 >> 172.21.15.94:0/456482217 conn(0x7f12ac0b0030 msgr2=0x7f12ac0adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:35.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 shutdown_connections 2023-10-16T08:51:35.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:35.866+0000 7f12b2d39640 1 -- 172.21.15.94:0/456482217 wait complete. 2023-10-16T08:51:35.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:51:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.103+0000 7f4d5ad41640 1 Processor -- start 2023-10-16T08:51:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.103+0000 7f4d5ad41640 1 -- start start 2023-10-16T08:51:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d5ad41640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4d5415a830 0x7f4d540cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d5ad41640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d54070a30 0x7f4d540c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d5ad41640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540cf040 con 0x7f4d540ca550 2023-10-16T08:51:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d5ad41640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540ca9e0 con 0x7f4d54070a30 2023-10-16T08:51:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d5ad41640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540ce430 con 0x7f4d5415a830 2023-10-16T08:51:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d592de640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d54070a30 0x7f4d540c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.105+0000 7f4d592de640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4d54070a30 0x7f4d540c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37938/0 (socket says 172.21.15.94:37938) 2023-10-16T08:51:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.106+0000 7f4d592de640 1 -- 172.21.15.94:0/2660469287 learned_addr learned my addr 172.21.15.94:0/2660469287 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.106+0000 7f4d58add640 1 --2- 172.21.15.94:0/2660469287 >> v2:172.21.15.130:3300/0 conn(0x7f4d5415a830 0x7f4d540cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.106+0000 7f4d592de640 1 -- 172.21.15.94:0/2660469287 >> v2:172.21.15.130:3300/0 conn(0x7f4d5415a830 msgr2=0x7f4d540cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.106+0000 7f4d592de640 1 --2- 172.21.15.94:0/2660469287 >> v2:172.21.15.130:3300/0 conn(0x7f4d5415a830 0x7f4d540cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.106+0000 7f4d592de640 1 -- 172.21.15.94:0/2660469287 >> v1:172.21.15.130:6789/0 conn(0x7f4d540ca550 legacy=0x7f4d54070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.106+0000 7f4d592de640 1 -- 172.21.15.94:0/2660469287 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540ce710 con 0x7f4d54070a30 2023-10-16T08:51:36.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.107+0000 7f4d592de640 1 --2- 172.21.15.94:0/2660469287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d54070a30 0x7f4d540c8b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cf570 tx=0x7f4d4c0302f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6e3df76197651c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.107+0000 7f4d537fe640 1 -- 172.21.15.94:0/2660469287 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c030e90 con 0x7f4d54070a30 2023-10-16T08:51:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.107+0000 7f4d537fe640 1 -- 172.21.15.94:0/2660469287 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c0383f0 con 0x7f4d54070a30 2023-10-16T08:51:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.107+0000 7f4d537fe640 1 -- 172.21.15.94:0/2660469287 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c038780 con 0x7f4d54070a30 2023-10-16T08:51:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 -- 172.21.15.94:0/2660469287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d54070a30 msgr2=0x7f4d540c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/2660469287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d54070a30 0x7f4d540c8b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d540cf570 tx=0x7f4d4c0302f0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 -- 172.21.15.94:0/2660469287 shutdown_connections 2023-10-16T08:51:36.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/2660469287 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d54070a30 0x7f4d540c8b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/2660469287 >> v2:172.21.15.130:3300/0 conn(0x7f4d5415a830 0x7f4d540cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 -- 172.21.15.94:0/2660469287 >> 172.21.15.94:0/2660469287 conn(0x7f4d540b0030 msgr2=0x7f4d540b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:36.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 -- 172.21.15.94:0/2660469287 shutdown_connections 2023-10-16T08:51:36.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.108+0000 7f4d5ad41640 1 -- 172.21.15.94:0/2660469287 wait complete. 2023-10-16T08:51:36.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.111+0000 7f4d5ad41640 1 Processor -- start 2023-10-16T08:51:36.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.111+0000 7f4d5ad41640 1 -- start start 2023-10-16T08:51:36.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d5ad41640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d54070a30 0x7f4d54149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d5ad41640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 0x7f4d5415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d5ad41640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d5415a830 0x7f4d5415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d5ad41640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c29d0 con 0x7f4d540ca550 2023-10-16T08:51:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d5ad41640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54156450 con 0x7f4d5415a830 2023-10-16T08:51:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d5ad41640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415bdc0 con 0x7f4d54070a30 2023-10-16T08:51:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d53fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 0x7f4d5415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.112+0000 7f4d53fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 0x7f4d5415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37942/0 (socket says 172.21.15.94:37942) 2023-10-16T08:51:36.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 -- 172.21.15.94:0/3182499435 learned_addr learned my addr 172.21.15.94:0/3182499435 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:36.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d58add640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d54070a30 0x7f4d54149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d592de640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d5415a830 0x7f4d5415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 -- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d54070a30 msgr2=0x7f4d54149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d54070a30 0x7f4d54149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 -- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d5415a830 msgr2=0x7f4d5415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d5415a830 0x7f4d5415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 -- 172.21.15.94:0/3182499435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009b30 con 0x7f4d540ca550 2023-10-16T08:51:36.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.113+0000 7f4d53fff640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 0x7f4d5415e6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c410 tx=0x7f4d4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.114+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400035f0 con 0x7f4d540ca550 2023-10-16T08:51:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.114+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40003750 con 0x7f4d540ca550 2023-10-16T08:51:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.114+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540c2030 con 0x7f4d540ca550 2023-10-16T08:51:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.114+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40003b40 con 0x7f4d540ca550 2023-10-16T08:51:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.114+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d540c25f0 con 0x7f4d540ca550 2023-10-16T08:51:36.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.115+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d540c2b10 con 0x7f4d540ca550 2023-10-16T08:51:36.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.116+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d40003ca0 con 0x7f4d540ca550 2023-10-16T08:51:36.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.117+0000 7f4d517fa640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3806ae70 0x7f4d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.118+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d40088ed0 con 0x7f4d540ca550 2023-10-16T08:51:36.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.118+0000 7f4d58add640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3806ae70 0x7f4d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.118+0000 7f4d58add640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3806ae70 0x7f4d3806d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d48006fd0 tx=0x7f4d48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.122+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d540c2b10 con 0x7f4d540ca550 2023-10-16T08:51:36.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.312+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d540c2b10 con 0x7f4d540ca550 2023-10-16T08:51:36.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.313+0000 7f4d517fa640 1 -- 172.21.15.94:0/3182499435 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d540c2b10 con 0x7f4d540ca550 2023-10-16T08:51:36.315 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:51:36.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3806ae70 msgr2=0x7f4d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3806ae70 0x7f4d3806d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d48006fd0 tx=0x7f4d48008040 comp rx=0 tx=0).stop 2023-10-16T08:51:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 msgr2=0x7f4d5415e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 0x7f4d5415e6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c410 tx=0x7f4d4000c8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 shutdown_connections 2023-10-16T08:51:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3806ae70 0x7f4d3806d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d5415a830 0x7f4d5415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d540ca550 0x7f4d5415e6e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 --2- 172.21.15.94:0/3182499435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d54070a30 0x7f4d54149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 >> 172.21.15.94:0/3182499435 conn(0x7f4d540b0030 msgr2=0x7f4d540cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 shutdown_connections 2023-10-16T08:51:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.316+0000 7f4d5ad41640 1 -- 172.21.15.94:0/3182499435 wait complete. 2023-10-16T08:51:36.337 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:51:36.541 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.540+0000 7fc98ba10640 1 Processor -- start 2023-10-16T08:51:36.542 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.541+0000 7fc98ba10640 1 -- start start 2023-10-16T08:51:36.543 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc98ba10640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 0x7fc9840cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.543 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc98ba10640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9840ca550 0x7fc984070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.543 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc98ba10640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9840cf040 con 0x7fc984070860 2023-10-16T08:51:36.543 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc98ba10640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc984070cf0 con 0x7fc9840ca550 2023-10-16T08:51:36.544 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc98ba10640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840ce430 con 0x7fc98415a830 2023-10-16T08:51:36.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc989fad640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc984070860 0x7fc98415e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48700/0 (socket says 172.21.15.94:48700) 2023-10-16T08:51:36.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.542+0000 7fc989fad640 1 -- 172.21.15.94:0/1022022630 learned_addr learned my addr 172.21.15.94:0/1022022630 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:36.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc9897ac640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 0x7fc9840cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc988fab640 1 --2- 172.21.15.94:0/1022022630 >> v2:172.21.15.130:3300/0 conn(0x7fc9840ca550 0x7fc984070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631047811 0 0) 0x7fc9840cf040 con 0x7fc984070860 2023-10-16T08:51:36.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc974003520 con 0x7fc984070860 2023-10-16T08:51:36.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093067456 0 0) 0x7fc974003520 con 0x7fc984070860 2023-10-16T08:51:36.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 msgr2=0x7fc9840cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 0x7fc9840cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 >> v2:172.21.15.130:3300/0 conn(0x7fc9840ca550 msgr2=0x7fc984070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 --2- 172.21.15.94:0/1022022630 >> v2:172.21.15.130:3300/0 conn(0x7fc9840ca550 0x7fc984070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9840ce710 con 0x7fc984070860 2023-10-16T08:51:36.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fc97c001670 con 0x7fc984070860 2023-10-16T08:51:36.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 >> v1:172.21.15.94:6789/0 conn(0x7fc984070860 legacy=0x7fc98415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc974003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 0x7fc9740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984070cf0 con 0x7fc974003970 2023-10-16T08:51:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840ce430 con 0x7fc974004d00 2023-10-16T08:51:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.543+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97400b980 con 0x7fc98415a830 2023-10-16T08:51:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc9897ac640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc974003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc989fad640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc988fab640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 0x7fc9740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc9897ac640 1 -- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 msgr2=0x7fc9740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc9897ac640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc98415a830 0x7fc9740047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc9897ac640 1 -- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974004d00 msgr2=0x7fc974005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc9897ac640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.544+0000 7fc9897ac640 1 -- 172.21.15.94:0/1022022630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974003520 con 0x7fc974003970 2023-10-16T08:51:36.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.545+0000 7fc9897ac640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc974003d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc978009fc0 tx=0x7fc9740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363b90d32854d291 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.545+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97802cc20 con 0x7fc974003970 2023-10-16T08:51:36.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.545+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97800f040 con 0x7fc974003970 2023-10-16T08:51:36.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.545+0000 7fc983fff640 1 -- 172.21.15.94:0/1022022630 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978034440 con 0x7fc974003970 2023-10-16T08:51:36.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc98ba10640 1 -- 172.21.15.94:0/1022022630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 msgr2=0x7fc974003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc98ba10640 1 --2- 172.21.15.94:0/1022022630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc974003d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc978009fc0 tx=0x7fc9740057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc989fad640 1 -- 172.21.15.94:0/1022022630 reap_dead start 2023-10-16T08:51:36.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc98ba10640 1 -- 172.21.15.94:0/1022022630 shutdown_connections 2023-10-16T08:51:36.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc98ba10640 1 -- 172.21.15.94:0/1022022630 >> 172.21.15.94:0/1022022630 conn(0x7fc9840b0030 msgr2=0x7fc9840b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:36.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc98ba10640 1 -- 172.21.15.94:0/1022022630 shutdown_connections 2023-10-16T08:51:36.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.546+0000 7fc98ba10640 1 -- 172.21.15.94:0/1022022630 wait complete. 2023-10-16T08:51:36.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.548+0000 7fc98ba10640 1 Processor -- start 2023-10-16T08:51:36.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.548+0000 7fc98ba10640 1 -- start start 2023-10-16T08:51:36.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc98ba10640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc984155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc98ba10640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9840c4770 0x7fc9840c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc98ba10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc98415c370 0x7fc98415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc98ba10640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840c6c10 con 0x7fc974003970 2023-10-16T08:51:36.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc98ba10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840c5130 con 0x7fc98415c370 2023-10-16T08:51:36.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc98ba10640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98415d0e0 con 0x7fc9840c4770 2023-10-16T08:51:36.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc9897ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc984155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc9897ac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc984155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37952/0 (socket says 172.21.15.94:37952) 2023-10-16T08:51:36.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.549+0000 7fc9897ac640 1 -- 172.21.15.94:0/2406372667 learned_addr learned my addr 172.21.15.94:0/2406372667 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:36.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc9897ac640 1 -- 172.21.15.94:0/2406372667 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9840c4770 msgr2=0x7fc9840c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc9897ac640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9840c4770 0x7fc9840c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc9897ac640 1 -- 172.21.15.94:0/2406372667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc98415c370 msgr2=0x7fc98415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc9897ac640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc98415c370 0x7fc98415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc9897ac640 1 -- 172.21.15.94:0/2406372667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98415d3c0 con 0x7fc974003970 2023-10-16T08:51:36.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc9897ac640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc984155cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc97800e230 tx=0x7fc978009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978034bd0 con 0x7fc974003970 2023-10-16T08:51:36.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc978034d50 con 0x7fc974003970 2023-10-16T08:51:36.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978003bd0 con 0x7fc974003970 2023-10-16T08:51:36.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.550+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98415d6a0 con 0x7fc974003970 2023-10-16T08:51:36.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.551+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984156230 con 0x7fc974003970 2023-10-16T08:51:36.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.552+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc984073ef0 con 0x7fc974003970 2023-10-16T08:51:36.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.553+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc978040450 con 0x7fc974003970 2023-10-16T08:51:36.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.553+0000 7fc981ffb640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc96806ae70 0x7fc96806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.554+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9780ac080 con 0x7fc974003970 2023-10-16T08:51:36.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.554+0000 7fc988fab640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc96806ae70 0x7fc96806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.554+0000 7fc988fab640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc96806ae70 0x7fc96806d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc98415bff0 tx=0x7fc970008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.557+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9780deca0 con 0x7fc974003970 2023-10-16T08:51:36.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.747+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc9840aec20 con 0x7fc974003970 2023-10-16T08:51:36.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.748+0000 7fc981ffb640 1 -- 172.21.15.94:0/2406372667 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc978076e30 con 0x7fc974003970 2023-10-16T08:51:36.749 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc96806ae70 msgr2=0x7fc96806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc96806ae70 0x7fc96806d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc98415bff0 tx=0x7fc970008040 comp rx=0 tx=0).stop 2023-10-16T08:51:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 msgr2=0x7fc984155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc984155cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc97800e230 tx=0x7fc978009750 comp rx=0 tx=0).stop 2023-10-16T08:51:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 shutdown_connections 2023-10-16T08:51:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc96806ae70 0x7fc96806d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc98415c370 0x7fc98415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9840c4770 0x7fc9840c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 --2- 172.21.15.94:0/2406372667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc974003970 0x7fc984155cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 >> 172.21.15.94:0/2406372667 conn(0x7fc9840b0030 msgr2=0x7fc9840b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 shutdown_connections 2023-10-16T08:51:36.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.751+0000 7fc98ba10640 1 -- 172.21.15.94:0/2406372667 wait complete. 2023-10-16T08:51:36.770 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:51:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.977+0000 7f5f32e39640 1 Processor -- start 2023-10-16T08:51:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.977+0000 7f5f32e39640 1 -- start start 2023-10-16T08:51:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.978+0000 7f5f32e39640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5f2c15d700 0x7f5f2c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.978+0000 7f5f32e39640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f2c0b01b0 0x7f5f2c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f32e39640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c0b0b20 con 0x7f5f2c15dae0 2023-10-16T08:51:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f32e39640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c15a2c0 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f32e39640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c15a5a0 con 0x7f5f2c15d700 2023-10-16T08:51:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f313d6640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f2c0b01b0 0x7f5f2c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f2bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5f2c15dae0 0x7f5f2c06cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48702/0 (socket says 172.21.15.94:48702) 2023-10-16T08:51:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f2bfff640 1 -- 172.21.15.94:0/2039168132 learned_addr learned my addr 172.21.15.94:0/2039168132 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f30bd5640 1 --2- 172.21.15.94:0/2039168132 >> v2:172.21.15.130:3300/0 conn(0x7f5f2c15d700 0x7f5f2c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f313d6640 1 -- 172.21.15.94:0/2039168132 >> v2:172.21.15.130:3300/0 conn(0x7f5f2c15d700 msgr2=0x7f5f2c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f313d6640 1 --2- 172.21.15.94:0/2039168132 >> v2:172.21.15.130:3300/0 conn(0x7f5f2c15d700 0x7f5f2c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f313d6640 1 -- 172.21.15.94:0/2039168132 >> v1:172.21.15.94:6789/0 conn(0x7f5f2c15dae0 legacy=0x7f5f2c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f313d6640 1 -- 172.21.15.94:0/2039168132 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c15a880 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.979+0000 7f5f2b7fe640 1 -- 172.21.15.94:0/2039168132 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120131070 0 0) 0x7f5f2c0b0b20 con 0x7f5f2c15dae0 2023-10-16T08:51:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.980+0000 7f5f313d6640 1 --2- 172.21.15.94:0/2039168132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0b05e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0cc290 tx=0x7f5f2402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef736ee1495720d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f2b7fe640 1 -- 172.21.15.94:0/2039168132 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2402cc80 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f2b7fe640 1 -- 172.21.15.94:0/2039168132 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2402cde0 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f2b7fe640 1 -- 172.21.15.94:0/2039168132 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24034660 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 -- 172.21.15.94:0/2039168132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 msgr2=0x7f5f2c0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2039168132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0b05e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0cc290 tx=0x7f5f2402bed0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 -- 172.21.15.94:0/2039168132 shutdown_connections 2023-10-16T08:51:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2039168132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0b05e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2039168132 >> v2:172.21.15.130:3300/0 conn(0x7f5f2c15d700 0x7f5f2c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 -- 172.21.15.94:0/2039168132 >> 172.21.15.94:0/2039168132 conn(0x7f5f2c0cb1b0 msgr2=0x7f5f2c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 -- 172.21.15.94:0/2039168132 shutdown_connections 2023-10-16T08:51:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.981+0000 7f5f32e39640 1 -- 172.21.15.94:0/2039168132 wait complete. 2023-10-16T08:51:36.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.983+0000 7f5f32e39640 1 Processor -- start 2023-10-16T08:51:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.983+0000 7f5f32e39640 1 -- start start 2023-10-16T08:51:36.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f32e39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f32e39640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f2c15d700 0x7f5f2c1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f32e39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f2c15dae0 0x7f5f2c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f32e39640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c159370 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f32e39640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c166750 con 0x7f5f2c15dae0 2023-10-16T08:51:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f32e39640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c166a30 con 0x7f5f2c15d700 2023-10-16T08:51:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f30bd5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f30bd5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37958/0 (socket says 172.21.15.94:37958) 2023-10-16T08:51:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.984+0000 7f5f30bd5640 1 -- 172.21.15.94:0/2411383802 learned_addr learned my addr 172.21.15.94:0/2411383802 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f313d6640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f2c15dae0 0x7f5f2c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f2bfff640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f2c15d700 0x7f5f2c1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f30bd5640 1 -- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f2c15d700 msgr2=0x7f5f2c1f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f30bd5640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f2c15d700 0x7f5f2c1f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f30bd5640 1 -- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f2c15dae0 msgr2=0x7f5f2c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f30bd5640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f2c15dae0 0x7f5f2c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f30bd5640 1 -- 172.21.15.94:0/2411383802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009a70 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f313d6640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f2c15dae0 0x7f5f2c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f2bfff640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f2c15d700 0x7f5f2c1f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f30bd5640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0af8a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000d800 tx=0x7f5f2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000b6c0 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2000b820 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c166d10 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.985+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000bbb0 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.986+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c1672d0 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.987+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c15df60 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.988+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f2000bd10 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.988+0000 7f5f297fa640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f1006ae70 0x7f5f1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.989+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f20089ea0 con 0x7f5f2c0b01b0 2023-10-16T08:51:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.989+0000 7f5f2bfff640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f1006ae70 0x7f5f1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.990+0000 7f5f2bfff640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f1006ae70 0x7f5f1006d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f18000f60 tx=0x7f5f18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:36.993+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f20054c60 con 0x7f5f2c0b01b0 2023-10-16T08:51:37.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.199+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f2c073ef0 con 0x7f5f2c0b01b0 2023-10-16T08:51:37.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.200+0000 7f5f297fa640 1 -- 172.21.15.94:0/2411383802 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5f20058280 con 0x7f5f2c0b01b0 2023-10-16T08:51:37.201 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:51:37.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f1006ae70 msgr2=0x7f5f1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:37.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f1006ae70 0x7f5f1006d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f18000f60 tx=0x7f5f18009040 comp rx=0 tx=0).stop 2023-10-16T08:51:37.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 msgr2=0x7f5f2c0af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:37.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0af8a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000d800 tx=0x7f5f2000dcc0 comp rx=0 tx=0).stop 2023-10-16T08:51:37.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 shutdown_connections 2023-10-16T08:51:37.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f1006ae70 0x7f5f1006d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:37.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.202+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f2c15dae0 0x7f5f2c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:37.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.203+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f2c15d700 0x7f5f2c1f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:37.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.203+0000 7f5f32e39640 1 --2- 172.21.15.94:0/2411383802 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f2c0b01b0 0x7f5f2c0af8a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:37.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.203+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 >> 172.21.15.94:0/2411383802 conn(0x7f5f2c0cb1b0 msgr2=0x7f5f2c0cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:37.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.203+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 shutdown_connections 2023-10-16T08:51:37.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:37.203+0000 7f5f32e39640 1 -- 172.21.15.94:0/2411383802 wait complete. 2023-10-16T08:51:37.222 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2023-10-16T08:51:37.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:37.223 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-16T08:51:37.313 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi094.stderr:ceph-fuse[92520]: fuse finished with error 0 and tester_r 0 2023-10-16T08:51:37.318 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:51:43.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:51:43.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:51:43.421 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-16T08:51:43.495 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:43.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.704+0000 7f206ba83640 1 Processor -- start 2023-10-16T08:51:43.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.704+0000 7f206ba83640 1 -- start start 2023-10-16T08:51:43.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.705+0000 7f206ba83640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f20640c9e00 0x7f20640c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.705+0000 7f206ba83640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 0x7f20640cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206ba83640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2064071c10 con 0x7f20640ca1e0 2023-10-16T08:51:43.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206ba83640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640cde00 con 0x7f20640c9e00 2023-10-16T08:51:43.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206ba83640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2064071e40 con 0x7f2064071800 2023-10-16T08:51:43.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206901e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f20640ca1e0 0x7f20640710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48710/0 (socket says 172.21.15.94:48710) 2023-10-16T08:51:43.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206901e640 1 -- 172.21.15.94:0/1031010420 learned_addr learned my addr 172.21.15.94:0/1031010420 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:43.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206981f640 1 --2- 172.21.15.94:0/1031010420 >> v2:172.21.15.130:3300/0 conn(0x7f20640c9e00 0x7f20640c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206a020640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 0x7f20640cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947531350 0 0) 0x7f2064071c10 con 0x7f20640ca1e0 2023-10-16T08:51:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.706+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2050003520 con 0x7f20640ca1e0 2023-10-16T08:51:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458557955 0 0) 0x7f2050003520 con 0x7f20640ca1e0 2023-10-16T08:51:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 msgr2=0x7f20640cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:43.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 0x7f20640cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 >> v2:172.21.15.130:3300/0 conn(0x7f20640c9e00 msgr2=0x7f20640c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:43.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 --2- 172.21.15.94:0/1031010420 >> v2:172.21.15.130:3300/0 conn(0x7f20640c9e00 0x7f20640c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064072120 con 0x7f20640ca1e0 2023-10-16T08:51:43.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f2054001670 con 0x7f20640ca1e0 2023-10-16T08:51:43.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 >> v1:172.21.15.94:6789/0 conn(0x7f20640ca1e0 legacy=0x7f20640710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:43.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 0x7f20500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2050003fb0 0x7f20500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f2050005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640cde00 con 0x7f2050004d00 2023-10-16T08:51:43.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2064071e40 con 0x7f2050003fb0 2023-10-16T08:51:43.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205000dc10 con 0x7f2064071800 2023-10-16T08:51:43.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206a020640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f2050005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206901e640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2050003fb0 0x7f20500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.707+0000 7f206981f640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 0x7f20500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.708+0000 7f206a020640 1 -- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 msgr2=0x7f20500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:43.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.708+0000 7f206a020640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2064071800 0x7f20500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.708+0000 7f206a020640 1 -- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2050003fb0 msgr2=0x7f20500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:43.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.708+0000 7f206a020640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2050003fb0 0x7f20500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.708+0000 7f206a020640 1 -- 172.21.15.94:0/1031010420 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050003520 con 0x7f2050004d00 2023-10-16T08:51:43.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206a020640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f2050005180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f205c009fc0 tx=0x7f20500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9eda236d8eaea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:43.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c02cc20 con 0x7f2050004d00 2023-10-16T08:51:43.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c00f040 con 0x7f2050004d00 2023-10-16T08:51:43.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206881d640 1 -- 172.21.15.94:0/1031010420 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c034440 con 0x7f2050004d00 2023-10-16T08:51:43.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206ba83640 1 -- 172.21.15.94:0/1031010420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 msgr2=0x7f2050005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:43.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206ba83640 1 --2- 172.21.15.94:0/1031010420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f2050005180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f205c009fc0 tx=0x7f20500057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.709+0000 7f206a020640 1 -- 172.21.15.94:0/1031010420 reap_dead start 2023-10-16T08:51:43.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.710+0000 7f206ba83640 1 -- 172.21.15.94:0/1031010420 shutdown_connections 2023-10-16T08:51:43.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.710+0000 7f206ba83640 1 -- 172.21.15.94:0/1031010420 >> 172.21.15.94:0/1031010420 conn(0x7f206406c1c0 msgr2=0x7f206406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:43.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.710+0000 7f206ba83640 1 -- 172.21.15.94:0/1031010420 shutdown_connections 2023-10-16T08:51:43.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.710+0000 7f206ba83640 1 -- 172.21.15.94:0/1031010420 wait complete. 2023-10-16T08:51:43.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.711+0000 7f206ba83640 1 Processor -- start 2023-10-16T08:51:43.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.712+0000 7f206ba83640 1 -- start start 2023-10-16T08:51:43.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.712+0000 7f206ba83640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f20640c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206ba83640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20640c5710 0x7f2064152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206ba83640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20641e3040 0x7f20640c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206ba83640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640c7140 con 0x7f2050004d00 2023-10-16T08:51:43.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206ba83640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20641e02f0 con 0x7f20641e3040 2023-10-16T08:51:43.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206ba83640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20640c6ec0 con 0x7f20640c5710 2023-10-16T08:51:43.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f20640c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f20640c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37974/0 (socket says 172.21.15.94:37974) 2023-10-16T08:51:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 -- 172.21.15.94:0/3312974818 learned_addr learned my addr 172.21.15.94:0/3312974818 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 -- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20640c5710 msgr2=0x7f2064152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206901e640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20640c5710 0x7f2064152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20640c5710 0x7f2064152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 -- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20641e3040 msgr2=0x7f20640c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20641e3040 0x7f20640c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.713+0000 7f206981f640 1 -- 172.21.15.94:0/3312974818 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20641df9c0 con 0x7f2050004d00 2023-10-16T08:51:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.714+0000 7f206981f640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f20640c6980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2060011700 tx=0x7f2060011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:43.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.714+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000f940 con 0x7f2050004d00 2023-10-16T08:51:43.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.714+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206000faa0 con 0x7f2050004d00 2023-10-16T08:51:43.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.714+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20641dfca0 con 0x7f2050004d00 2023-10-16T08:51:43.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.714+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000fe10 con 0x7f2050004d00 2023-10-16T08:51:43.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.714+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20641532a0 con 0x7f2050004d00 2023-10-16T08:51:43.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.715+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2064073ef0 con 0x7f2050004d00 2023-10-16T08:51:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.716+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2060015460 con 0x7f2050004d00 2023-10-16T08:51:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.717+0000 7f205a7fc640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f204806aea0 0x7f204806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.717+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2060089dc0 con 0x7f2050004d00 2023-10-16T08:51:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.717+0000 7f206901e640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f204806aea0 0x7f204806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:43.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.718+0000 7f206901e640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f204806aea0 0x7f204806d360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20641e1440 tx=0x7f2054000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:43.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.722+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2060054b70 con 0x7f2050004d00 2023-10-16T08:51:43.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.912+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20640cc1d0 con 0x7f2050004d00 2023-10-16T08:51:43.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.915+0000 7f205a7fc640 1 -- 172.21.15.94:0/3312974818 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f2060022090 con 0x7f2050004d00 2023-10-16T08:51:43.917 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:43.918 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:43.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.917+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f204806aea0 msgr2=0x7f204806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:43.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.917+0000 7f206ba83640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f204806aea0 0x7f204806d360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20641e1440 tx=0x7f2054000f50 comp rx=0 tx=0).stop 2023-10-16T08:51:43.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.917+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 msgr2=0x7f20640c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:43.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.917+0000 7f206ba83640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f20640c6980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2060011700 tx=0x7f2060011bc0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 shutdown_connections 2023-10-16T08:51:43.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f204806aea0 0x7f204806d360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20641e3040 0x7f20640c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20640c5710 0x7f2064152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 --2- 172.21.15.94:0/3312974818 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2050004d00 0x7f20640c6980 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:43.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 >> 172.21.15.94:0/3312974818 conn(0x7f206406c1c0 msgr2=0x7f20640ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:43.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 shutdown_connections 2023-10-16T08:51:43.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:43.918+0000 7f206ba83640 1 -- 172.21.15.94:0/3312974818 wait complete. 2023-10-16T08:51:43.938 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:44.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.145+0000 7f377e402640 1 Processor -- start 2023-10-16T08:51:44.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.145+0000 7f377e402640 1 -- start start 2023-10-16T08:51:44.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.146+0000 7f377e402640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f37780c9e00 0x7f37780c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.146+0000 7f377e402640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 0x7f37780710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.146+0000 7f377e402640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778071e40 con 0x7f3778071630 2023-10-16T08:51:44.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.146+0000 7f377e402640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780cde00 con 0x7f37780c9e00 2023-10-16T08:51:44.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.146+0000 7f377e402640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778072120 con 0x7f37780ca1e0 2023-10-16T08:51:44.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f377c99f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3778071630 0x7f37780cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48718/0 (socket says 172.21.15.94:48718) 2023-10-16T08:51:44.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f377c99f640 1 -- 172.21.15.94:0/2629011574 learned_addr learned my addr 172.21.15.94:0/2629011574 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:44.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f37777fe640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 0x7f37780710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3777fff640 1 --2- 172.21.15.94:0/2629011574 >> v2:172.21.15.130:3300/0 conn(0x7f37780c9e00 0x7f37780c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632586902 0 0) 0x7f3778071e40 con 0x7f3778071630 2023-10-16T08:51:44.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3760003520 con 0x7f3778071630 2023-10-16T08:51:44.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335075037 0 0) 0x7f3760003520 con 0x7f3778071630 2023-10-16T08:51:44.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 msgr2=0x7f37780710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:44.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 0x7f37780710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 >> v2:172.21.15.130:3300/0 conn(0x7f37780c9e00 msgr2=0x7f37780c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:44.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.147+0000 7f3776ffd640 1 --2- 172.21.15.94:0/2629011574 >> v2:172.21.15.130:3300/0 conn(0x7f37780c9e00 0x7f37780c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778072400 con 0x7f3778071630 2023-10-16T08:51:44.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f37700019f0 con 0x7f3778071630 2023-10-16T08:51:44.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 >> v1:172.21.15.94:6789/0 conn(0x7f3778071630 legacy=0x7f37780cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f3760003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 0x7f37600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780cde00 con 0x7f37600039e0 2023-10-16T08:51:44.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778072120 con 0x7f3760004d00 2023-10-16T08:51:44.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376000db90 con 0x7f37780ca1e0 2023-10-16T08:51:44.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3777fff640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f3760003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f37777fe640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 0x7f37600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3777fff640 1 -- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 msgr2=0x7f37600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3777fff640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780ca1e0 0x7f37600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f377c99f640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3777fff640 1 -- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3760004d00 msgr2=0x7f3760005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3777fff640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.148+0000 7f3777fff640 1 -- 172.21.15.94:0/2629011574 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760003520 con 0x7f37600039e0 2023-10-16T08:51:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f3777fff640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f3760003e00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3768009ac0 tx=0x7f37600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd80c6bf2cf0416e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376802c710 con 0x7f37600039e0 2023-10-16T08:51:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376802c870 con 0x7f37600039e0 2023-10-16T08:51:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f3776ffd640 1 -- 172.21.15.94:0/2629011574 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376802cc00 con 0x7f37600039e0 2023-10-16T08:51:44.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f377e402640 1 -- 172.21.15.94:0/2629011574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 msgr2=0x7f3760003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f377e402640 1 --2- 172.21.15.94:0/2629011574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f3760003e00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3768009ac0 tx=0x7f37600057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f377c99f640 1 -- 172.21.15.94:0/2629011574 reap_dead start 2023-10-16T08:51:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f377e402640 1 -- 172.21.15.94:0/2629011574 shutdown_connections 2023-10-16T08:51:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.150+0000 7f377e402640 1 -- 172.21.15.94:0/2629011574 >> 172.21.15.94:0/2629011574 conn(0x7f377806c1c0 msgr2=0x7f377806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:44.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.151+0000 7f377e402640 1 -- 172.21.15.94:0/2629011574 shutdown_connections 2023-10-16T08:51:44.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.151+0000 7f377e402640 1 -- 172.21.15.94:0/2629011574 wait complete. 2023-10-16T08:51:44.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.152+0000 7f377e402640 1 Processor -- start 2023-10-16T08:51:44.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 -- start start 2023-10-16T08:51:44.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f37780b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37780ae9d0 0x7f37780aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780b2f20 0x7f37780b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780b2b00 con 0x7f37600039e0 2023-10-16T08:51:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37781436f0 con 0x7f37780ae9d0 2023-10-16T08:51:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.153+0000 7f377e402640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37780b21e0 con 0x7f37780b2f20 2023-10-16T08:51:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f37780b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f37780b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:37992/0 (socket says 172.21.15.94:37992) 2023-10-16T08:51:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 -- 172.21.15.94:0/1966087421 learned_addr learned my addr 172.21.15.94:0/1966087421 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:44.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f377c99f640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780b2f20 0x7f37780b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 -- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780b2f20 msgr2=0x7f37780b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780b2f20 0x7f37780b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f37777fe640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37780ae9d0 0x7f37780aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 -- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37780ae9d0 msgr2=0x7f37780aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37780ae9d0 0x7f37780aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 -- 172.21.15.94:0/1966087421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778143980 con 0x7f37600039e0 2023-10-16T08:51:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.154+0000 7f3777fff640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f37780b0420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f376802c2b0 tx=0x7f3768004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.155+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768003810 con 0x7f37600039e0 2023-10-16T08:51:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.155+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376802de90 con 0x7f37600039e0 2023-10-16T08:51:44.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.155+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768003b70 con 0x7f37600039e0 2023-10-16T08:51:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.155+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780b2460 con 0x7f37600039e0 2023-10-16T08:51:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.155+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37780b2720 con 0x7f37600039e0 2023-10-16T08:51:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.156+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3778073ef0 con 0x7f37600039e0 2023-10-16T08:51:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.157+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3768003cd0 con 0x7f37600039e0 2023-10-16T08:51:44.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.158+0000 7f3774ff9640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376406ae70 0x7f376406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.158+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37680ab7d0 con 0x7f37600039e0 2023-10-16T08:51:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.158+0000 7f37777fe640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376406ae70 0x7f376406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.159+0000 7f37777fe640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376406ae70 0x7f376406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37780b0180 tx=0x7f376c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:44.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.162+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3768076590 con 0x7f37600039e0 2023-10-16T08:51:44.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.352+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37780caee0 con 0x7f37600039e0 2023-10-16T08:51:44.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.354+0000 7f3774ff9640 1 -- 172.21.15.94:0/1966087421 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f3768079bb0 con 0x7f37600039e0 2023-10-16T08:51:44.356 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:44.356 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:44.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.356+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376406ae70 msgr2=0x7f376406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.356+0000 7f377e402640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376406ae70 0x7f376406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37780b0180 tx=0x7f376c008040 comp rx=0 tx=0).stop 2023-10-16T08:51:44.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.356+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 msgr2=0x7f37780b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.356+0000 7f377e402640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f37780b0420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f376802c2b0 tx=0x7f3768004730 comp rx=0 tx=0).stop 2023-10-16T08:51:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 shutdown_connections 2023-10-16T08:51:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37780b2f20 0x7f37780b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376406ae70 0x7f376406d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37780ae9d0 0x7f37780aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 --2- 172.21.15.94:0/1966087421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37600039e0 0x7f37780b0420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 >> 172.21.15.94:0/1966087421 conn(0x7f377806c1c0 msgr2=0x7f3778157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 shutdown_connections 2023-10-16T08:51:44.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.357+0000 7f377e402640 1 -- 172.21.15.94:0/1966087421 wait complete. 2023-10-16T08:51:44.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T08:51:44.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.590+0000 7fa3eaa09640 1 Processor -- start 2023-10-16T08:51:44.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.591+0000 7fa3eaa09640 1 -- start start 2023-10-16T08:51:44.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3eaa09640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159890 0x7fa3e4071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3eaa09640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3e40ca110 0x7fa3e40ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3eaa09640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa3e415d3f0 0x7fa3e415d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3eaa09640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40caab0 con 0x7fa3e40ca110 2023-10-16T08:51:44.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3eaa09640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e4072480 con 0x7fa3e415d3f0 2023-10-16T08:51:44.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3eaa09640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40cd0c0 con 0x7fa3e4159890 2023-10-16T08:51:44.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3dbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3e40ca110 0x7fa3e40ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3dbfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3e40ca110 0x7fa3e40ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56738/0 (socket says 172.21.15.94:56738) 2023-10-16T08:51:44.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.592+0000 7fa3dbfff640 1 -- 172.21.15.94:0/756783036 learned_addr learned my addr 172.21.15.94:0/756783036 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:44.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3e8fa6640 1 --2- 172.21.15.94:0/756783036 >> v2:172.21.15.130:3300/0 conn(0x7fa3e415d3f0 0x7fa3e415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3e3fff640 1 --2- 172.21.15.94:0/756783036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159890 0x7fa3e4071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3dbfff640 1 -- 172.21.15.94:0/756783036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159890 msgr2=0x7fa3e4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/756783036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159890 0x7fa3e4071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3dbfff640 1 -- 172.21.15.94:0/756783036 >> v2:172.21.15.130:3300/0 conn(0x7fa3e415d3f0 msgr2=0x7fa3e415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/756783036 >> v2:172.21.15.130:3300/0 conn(0x7fa3e415d3f0 0x7fa3e415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.593+0000 7fa3dbfff640 1 -- 172.21.15.94:0/756783036 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40cc540 con 0x7fa3e40ca110 2023-10-16T08:51:44.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.594+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/756783036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40ca570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40cd9d0 tx=0x7fa3cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b4a9de272803bc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:44.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.594+0000 7fa3e37fe640 1 -- 172.21.15.94:0/756783036 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc031870 con 0x7fa3e40ca110 2023-10-16T08:51:44.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.594+0000 7fa3e37fe640 1 -- 172.21.15.94:0/756783036 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0319d0 con 0x7fa3e40ca110 2023-10-16T08:51:44.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.594+0000 7fa3e37fe640 1 -- 172.21.15.94:0/756783036 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc031d60 con 0x7fa3e40ca110 2023-10-16T08:51:44.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 -- 172.21.15.94:0/756783036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 msgr2=0x7fa3e40ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/756783036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40ca570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40cd9d0 tx=0x7fa3cc02b910 comp rx=0 tx=0).stop 2023-10-16T08:51:44.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 -- 172.21.15.94:0/756783036 shutdown_connections 2023-10-16T08:51:44.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/756783036 >> v2:172.21.15.130:3300/0 conn(0x7fa3e415d3f0 0x7fa3e415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/756783036 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40ca570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/756783036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159890 0x7fa3e4071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 -- 172.21.15.94:0/756783036 >> 172.21.15.94:0/756783036 conn(0x7fa3e40b0030 msgr2=0x7fa3e40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:44.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 -- 172.21.15.94:0/756783036 shutdown_connections 2023-10-16T08:51:44.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.595+0000 7fa3eaa09640 1 -- 172.21.15.94:0/756783036 wait complete. 2023-10-16T08:51:44.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.597+0000 7fa3eaa09640 1 Processor -- start 2023-10-16T08:51:44.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.597+0000 7fa3eaa09640 1 -- start start 2023-10-16T08:51:44.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3eaa09640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3eaa09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4159890 0x7fa3e40ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3eaa09640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e415d3f0 0x7fa3e40ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3eaa09640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40c6360 con 0x7fa3e40ca110 2023-10-16T08:51:44.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3eaa09640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4157d80 con 0x7fa3e4159890 2023-10-16T08:51:44.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3eaa09640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40c5750 con 0x7fa3e415d3f0 2023-10-16T08:51:44.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3e3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3e3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56750/0 (socket says 172.21.15.94:56750) 2023-10-16T08:51:44.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.598+0000 7fa3e3fff640 1 -- 172.21.15.94:0/413309454 learned_addr learned my addr 172.21.15.94:0/413309454 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:44.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e8fa6640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e415d3f0 0x7fa3e40ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4159890 0x7fa3e40ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e3fff640 1 -- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e415d3f0 msgr2=0x7fa3e40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e3fff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e415d3f0 0x7fa3e40ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e3fff640 1 -- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4159890 msgr2=0x7fa3e40ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:44.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e3fff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4159890 0x7fa3e40ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:44.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e3fff640 1 -- 172.21.15.94:0/413309454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0094d0 con 0x7fa3e40ca110 2023-10-16T08:51:44.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4159890 0x7fa3e40ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:44.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e3fff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40b2770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d5f0 tx=0x7fa3d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:44.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40125f0 con 0x7fa3e40ca110 2023-10-16T08:51:44.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4012750 con 0x7fa3e40ca110 2023-10-16T08:51:44.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e40c5a30 con 0x7fa3e40ca110 2023-10-16T08:51:44.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.599+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4012b00 con 0x7fa3e40ca110 2023-10-16T08:51:44.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.600+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e40c5ff0 con 0x7fa3e40ca110 2023-10-16T08:51:44.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.601+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e40c6180 con 0x7fa3e40ca110 2023-10-16T08:51:44.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.601+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3d4012c60 con 0x7fa3e40ca110 2023-10-16T08:51:44.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.602+0000 7fa3e17fa640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa3c406ae70 0x7fa3c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:44.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.602+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3d4089d40 con 0x7fa3e40ca110 2023-10-16T08:51:44.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.603+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa3c406ae70 0x7fa3c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:44.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.603+0000 7fa3dbfff640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa3c406ae70 0x7fa3c406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc036000 tx=0x7fa3cc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:44.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.607+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3d4054b90 con 0x7fa3e40ca110 2023-10-16T08:51:44.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:44.839+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa3e4073ef0 con 0x7fa3e40ca110 2023-10-16T08:51:45.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.631+0000 7fa3e17fa640 1 -- 172.21.15.94:0/413309454 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa3d40581b0 con 0x7fa3e40ca110 2023-10-16T08:51:45.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.634+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa3c406ae70 msgr2=0x7fa3c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:45.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.634+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa3c406ae70 0x7fa3c406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc036000 tx=0x7fa3cc03c040 comp rx=0 tx=0).stop 2023-10-16T08:51:45.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.634+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 msgr2=0x7fa3e40b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:45.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.634+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40b2770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d5f0 tx=0x7fa3d400dab0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 shutdown_connections 2023-10-16T08:51:45.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e415d3f0 0x7fa3e40ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa3c406ae70 0x7fa3c406d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4159890 0x7fa3e40ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 --2- 172.21.15.94:0/413309454 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e40ca110 0x7fa3e40b2770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 >> 172.21.15.94:0/413309454 conn(0x7fa3e40b0030 msgr2=0x7fa3e40abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:45.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 shutdown_connections 2023-10-16T08:51:45.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.635+0000 7fa3eaa09640 1 -- 172.21.15.94:0/413309454 wait complete. 2023-10-16T08:51:45.656 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-16T08:51:45.657 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T08:51:45.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.873+0000 7f27ce1f0640 1 Processor -- start 2023-10-16T08:51:45.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.873+0000 7f27ce1f0640 1 -- start start 2023-10-16T08:51:45.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.874+0000 7f27ce1f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 0x7f27c80cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.874+0000 7f27ce1f0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27c80ca550 0x7f27c8070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27ce1f0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c80cf040 con 0x7f27c8070860 2023-10-16T08:51:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27ce1f0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c8070cf0 con 0x7f27c80ca550 2023-10-16T08:51:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27ce1f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80ce430 con 0x7f27c815a830 2023-10-16T08:51:45.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27c7fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f27c8070860 0x7f27c815e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50784/0 (socket says 172.21.15.94:50784) 2023-10-16T08:51:45.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27c7fff640 1 -- 172.21.15.94:0/1731777002 learned_addr learned my addr 172.21.15.94:0/1731777002 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27c77fe640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 0x7f27c80cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27bffff640 1 --2- 172.21.15.94:0/1731777002 >> v2:172.21.15.130:3300/0 conn(0x7f27c80ca550 0x7f27c8070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047454199 0 0) 0x7f27c80cf040 con 0x7f27c8070860 2023-10-16T08:51:45.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.875+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b4003520 con 0x7f27c8070860 2023-10-16T08:51:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609882843 0 0) 0x7f27b4003520 con 0x7f27c8070860 2023-10-16T08:51:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 msgr2=0x7f27c80cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 0x7f27c80cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 >> v2:172.21.15.130:3300/0 conn(0x7f27c80ca550 msgr2=0x7f27c8070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:45.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 --2- 172.21.15.94:0/1731777002 >> v2:172.21.15.130:3300/0 conn(0x7f27c80ca550 0x7f27c8070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80ce710 con 0x7f27c8070860 2023-10-16T08:51:45.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f27c00019f0 con 0x7f27c8070860 2023-10-16T08:51:45.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 >> v1:172.21.15.94:6789/0 conn(0x7f27c8070860 legacy=0x7f27c815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:45.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27b4003970 0x7f27b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b40047c0 0x7f27b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 0x7f27b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8070cf0 con 0x7f27b4003970 2023-10-16T08:51:45.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80ce430 con 0x7f27b40047c0 2023-10-16T08:51:45.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400b980 con 0x7f27c815a830 2023-10-16T08:51:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27c77fe640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27b4003970 0x7f27b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.876+0000 7f27bffff640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b40047c0 0x7f27b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.877+0000 7f27c7fff640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 0x7f27b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.877+0000 7f27c77fe640 1 -- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 msgr2=0x7f27b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:45.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.877+0000 7f27c77fe640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c815a830 0x7f27b4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.877+0000 7f27c77fe640 1 -- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b40047c0 msgr2=0x7f27b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.877+0000 7f27c77fe640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b40047c0 0x7f27b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.877+0000 7f27c77fe640 1 -- 172.21.15.94:0/1731777002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4003520 con 0x7f27b4003970 2023-10-16T08:51:45.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.878+0000 7f27c77fe640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27b4003970 0x7f27b4003d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009ac0 tx=0x7f27b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee6b46e7d0721fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.878+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b802c6b0 con 0x7f27b4003970 2023-10-16T08:51:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.878+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b802c810 con 0x7f27b4003970 2023-10-16T08:51:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.878+0000 7f27c6ffd640 1 -- 172.21.15.94:0/1731777002 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b802cba0 con 0x7f27b4003970 2023-10-16T08:51:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27ce1f0640 1 -- 172.21.15.94:0/1731777002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27b4003970 msgr2=0x7f27b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:45.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/1731777002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27b4003970 0x7f27b4003d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009ac0 tx=0x7f27b40057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27c7fff640 1 -- 172.21.15.94:0/1731777002 reap_dead start 2023-10-16T08:51:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27ce1f0640 1 -- 172.21.15.94:0/1731777002 shutdown_connections 2023-10-16T08:51:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27ce1f0640 1 -- 172.21.15.94:0/1731777002 >> 172.21.15.94:0/1731777002 conn(0x7f27c80b0030 msgr2=0x7f27c80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27ce1f0640 1 -- 172.21.15.94:0/1731777002 shutdown_connections 2023-10-16T08:51:45.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.879+0000 7f27ce1f0640 1 -- 172.21.15.94:0/1731777002 wait complete. 2023-10-16T08:51:45.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.881+0000 7f27ce1f0640 1 Processor -- start 2023-10-16T08:51:45.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.881+0000 7f27ce1f0640 1 -- start start 2023-10-16T08:51:45.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27ce1f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27b4003970 0x7f27c80c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27ce1f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c81573a0 0x7f27c81ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27ce1f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 0x7f27c8159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27ce1f0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c81ee3b0 con 0x7f27c8159500 2023-10-16T08:51:45.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27ce1f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80c2ed0 con 0x7f27c81573a0 2023-10-16T08:51:45.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27ce1f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8159ed0 con 0x7f27b4003970 2023-10-16T08:51:45.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 0x7f27c8159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 0x7f27c8159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56772/0 (socket says 172.21.15.94:56772) 2023-10-16T08:51:45.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.882+0000 7f27c7fff640 1 -- 172.21.15.94:0/3791835080 learned_addr learned my addr 172.21.15.94:0/3791835080 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:45.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c77fe640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27b4003970 0x7f27c80c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27bffff640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c81573a0 0x7f27c81ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c7fff640 1 -- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27b4003970 msgr2=0x7f27c80c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:45.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c7fff640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27b4003970 0x7f27c80c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c7fff640 1 -- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c81573a0 msgr2=0x7f27c81ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:45.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c7fff640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c81573a0 0x7f27c81ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:45.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c7fff640 1 -- 172.21.15.94:0/3791835080 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80c4480 con 0x7f27c8159500 2023-10-16T08:51:45.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c7fff640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 0x7f27c8159990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27c80cf5a0 tx=0x7f27c000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:45.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000de70 con 0x7f27c8159500 2023-10-16T08:51:45.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.883+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000bb80 con 0x7f27c8159500 2023-10-16T08:51:45.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.884+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0007110 con 0x7f27c8159500 2023-10-16T08:51:45.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.884+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c8157910 con 0x7f27c8159500 2023-10-16T08:51:45.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.884+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c8157ed0 con 0x7f27c8159500 2023-10-16T08:51:45.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.885+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c81ee4f0 con 0x7f27c8159500 2023-10-16T08:51:45.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.886+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27c0007270 con 0x7f27c8159500 2023-10-16T08:51:45.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.887+0000 7f27c4ff9640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f27a806ae90 0x7f27a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:45.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.887+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27c0089e00 con 0x7f27c8159500 2023-10-16T08:51:45.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.887+0000 7f27c77fe640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f27a806ae90 0x7f27a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.888+0000 7f27c77fe640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f27a806ae90 0x7f27a806d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27b8036000 tx=0x7f27b8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:45.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:45.891+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27c81ee4f0 con 0x7f27c8159500 2023-10-16T08:51:46.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.123+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f27c8073ef0 con 0x7f27c8159500 2023-10-16T08:51:46.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.641+0000 7f27c4ff9640 1 -- 172.21.15.94:0/3791835080 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27c0054bb0 con 0x7f27c8159500 2023-10-16T08:51:46.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f27a806ae90 msgr2=0x7f27a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:46.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f27a806ae90 0x7f27a806d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27b8036000 tx=0x7f27b8030000 comp rx=0 tx=0).stop 2023-10-16T08:51:46.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 msgr2=0x7f27c8159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:46.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 0x7f27c8159990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27c80cf5a0 tx=0x7f27c000b4a0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 shutdown_connections 2023-10-16T08:51:46.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c8159500 0x7f27c8159990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f27a806ae90 0x7f27a806d350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c81573a0 0x7f27c81ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 --2- 172.21.15.94:0/3791835080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27b4003970 0x7f27c80c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 >> 172.21.15.94:0/3791835080 conn(0x7f27c80b0030 msgr2=0x7f27c80af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:46.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 shutdown_connections 2023-10-16T08:51:46.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.645+0000 7f27ce1f0640 1 -- 172.21.15.94:0/3791835080 wait complete. 2023-10-16T08:51:46.669 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T08:51:46.670 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:51:46.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.886+0000 7f60177f5640 1 Processor -- start 2023-10-16T08:51:46.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.886+0000 7f60177f5640 1 -- start start 2023-10-16T08:51:46.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.887+0000 7f60177f5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f60100c20e0 0x7f60100710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:46.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f60177f5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60100c2570 con 0x7f60100c9e00 2023-10-16T08:51:46.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f60177f5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6010071e40 con 0x7f6010071630 2023-10-16T08:51:46.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f60177f5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100cde00 con 0x7f60100c20e0 2023-10-16T08:51:46.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f6014d90640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f60100c20e0 0x7f60100710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:46.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f6014d90640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f60100c20e0 0x7f60100710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56776/0 (socket says 172.21.15.94:56776) 2023-10-16T08:51:46.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f6014d90640 1 -- 172.21.15.94:0/1715261554 learned_addr learned my addr 172.21.15.94:0/1715261554 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:46.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f6014d90640 1 -- 172.21.15.94:0/1715261554 >> v1:172.21.15.130:6789/0 conn(0x7f6010071630 legacy=0x7f60100cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:46.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f6014d90640 1 -- 172.21.15.94:0/1715261554 >> v1:172.21.15.94:6789/0 conn(0x7f60100c9e00 legacy=0x7f60100ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:46.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.888+0000 7f6014d90640 1 -- 172.21.15.94:0/1715261554 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010072120 con 0x7f60100c20e0 2023-10-16T08:51:46.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.889+0000 7f6014d90640 1 --2- 172.21.15.94:0/1715261554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60100c20e0 0x7f60100710f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6000009870 tx=0x7f600002dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fdfd0491e6c8dd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:46.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f6007fff640 1 -- 172.21.15.94:0/1715261554 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600002e950 con 0x7f60100c20e0 2023-10-16T08:51:46.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f6007fff640 1 -- 172.21.15.94:0/1715261554 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600002eab0 con 0x7f60100c20e0 2023-10-16T08:51:46.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f6007fff640 1 -- 172.21.15.94:0/1715261554 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600002ee40 con 0x7f60100c20e0 2023-10-16T08:51:46.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f60177f5640 1 -- 172.21.15.94:0/1715261554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60100c20e0 msgr2=0x7f60100710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:46.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f60177f5640 1 --2- 172.21.15.94:0/1715261554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60100c20e0 0x7f60100710f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6000009870 tx=0x7f600002dba0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f60177f5640 1 -- 172.21.15.94:0/1715261554 shutdown_connections 2023-10-16T08:51:46.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f60177f5640 1 --2- 172.21.15.94:0/1715261554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f60100c20e0 0x7f60100710f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.890+0000 7f60177f5640 1 -- 172.21.15.94:0/1715261554 >> 172.21.15.94:0/1715261554 conn(0x7f601006c1c0 msgr2=0x7f601006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:46.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.891+0000 7f60177f5640 1 -- 172.21.15.94:0/1715261554 shutdown_connections 2023-10-16T08:51:46.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.891+0000 7f60177f5640 1 -- 172.21.15.94:0/1715261554 wait complete. 2023-10-16T08:51:46.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.892+0000 7f60177f5640 1 Processor -- start 2023-10-16T08:51:46.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.892+0000 7f60177f5640 1 -- start start 2023-10-16T08:51:46.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.893+0000 7f60177f5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 0x7f6010149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:46.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.893+0000 7f60177f5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60100c20e0 0x7f60100c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:46.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.893+0000 7f60177f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60100c9e00 0x7f60100c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:46.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.893+0000 7f60177f5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601014a1a0 con 0x7f6010071630 2023-10-16T08:51:46.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.893+0000 7f60177f5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100c60b0 con 0x7f60100c9e00 2023-10-16T08:51:46.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.893+0000 7f60177f5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60100c6390 con 0x7f60100c20e0 2023-10-16T08:51:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 0x7f6010149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 0x7f6010149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56790/0 (socket says 172.21.15.94:56790) 2023-10-16T08:51:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 -- 172.21.15.94:0/2869154539 learned_addr learned my addr 172.21.15.94:0/2869154539 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015d92640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60100c9e00 0x7f60100c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:46.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 -- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60100c20e0 msgr2=0x7f60100c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6014d90640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60100c20e0 0x7f60100c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60100c20e0 0x7f60100c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 -- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60100c9e00 msgr2=0x7f60100c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60100c9e00 0x7f60100c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:46.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 -- 172.21.15.94:0/2869154539 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000094d0 con 0x7f6010071630 2023-10-16T08:51:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015d92640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60100c9e00 0x7f60100c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.894+0000 7f6015591640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 0x7f6010149c60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c400 tx=0x7f600c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.895+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0052d0 con 0x7f6010071630 2023-10-16T08:51:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.895+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c005430 con 0x7f6010071630 2023-10-16T08:51:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.895+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c003830 con 0x7f6010071630 2023-10-16T08:51:46.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.895+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60100c6670 con 0x7f6010071630 2023-10-16T08:51:46.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.895+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60100c6950 con 0x7f6010071630 2023-10-16T08:51:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.896+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6010073ef0 con 0x7f6010071630 2023-10-16T08:51:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.897+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f600c003990 con 0x7f6010071630 2023-10-16T08:51:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.898+0000 7f6005ffb640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ff406ae70 0x7f5ff406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.898+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f600c088d90 con 0x7f6010071630 2023-10-16T08:51:46.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.898+0000 7f6014d90640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ff406ae70 0x7f5ff406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:46.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.899+0000 7f6014d90640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ff406ae70 0x7f5ff406d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6000038000 tx=0x7f6000032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:46.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:46.902+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f600c053be0 con 0x7f6010071630 2023-10-16T08:51:47.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.129+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60100aed80 con 0x7f6010071630 2023-10-16T08:51:47.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.130+0000 7f6005ffb640 1 -- 172.21.15.94:0/2869154539 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f600c057200 con 0x7f6010071630 2023-10-16T08:51:47.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:47.132 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:51:47.133 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:51:47.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ff406ae70 msgr2=0x7f5ff406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ff406ae70 0x7f5ff406d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6000038000 tx=0x7f6000032000 comp rx=0 tx=0).stop 2023-10-16T08:51:47.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 msgr2=0x7f6010149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 0x7f6010149c60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c400 tx=0x7f600c00c8c0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 shutdown_connections 2023-10-16T08:51:47.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ff406ae70 0x7f5ff406d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60100c9e00 0x7f60100c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60100c20e0 0x7f60100c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 --2- 172.21.15.94:0/2869154539 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6010071630 0x7f6010149c60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 >> 172.21.15.94:0/2869154539 conn(0x7f601006c1c0 msgr2=0x7f60100adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:47.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.132+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 shutdown_connections 2023-10-16T08:51:47.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.133+0000 7f60177f5640 1 -- 172.21.15.94:0/2869154539 wait complete. 2023-10-16T08:51:47.153 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:47.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.362+0000 7f9881d73640 1 Processor -- start 2023-10-16T08:51:47.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.363+0000 7f9881d73640 1 -- start start 2023-10-16T08:51:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f9881d73640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f987c0b0010 0x7f987c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f9881d73640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15f040 0x7f987c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f9881d73640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0707f0 con 0x7f987c15ad00 2023-10-16T08:51:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f9881d73640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c070ad0 con 0x7f987c0b0010 2023-10-16T08:51:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f9881d73640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c15b1d0 con 0x7f987c15f040 2023-10-16T08:51:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f987b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f987c0b0010 0x7f987c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f987b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f987c0b0010 0x7f987c0701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56794/0 (socket says 172.21.15.94:56794) 2023-10-16T08:51:47.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f987b7fe640 1 -- 172.21.15.94:0/1770342752 learned_addr learned my addr 172.21.15.94:0/1770342752 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:47.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.364+0000 7f987bfff640 1 --2- 172.21.15.94:0/1770342752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15f040 0x7f987c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.365+0000 7f987b7fe640 1 -- 172.21.15.94:0/1770342752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15f040 msgr2=0x7f987c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:47.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.365+0000 7f987b7fe640 1 --2- 172.21.15.94:0/1770342752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15f040 0x7f987c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.365+0000 7f987b7fe640 1 -- 172.21.15.94:0/1770342752 >> v1:172.21.15.130:6789/0 conn(0x7f987c15ad00 legacy=0x7f987c0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.365+0000 7f987b7fe640 1 -- 172.21.15.94:0/1770342752 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c15b4b0 con 0x7f987c0b0010 2023-10-16T08:51:47.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.366+0000 7f987b7fe640 1 --2- 172.21.15.94:0/1770342752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c0b0010 0x7f987c0701a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f986c009e50 tx=0x7f986c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a52b248cd24fbe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:47.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.366+0000 7f987a7fc640 1 -- 172.21.15.94:0/1770342752 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c02cb00 con 0x7f987c0b0010 2023-10-16T08:51:47.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.366+0000 7f987a7fc640 1 -- 172.21.15.94:0/1770342752 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c02cc60 con 0x7f987c0b0010 2023-10-16T08:51:47.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.366+0000 7f987a7fc640 1 -- 172.21.15.94:0/1770342752 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0343f0 con 0x7f987c0b0010 2023-10-16T08:51:47.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 -- 172.21.15.94:0/1770342752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c0b0010 msgr2=0x7f987c0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 --2- 172.21.15.94:0/1770342752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c0b0010 0x7f987c0701a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f986c009e50 tx=0x7f986c02bf60 comp rx=0 tx=0).stop 2023-10-16T08:51:47.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 -- 172.21.15.94:0/1770342752 shutdown_connections 2023-10-16T08:51:47.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 --2- 172.21.15.94:0/1770342752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15f040 0x7f987c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 --2- 172.21.15.94:0/1770342752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c0b0010 0x7f987c0701a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 -- 172.21.15.94:0/1770342752 >> 172.21.15.94:0/1770342752 conn(0x7f987c06c1c0 msgr2=0x7f987c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:47.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 -- 172.21.15.94:0/1770342752 shutdown_connections 2023-10-16T08:51:47.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.367+0000 7f9881d73640 1 -- 172.21.15.94:0/1770342752 wait complete. 2023-10-16T08:51:47.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.369+0000 7f9881d73640 1 Processor -- start 2023-10-16T08:51:47.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.369+0000 7f9881d73640 1 -- start start 2023-10-16T08:51:47.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f9881d73640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f987c0b0010 0x7f987c0c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f9881d73640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15ad00 0x7f987c0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f9881d73640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 0x7f987c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f9881d73640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0cd170 con 0x7f987c15f040 2023-10-16T08:51:47.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f9881d73640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0cc5f0 con 0x7f987c0b0010 2023-10-16T08:51:47.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f9881d73640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0cc8d0 con 0x7f987c15ad00 2023-10-16T08:51:47.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 0x7f987c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 0x7f987c0c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56802/0 (socket says 172.21.15.94:56802) 2023-10-16T08:51:47.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 -- 172.21.15.94:0/2167651015 learned_addr learned my addr 172.21.15.94:0/2167651015 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987affd640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15ad00 0x7f987c0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987b7fe640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f987c0b0010 0x7f987c0c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 -- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15ad00 msgr2=0x7f987c0c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15ad00 0x7f987c0c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 -- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f987c0b0010 msgr2=0x7f987c0c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f987c0b0010 0x7f987c0c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987bfff640 1 -- 172.21.15.94:0/2167651015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009b30 con 0x7f987c15f040 2023-10-16T08:51:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.370+0000 7f987b7fe640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f987c0b0010 0x7f987c0c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.371+0000 7f987bfff640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 0x7f987c0c5660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f987400d5d0 tx=0x7f987400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:47.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.371+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740125f0 con 0x7f987c15f040 2023-10-16T08:51:47.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.371+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874012770 con 0x7f987c15f040 2023-10-16T08:51:47.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.371+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874012b20 con 0x7f987c15f040 2023-10-16T08:51:47.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.371+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c0ccbb0 con 0x7f987c15f040 2023-10-16T08:51:47.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.371+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c0c8440 con 0x7f987c15f040 2023-10-16T08:51:47.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.372+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c0ab860 con 0x7f987c15f040 2023-10-16T08:51:47.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.373+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9874012c80 con 0x7f987c15f040 2023-10-16T08:51:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.374+0000 7f9873fff640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f985c06ae70 0x7f985c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.374+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9874089e40 con 0x7f987c15f040 2023-10-16T08:51:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.375+0000 7f987b7fe640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f985c06ae70 0x7f985c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.375+0000 7f987b7fe640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f985c06ae70 0x7f985c06d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f986c035000 tx=0x7f986c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:47.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.379+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f987c0ab860 con 0x7f987c15f040 2023-10-16T08:51:47.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.568+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f987c0ab860 con 0x7f987c15f040 2023-10-16T08:51:47.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.570+0000 7f9873fff640 1 -- 172.21.15.94:0/2167651015 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f987c0ab860 con 0x7f987c15f040 2023-10-16T08:51:47.573 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:47.573 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f985c06ae70 msgr2=0x7f985c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f985c06ae70 0x7f985c06d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f986c035000 tx=0x7f986c030000 comp rx=0 tx=0).stop 2023-10-16T08:51:47.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 msgr2=0x7f987c0c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 0x7f987c0c5660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f987400d5d0 tx=0x7f987400da90 comp rx=0 tx=0).stop 2023-10-16T08:51:47.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 shutdown_connections 2023-10-16T08:51:47.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f987c15f040 0x7f987c0c5660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f987c15ad00 0x7f987c0c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f985c06ae70 0x7f985c06d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 --2- 172.21.15.94:0/2167651015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f987c0b0010 0x7f987c0c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.573+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 >> 172.21.15.94:0/2167651015 conn(0x7f987c06c1c0 msgr2=0x7f987c0adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:47.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.574+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 shutdown_connections 2023-10-16T08:51:47.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.574+0000 7f9881d73640 1 -- 172.21.15.94:0/2167651015 wait complete. 2023-10-16T08:51:47.595 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T08:51:47.595 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T08:51:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.808+0000 7fdf0fec9640 1 Processor -- start 2023-10-16T08:51:47.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.808+0000 7fdf0fec9640 1 -- start start 2023-10-16T08:51:47.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0fec9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0fec9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf0815f040 0x7fdf0815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0fec9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf080707f0 con 0x7fdf0815ad00 2023-10-16T08:51:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0fec9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf08070ad0 con 0x7fdf0815f040 2023-10-16T08:51:47.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0fec9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0815b1d0 con 0x7fdf080b0010 2023-10-16T08:51:47.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0e466640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf0815f040 0x7fdf0815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0dc65640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0e466640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf0815f040 0x7fdf0815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:57938/0 (socket says 172.21.15.94:57938) 2023-10-16T08:51:47.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0dc65640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:46838/0 (socket says 172.21.15.94:46838) 2023-10-16T08:51:47.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.810+0000 7fdf0e466640 1 -- 172.21.15.94:0/1158408944 learned_addr learned my addr 172.21.15.94:0/1158408944 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:47.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.811+0000 7fdf0e466640 1 -- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 msgr2=0x7fdf080701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:47.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.811+0000 7fdf0e466640 1 --2- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.811+0000 7fdf0e466640 1 -- 172.21.15.94:0/1158408944 >> v1:172.21.15.130:6789/0 conn(0x7fdf0815ad00 legacy=0x7fdf080b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.811+0000 7fdf0e466640 1 -- 172.21.15.94:0/1158408944 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0815b4b0 con 0x7fdf0815f040 2023-10-16T08:51:47.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.812+0000 7fdf0e466640 1 --2- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815f040 0x7fdf0815b9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009e50 tx=0x7fdf0002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5dcd48ff29fe63 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:47.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.813+0000 7fdf0cc63640 1 -- 172.21.15.94:0/1158408944 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0002cb00 con 0x7fdf0815f040 2023-10-16T08:51:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.813+0000 7fdf0cc63640 1 -- 172.21.15.94:0/1158408944 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0002cc60 con 0x7fdf0815f040 2023-10-16T08:51:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.813+0000 7fdf0cc63640 1 -- 172.21.15.94:0/1158408944 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000343f0 con 0x7fdf0815f040 2023-10-16T08:51:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 -- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815f040 msgr2=0x7fdf0815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815f040 0x7fdf0815b9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009e50 tx=0x7fdf0002bf60 comp rx=0 tx=0).stop 2023-10-16T08:51:47.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 -- 172.21.15.94:0/1158408944 shutdown_connections 2023-10-16T08:51:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815f040 0x7fdf0815b9d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/1158408944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 -- 172.21.15.94:0/1158408944 >> 172.21.15.94:0/1158408944 conn(0x7fdf0806c1c0 msgr2=0x7fdf0806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 -- 172.21.15.94:0/1158408944 shutdown_connections 2023-10-16T08:51:47.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.814+0000 7fdf0fec9640 1 -- 172.21.15.94:0/1158408944 wait complete. 2023-10-16T08:51:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.816+0000 7fdf0fec9640 1 Processor -- start 2023-10-16T08:51:47.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.816+0000 7fdf0fec9640 1 -- start start 2023-10-16T08:51:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0fec9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0fec9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815ad00 0x7fdf081efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0fec9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 0x7fdf080c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0fec9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080c3680 con 0x7fdf0815f040 2023-10-16T08:51:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0fec9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f01d0 con 0x7fdf0815ad00 2023-10-16T08:51:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0fec9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080c2d40 con 0x7fdf080b0010 2023-10-16T08:51:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0e466640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 0x7fdf080c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0e466640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 0x7fdf080c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56812/0 (socket says 172.21.15.94:56812) 2023-10-16T08:51:47.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.817+0000 7fdf0e466640 1 -- 172.21.15.94:0/3980398661 learned_addr learned my addr 172.21.15.94:0/3980398661 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0dc65640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0d464640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815ad00 0x7fdf081efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0e466640 1 -- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 msgr2=0x7fdf080c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0e466640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0e466640 1 -- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815ad00 msgr2=0x7fdf081efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:47.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0e466640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815ad00 0x7fdf081efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:47.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0e466640 1 -- 172.21.15.94:0/3980398661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009b30 con 0x7fdf0815f040 2023-10-16T08:51:47.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0d464640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815ad00 0x7fdf081efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:47.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0e466640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 0x7fdf080c44c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009e50 tx=0x7fdf00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:47.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0003e450 con 0x7fdf0815f040 2023-10-16T08:51:47.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0003e5b0 con 0x7fdf0815f040 2023-10-16T08:51:47.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf080c4d10 con 0x7fdf0815f040 2023-10-16T08:51:47.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.818+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0003e960 con 0x7fdf0815f040 2023-10-16T08:51:47.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.819+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf080c32a0 con 0x7fdf0815f040 2023-10-16T08:51:47.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.820+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf080c37c0 con 0x7fdf0815f040 2023-10-16T08:51:47.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.821+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf0003eac0 con 0x7fdf0815f040 2023-10-16T08:51:47.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.822+0000 7fdefe7fc640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdeec06ae70 0x7fdeec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:47.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.822+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf000acba0 con 0x7fdf0815f040 2023-10-16T08:51:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.822+0000 7fdf0dc65640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdeec06ae70 0x7fdeec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.823+0000 7fdf0dc65640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdeec06ae70 0x7fdeec06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009ad0 tx=0x7fdf04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:47.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:47.825+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf00077a60 con 0x7fdf0815f040 2023-10-16T08:51:48.017 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.015+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 --> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf08070db0 con 0x7fdeec06ae70 2023-10-16T08:51:48.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.046+0000 7fdefe7fc640 1 -- 172.21.15.94:0/3980398661 <== mgr.4107 v2:172.21.15.94:6832/2208206022 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345111 (secure 0 0 0) 0x7fdf040119a0 con 0x7fdeec06ae70 2023-10-16T08:51:48.053 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:48.055 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2023-10-16T08:51:48.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.053+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdeec06ae70 msgr2=0x7fdeec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.053+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdeec06ae70 0x7fdeec06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009ad0 tx=0x7fdf04008040 comp rx=0 tx=0).stop 2023-10-16T08:51:48.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.053+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 msgr2=0x7fdf080c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.053+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 0x7fdf080c44c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009e50 tx=0x7fdf00004a40 comp rx=0 tx=0).stop 2023-10-16T08:51:48.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 shutdown_connections 2023-10-16T08:51:48.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf0815f040 0x7fdf080c44c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdeec06ae70 0x7fdeec06d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf0815ad00 0x7fdf081efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 --2- 172.21.15.94:0/3980398661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf080b0010 0x7fdf080c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 >> 172.21.15.94:0/3980398661 conn(0x7fdf0806c1c0 msgr2=0x7fdf080aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:48.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 shutdown_connections 2023-10-16T08:51:48.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.054+0000 7fdf0fec9640 1 -- 172.21.15.94:0/3980398661 wait complete. 2023-10-16T08:51:48.075 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-10-16T08:51:47.822676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236140,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":3416064,"data_stored":2045726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005022"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664629+0000","last_change":"2023-10-16T08:51:18.472763+0000","last_active":"2023-10-16T08:51:23.664629+0000","last_peered":"2023-10-16T08:51:23.664629+0000","last_clean":"2023-10-16T08:51:23.664629+0000","last_became_active":"2023-10-16T08:51:18.472447+0000","last_became_peered":"2023-10-16T08:51:18.472447+0000","last_unstale":"2023-10-16T08:51:23.664629+0000","last_undegraded":"2023-10-16T08:51:23.664629+0000","last_fullsized":"2023-10-16T08:51:23.664629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:21.069905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656591+0000","last_change":"2023-10-16T08:51:19.478851+0000","last_active":"2023-10-16T08:51:23.656591+0000","last_peered":"2023-10-16T08:51:23.656591+0000","last_clean":"2023-10-16T08:51:23.656591+0000","last_became_active":"2023-10-16T08:51:19.478587+0000","last_became_peered":"2023-10-16T08:51:19.478587+0000","last_unstale":"2023-10-16T08:51:23.656591+0000","last_undegraded":"2023-10-16T08:51:23.656591+0000","last_fullsized":"2023-10-16T08:51:23.656591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632168+0000","last_change":"2023-10-16T08:51:23.936156+0000","last_active":"2023-10-16T08:51:24.632168+0000","last_peered":"2023-10-16T08:51:24.632168+0000","last_clean":"2023-10-16T08:51:24.632168+0000","last_became_active":"2023-10-16T08:51:23.935275+0000","last_became_peered":"2023-10-16T08:51:23.935275+0000","last_unstale":"2023-10-16T08:51:24.632168+0000","last_undegraded":"2023-10-16T08:51:24.632168+0000","last_fullsized":"2023-10-16T08:51:24.632168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:23.584433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656765+0000","last_change":"2023-10-16T08:51:18.463620+0000","last_active":"2023-10-16T08:51:23.656765+0000","last_peered":"2023-10-16T08:51:23.656765+0000","last_clean":"2023-10-16T08:51:23.656765+0000","last_became_active":"2023-10-16T08:51:18.463088+0000","last_became_peered":"2023-10-16T08:51:18.463088+0000","last_unstale":"2023-10-16T08:51:23.656765+0000","last_undegraded":"2023-10-16T08:51:23.656765+0000","last_fullsized":"2023-10-16T08:51:23.656765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664153+0000","last_change":"2023-10-16T08:51:19.483778+0000","last_active":"2023-10-16T08:51:23.664153+0000","last_peered":"2023-10-16T08:51:23.664153+0000","last_clean":"2023-10-16T08:51:23.664153+0000","last_became_active":"2023-10-16T08:51:19.479538+0000","last_became_peered":"2023-10-16T08:51:19.479538+0000","last_unstale":"2023-10-16T08:51:23.664153+0000","last_undegraded":"2023-10-16T08:51:23.664153+0000","last_fullsized":"2023-10-16T08:51:23.664153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001998+0000","last_change":"2023-10-16T08:51:23.687361+0000","last_active":"2023-10-16T08:51:25.001998+0000","last_peered":"2023-10-16T08:51:25.001998+0000","last_clean":"2023-10-16T08:51:25.001998+0000","last_became_active":"2023-10-16T08:51:23.686758+0000","last_became_peered":"2023-10-16T08:51:23.686758+0000","last_unstale":"2023-10-16T08:51:25.001998+0000","last_undegraded":"2023-10-16T08:51:25.001998+0000","last_fullsized":"2023-10-16T08:51:25.001998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:04.836076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932744+0000","last_change":"2023-10-16T08:51:18.479211+0000","last_active":"2023-10-16T08:51:23.932744+0000","last_peered":"2023-10-16T08:51:23.932744+0000","last_clean":"2023-10-16T08:51:23.932744+0000","last_became_active":"2023-10-16T08:51:18.478753+0000","last_became_peered":"2023-10-16T08:51:18.478753+0000","last_unstale":"2023-10-16T08:51:23.932744+0000","last_undegraded":"2023-10-16T08:51:23.932744+0000","last_fullsized":"2023-10-16T08:51:23.932744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:13.887687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655634+0000","last_change":"2023-10-16T08:51:19.497246+0000","last_active":"2023-10-16T08:51:23.655634+0000","last_peered":"2023-10-16T08:51:23.655634+0000","last_clean":"2023-10-16T08:51:23.655634+0000","last_became_active":"2023-10-16T08:51:19.496966+0000","last_became_peered":"2023-10-16T08:51:19.496966+0000","last_unstale":"2023-10-16T08:51:23.655634+0000","last_undegraded":"2023-10-16T08:51:23.655634+0000","last_fullsized":"2023-10-16T08:51:23.655634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002504+0000","last_change":"2023-10-16T08:51:23.694314+0000","last_active":"2023-10-16T08:51:25.002504+0000","last_peered":"2023-10-16T08:51:25.002504+0000","last_clean":"2023-10-16T08:51:25.002504+0000","last_became_active":"2023-10-16T08:51:23.693789+0000","last_became_peered":"2023-10-16T08:51:23.693789+0000","last_unstale":"2023-10-16T08:51:25.002504+0000","last_undegraded":"2023-10-16T08:51:25.002504+0000","last_fullsized":"2023-10-16T08:51:25.002504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:34.725310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928781+0000","last_change":"2023-10-16T08:51:18.480432+0000","last_active":"2023-10-16T08:51:23.928781+0000","last_peered":"2023-10-16T08:51:23.928781+0000","last_clean":"2023-10-16T08:51:23.928781+0000","last_became_active":"2023-10-16T08:51:18.479649+0000","last_became_peered":"2023-10-16T08:51:18.479649+0000","last_unstale":"2023-10-16T08:51:23.928781+0000","last_undegraded":"2023-10-16T08:51:23.928781+0000","last_fullsized":"2023-10-16T08:51:23.928781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:59.612239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657088+0000","last_change":"2023-10-16T08:51:19.501369+0000","last_active":"2023-10-16T08:51:23.657088+0000","last_peered":"2023-10-16T08:51:23.657088+0000","last_clean":"2023-10-16T08:51:23.657088+0000","last_became_active":"2023-10-16T08:51:19.501077+0000","last_became_peered":"2023-10-16T08:51:19.501077+0000","last_unstale":"2023-10-16T08:51:23.657088+0000","last_undegraded":"2023-10-16T08:51:23.657088+0000","last_fullsized":"2023-10-16T08:51:23.657088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:04.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002122+0000","last_change":"2023-10-16T08:51:23.684667+0000","last_active":"2023-10-16T08:51:25.002122+0000","last_peered":"2023-10-16T08:51:25.002122+0000","last_clean":"2023-10-16T08:51:25.002122+0000","last_became_active":"2023-10-16T08:51:23.683885+0000","last_became_peered":"2023-10-16T08:51:23.683885+0000","last_unstale":"2023-10-16T08:51:25.002122+0000","last_undegraded":"2023-10-16T08:51:25.002122+0000","last_fullsized":"2023-10-16T08:51:25.002122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:31.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669202+0000","last_change":"2023-10-16T08:51:19.494151+0000","last_active":"2023-10-16T08:51:23.669202+0000","last_peered":"2023-10-16T08:51:23.669202+0000","last_clean":"2023-10-16T08:51:23.669202+0000","last_became_active":"2023-10-16T08:51:19.493825+0000","last_became_peered":"2023-10-16T08:51:19.493825+0000","last_unstale":"2023-10-16T08:51:23.669202+0000","last_undegraded":"2023-10-16T08:51:23.669202+0000","last_fullsized":"2023-10-16T08:51:23.669202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932601+0000","last_change":"2023-10-16T08:51:18.475975+0000","last_active":"2023-10-16T08:51:23.932601+0000","last_peered":"2023-10-16T08:51:23.932601+0000","last_clean":"2023-10-16T08:51:23.932601+0000","last_became_active":"2023-10-16T08:51:18.474515+0000","last_became_peered":"2023-10-16T08:51:18.474515+0000","last_unstale":"2023-10-16T08:51:23.932601+0000","last_undegraded":"2023-10-16T08:51:23.932601+0000","last_fullsized":"2023-10-16T08:51:23.932601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:19.036322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004645+0000","last_change":"2023-10-16T08:51:23.687410+0000","last_active":"2023-10-16T08:51:25.004645+0000","last_peered":"2023-10-16T08:51:25.004645+0000","last_clean":"2023-10-16T08:51:25.004645+0000","last_became_active":"2023-10-16T08:51:23.686729+0000","last_became_peered":"2023-10-16T08:51:23.686729+0000","last_unstale":"2023-10-16T08:51:25.004645+0000","last_undegraded":"2023-10-16T08:51:25.004645+0000","last_fullsized":"2023-10-16T08:51:25.004645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653922+0000","last_change":"2023-10-16T08:51:19.472792+0000","last_active":"2023-10-16T08:51:23.653922+0000","last_peered":"2023-10-16T08:51:23.653922+0000","last_clean":"2023-10-16T08:51:23.653922+0000","last_became_active":"2023-10-16T08:51:19.472538+0000","last_became_peered":"2023-10-16T08:51:19.472538+0000","last_unstale":"2023-10-16T08:51:23.653922+0000","last_undegraded":"2023-10-16T08:51:23.653922+0000","last_fullsized":"2023-10-16T08:51:23.653922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676788+0000","last_change":"2023-10-16T08:51:18.460657+0000","last_active":"2023-10-16T08:51:23.676788+0000","last_peered":"2023-10-16T08:51:23.676788+0000","last_clean":"2023-10-16T08:51:23.676788+0000","last_became_active":"2023-10-16T08:51:18.460294+0000","last_became_peered":"2023-10-16T08:51:18.460294+0000","last_unstale":"2023-10-16T08:51:23.676788+0000","last_undegraded":"2023-10-16T08:51:23.676788+0000","last_fullsized":"2023-10-16T08:51:23.676788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003182+0000","last_change":"2023-10-16T08:51:23.687710+0000","last_active":"2023-10-16T08:51:25.003182+0000","last_peered":"2023-10-16T08:51:25.003182+0000","last_clean":"2023-10-16T08:51:25.003182+0000","last_became_active":"2023-10-16T08:51:23.686904+0000","last_became_peered":"2023-10-16T08:51:23.686904+0000","last_unstale":"2023-10-16T08:51:25.003182+0000","last_undegraded":"2023-10-16T08:51:25.003182+0000","last_fullsized":"2023-10-16T08:51:25.003182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658779+0000","last_change":"2023-10-16T08:51:19.493284+0000","last_active":"2023-10-16T08:51:23.658779+0000","last_peered":"2023-10-16T08:51:23.658779+0000","last_clean":"2023-10-16T08:51:23.658779+0000","last_became_active":"2023-10-16T08:51:19.493001+0000","last_became_peered":"2023-10-16T08:51:19.493001+0000","last_unstale":"2023-10-16T08:51:23.658779+0000","last_undegraded":"2023-10-16T08:51:23.658779+0000","last_fullsized":"2023-10-16T08:51:23.658779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676274+0000","last_change":"2023-10-16T08:51:18.474813+0000","last_active":"2023-10-16T08:51:23.676274+0000","last_peered":"2023-10-16T08:51:23.676274+0000","last_clean":"2023-10-16T08:51:23.676274+0000","last_became_active":"2023-10-16T08:51:18.474551+0000","last_became_peered":"2023-10-16T08:51:18.474551+0000","last_unstale":"2023-10-16T08:51:23.676274+0000","last_undegraded":"2023-10-16T08:51:23.676274+0000","last_fullsized":"2023-10-16T08:51:23.676274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:14:07.961126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630476+0000","last_change":"2023-10-16T08:51:23.936794+0000","last_active":"2023-10-16T08:51:24.630476+0000","last_peered":"2023-10-16T08:51:24.630476+0000","last_clean":"2023-10-16T08:51:24.630476+0000","last_became_active":"2023-10-16T08:51:23.936108+0000","last_became_peered":"2023-10-16T08:51:23.936108+0000","last_unstale":"2023-10-16T08:51:24.630476+0000","last_undegraded":"2023-10-16T08:51:24.630476+0000","last_fullsized":"2023-10-16T08:51:24.630476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:54.425130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674596+0000","last_change":"2023-10-16T08:51:19.487794+0000","last_active":"2023-10-16T08:51:23.674596+0000","last_peered":"2023-10-16T08:51:23.674596+0000","last_clean":"2023-10-16T08:51:23.674596+0000","last_became_active":"2023-10-16T08:51:19.487394+0000","last_became_peered":"2023-10-16T08:51:19.487394+0000","last_unstale":"2023-10-16T08:51:23.674596+0000","last_undegraded":"2023-10-16T08:51:23.674596+0000","last_fullsized":"2023-10-16T08:51:23.674596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:55.545822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927706+0000","last_change":"2023-10-16T08:51:18.475910+0000","last_active":"2023-10-16T08:51:23.927706+0000","last_peered":"2023-10-16T08:51:23.927706+0000","last_clean":"2023-10-16T08:51:23.927706+0000","last_became_active":"2023-10-16T08:51:18.475567+0000","last_became_peered":"2023-10-16T08:51:18.475567+0000","last_unstale":"2023-10-16T08:51:23.927706+0000","last_undegraded":"2023-10-16T08:51:23.927706+0000","last_fullsized":"2023-10-16T08:51:23.927706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003131+0000","last_change":"2023-10-16T08:51:23.688779+0000","last_active":"2023-10-16T08:51:25.003131+0000","last_peered":"2023-10-16T08:51:25.003131+0000","last_clean":"2023-10-16T08:51:25.003131+0000","last_became_active":"2023-10-16T08:51:23.688065+0000","last_became_peered":"2023-10-16T08:51:23.688065+0000","last_unstale":"2023-10-16T08:51:25.003131+0000","last_undegraded":"2023-10-16T08:51:25.003131+0000","last_fullsized":"2023-10-16T08:51:25.003131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:37.434614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.668428+0000","last_change":"2023-10-16T08:51:19.483164+0000","last_active":"2023-10-16T08:51:23.668428+0000","last_peered":"2023-10-16T08:51:23.668428+0000","last_clean":"2023-10-16T08:51:23.668428+0000","last_became_active":"2023-10-16T08:51:19.482701+0000","last_became_peered":"2023-10-16T08:51:19.482701+0000","last_unstale":"2023-10-16T08:51:23.668428+0000","last_undegraded":"2023-10-16T08:51:23.668428+0000","last_fullsized":"2023-10-16T08:51:23.668428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:30:05.215149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673453+0000","last_change":"2023-10-16T08:51:18.479436+0000","last_active":"2023-10-16T08:51:23.673453+0000","last_peered":"2023-10-16T08:51:23.673453+0000","last_clean":"2023-10-16T08:51:23.673453+0000","last_became_active":"2023-10-16T08:51:18.479112+0000","last_became_peered":"2023-10-16T08:51:18.479112+0000","last_unstale":"2023-10-16T08:51:23.673453+0000","last_undegraded":"2023-10-16T08:51:23.673453+0000","last_fullsized":"2023-10-16T08:51:23.673453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:18.761013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002204+0000","last_change":"2023-10-16T08:51:23.941023+0000","last_active":"2023-10-16T08:51:25.002204+0000","last_peered":"2023-10-16T08:51:25.002204+0000","last_clean":"2023-10-16T08:51:25.002204+0000","last_became_active":"2023-10-16T08:51:23.939686+0000","last_became_peered":"2023-10-16T08:51:23.939686+0000","last_unstale":"2023-10-16T08:51:25.002204+0000","last_undegraded":"2023-10-16T08:51:25.002204+0000","last_fullsized":"2023-10-16T08:51:25.002204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:13.170275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657614+0000","last_change":"2023-10-16T08:51:19.480568+0000","last_active":"2023-10-16T08:51:23.657614+0000","last_peered":"2023-10-16T08:51:23.657614+0000","last_clean":"2023-10-16T08:51:23.657614+0000","last_became_active":"2023-10-16T08:51:19.480223+0000","last_became_peered":"2023-10-16T08:51:19.480223+0000","last_unstale":"2023-10-16T08:51:23.657614+0000","last_undegraded":"2023-10-16T08:51:23.657614+0000","last_fullsized":"2023-10-16T08:51:23.657614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.426065+0000","last_change":"2023-10-16T08:51:18.478908+0000","last_active":"2023-10-16T08:51:24.426065+0000","last_peered":"2023-10-16T08:51:24.426065+0000","last_clean":"2023-10-16T08:51:24.426065+0000","last_became_active":"2023-10-16T08:51:18.478555+0000","last_became_peered":"2023-10-16T08:51:18.478555+0000","last_unstale":"2023-10-16T08:51:24.426065+0000","last_undegraded":"2023-10-16T08:51:24.426065+0000","last_fullsized":"2023-10-16T08:51:24.426065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:08.306658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631947+0000","last_change":"2023-10-16T08:51:23.932191+0000","last_active":"2023-10-16T08:51:24.631947+0000","last_peered":"2023-10-16T08:51:24.631947+0000","last_clean":"2023-10-16T08:51:24.631947+0000","last_became_active":"2023-10-16T08:51:23.930143+0000","last_became_peered":"2023-10-16T08:51:23.930143+0000","last_unstale":"2023-10-16T08:51:24.631947+0000","last_undegraded":"2023-10-16T08:51:24.631947+0000","last_fullsized":"2023-10-16T08:51:24.631947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:39:17.871021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676364+0000","last_change":"2023-10-16T08:51:19.485482+0000","last_active":"2023-10-16T08:51:23.676364+0000","last_peered":"2023-10-16T08:51:23.676364+0000","last_clean":"2023-10-16T08:51:23.676364+0000","last_became_active":"2023-10-16T08:51:19.485128+0000","last_became_peered":"2023-10-16T08:51:19.485128+0000","last_unstale":"2023-10-16T08:51:23.676364+0000","last_undegraded":"2023-10-16T08:51:23.676364+0000","last_fullsized":"2023-10-16T08:51:23.676364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:44:22.627895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933002+0000","last_change":"2023-10-16T08:51:18.478714+0000","last_active":"2023-10-16T08:51:23.933002+0000","last_peered":"2023-10-16T08:51:23.933002+0000","last_clean":"2023-10-16T08:51:23.933002+0000","last_became_active":"2023-10-16T08:51:18.478354+0000","last_became_peered":"2023-10-16T08:51:18.478354+0000","last_unstale":"2023-10-16T08:51:23.933002+0000","last_undegraded":"2023-10-16T08:51:23.933002+0000","last_fullsized":"2023-10-16T08:51:23.933002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780092+0000","last_change":"2023-10-16T08:51:23.929043+0000","last_active":"2023-10-16T08:51:24.780092+0000","last_peered":"2023-10-16T08:51:24.780092+0000","last_clean":"2023-10-16T08:51:24.780092+0000","last_became_active":"2023-10-16T08:51:23.928546+0000","last_became_peered":"2023-10-16T08:51:23.928546+0000","last_unstale":"2023-10-16T08:51:24.780092+0000","last_undegraded":"2023-10-16T08:51:24.780092+0000","last_fullsized":"2023-10-16T08:51:24.780092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656981+0000","last_change":"2023-10-16T08:51:19.489157+0000","last_active":"2023-10-16T08:51:23.656981+0000","last_peered":"2023-10-16T08:51:23.656981+0000","last_clean":"2023-10-16T08:51:23.656981+0000","last_became_active":"2023-10-16T08:51:19.488862+0000","last_became_peered":"2023-10-16T08:51:19.488862+0000","last_unstale":"2023-10-16T08:51:23.656981+0000","last_undegraded":"2023-10-16T08:51:23.656981+0000","last_fullsized":"2023-10-16T08:51:23.656981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:15.931317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676443+0000","last_change":"2023-10-16T08:51:18.453987+0000","last_active":"2023-10-16T08:51:23.676443+0000","last_peered":"2023-10-16T08:51:23.676443+0000","last_clean":"2023-10-16T08:51:23.676443+0000","last_became_active":"2023-10-16T08:51:18.453706+0000","last_became_peered":"2023-10-16T08:51:18.453706+0000","last_unstale":"2023-10-16T08:51:23.676443+0000","last_undegraded":"2023-10-16T08:51:23.676443+0000","last_fullsized":"2023-10-16T08:51:23.676443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:24.379905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629365+0000","last_change":"2023-10-16T08:51:23.690542+0000","last_active":"2023-10-16T08:51:24.629365+0000","last_peered":"2023-10-16T08:51:24.629365+0000","last_clean":"2023-10-16T08:51:24.629365+0000","last_became_active":"2023-10-16T08:51:23.690171+0000","last_became_peered":"2023-10-16T08:51:23.690171+0000","last_unstale":"2023-10-16T08:51:24.629365+0000","last_undegraded":"2023-10-16T08:51:24.629365+0000","last_fullsized":"2023-10-16T08:51:24.629365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682083+0000","last_change":"2023-10-16T08:51:19.486242+0000","last_active":"2023-10-16T08:51:23.682083+0000","last_peered":"2023-10-16T08:51:23.682083+0000","last_clean":"2023-10-16T08:51:23.682083+0000","last_became_active":"2023-10-16T08:51:19.485941+0000","last_became_peered":"2023-10-16T08:51:19.485941+0000","last_unstale":"2023-10-16T08:51:23.682083+0000","last_undegraded":"2023-10-16T08:51:23.682083+0000","last_fullsized":"2023-10-16T08:51:23.682083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:06.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656642+0000","last_change":"2023-10-16T08:51:18.457937+0000","last_active":"2023-10-16T08:51:23.656642+0000","last_peered":"2023-10-16T08:51:23.656642+0000","last_clean":"2023-10-16T08:51:23.656642+0000","last_became_active":"2023-10-16T08:51:18.457566+0000","last_became_peered":"2023-10-16T08:51:18.457566+0000","last_unstale":"2023-10-16T08:51:23.656642+0000","last_undegraded":"2023-10-16T08:51:23.656642+0000","last_fullsized":"2023-10-16T08:51:23.656642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:38.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630284+0000","last_change":"2023-10-16T08:51:23.690160+0000","last_active":"2023-10-16T08:51:24.630284+0000","last_peered":"2023-10-16T08:51:24.630284+0000","last_clean":"2023-10-16T08:51:24.630284+0000","last_became_active":"2023-10-16T08:51:23.689134+0000","last_became_peered":"2023-10-16T08:51:23.689134+0000","last_unstale":"2023-10-16T08:51:24.630284+0000","last_undegraded":"2023-10-16T08:51:24.630284+0000","last_fullsized":"2023-10-16T08:51:24.630284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:38.891384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674275+0000","last_change":"2023-10-16T08:51:19.477337+0000","last_active":"2023-10-16T08:51:23.674275+0000","last_peered":"2023-10-16T08:51:23.674275+0000","last_clean":"2023-10-16T08:51:23.674275+0000","last_became_active":"2023-10-16T08:51:19.476998+0000","last_became_peered":"2023-10-16T08:51:19.476998+0000","last_unstale":"2023-10-16T08:51:23.674275+0000","last_undegraded":"2023-10-16T08:51:23.674275+0000","last_fullsized":"2023-10-16T08:51:23.674275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:33.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654094+0000","last_change":"2023-10-16T08:51:18.463848+0000","last_active":"2023-10-16T08:51:23.654094+0000","last_peered":"2023-10-16T08:51:23.654094+0000","last_clean":"2023-10-16T08:51:23.654094+0000","last_became_active":"2023-10-16T08:51:18.463071+0000","last_became_peered":"2023-10-16T08:51:18.463071+0000","last_unstale":"2023-10-16T08:51:23.654094+0000","last_undegraded":"2023-10-16T08:51:23.654094+0000","last_fullsized":"2023-10-16T08:51:23.654094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630687+0000","last_change":"2023-10-16T08:51:23.691542+0000","last_active":"2023-10-16T08:51:24.630687+0000","last_peered":"2023-10-16T08:51:24.630687+0000","last_clean":"2023-10-16T08:51:24.630687+0000","last_became_active":"2023-10-16T08:51:23.691184+0000","last_became_peered":"2023-10-16T08:51:23.691184+0000","last_unstale":"2023-10-16T08:51:24.630687+0000","last_undegraded":"2023-10-16T08:51:24.630687+0000","last_fullsized":"2023-10-16T08:51:24.630687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:30.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663653+0000","last_change":"2023-10-16T08:51:19.489377+0000","last_active":"2023-10-16T08:51:23.663653+0000","last_peered":"2023-10-16T08:51:23.663653+0000","last_clean":"2023-10-16T08:51:23.663653+0000","last_became_active":"2023-10-16T08:51:19.488616+0000","last_became_peered":"2023-10-16T08:51:19.488616+0000","last_unstale":"2023-10-16T08:51:23.663653+0000","last_undegraded":"2023-10-16T08:51:23.663653+0000","last_fullsized":"2023-10-16T08:51:23.663653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927969+0000","last_change":"2023-10-16T08:51:18.476307+0000","last_active":"2023-10-16T08:51:23.927969+0000","last_peered":"2023-10-16T08:51:23.927969+0000","last_clean":"2023-10-16T08:51:23.927969+0000","last_became_active":"2023-10-16T08:51:18.475934+0000","last_became_peered":"2023-10-16T08:51:18.475934+0000","last_unstale":"2023-10-16T08:51:23.927969+0000","last_undegraded":"2023-10-16T08:51:23.927969+0000","last_fullsized":"2023-10-16T08:51:23.927969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780681+0000","last_change":"2023-10-16T08:51:23.940016+0000","last_active":"2023-10-16T08:51:24.780681+0000","last_peered":"2023-10-16T08:51:24.780681+0000","last_clean":"2023-10-16T08:51:24.780681+0000","last_became_active":"2023-10-16T08:51:23.939540+0000","last_became_peered":"2023-10-16T08:51:23.939540+0000","last_unstale":"2023-10-16T08:51:24.780681+0000","last_undegraded":"2023-10-16T08:51:24.780681+0000","last_fullsized":"2023-10-16T08:51:24.780681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:06.205944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655322+0000","last_change":"2023-10-16T08:51:19.488905+0000","last_active":"2023-10-16T08:51:23.655322+0000","last_peered":"2023-10-16T08:51:23.655322+0000","last_clean":"2023-10-16T08:51:23.655322+0000","last_became_active":"2023-10-16T08:51:19.488447+0000","last_became_peered":"2023-10-16T08:51:19.488447+0000","last_unstale":"2023-10-16T08:51:23.655322+0000","last_undegraded":"2023-10-16T08:51:23.655322+0000","last_fullsized":"2023-10-16T08:51:23.655322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654978+0000","last_change":"2023-10-16T08:51:18.461925+0000","last_active":"2023-10-16T08:51:23.654978+0000","last_peered":"2023-10-16T08:51:23.654978+0000","last_clean":"2023-10-16T08:51:23.654978+0000","last_became_active":"2023-10-16T08:51:18.461503+0000","last_became_peered":"2023-10-16T08:51:18.461503+0000","last_unstale":"2023-10-16T08:51:23.654978+0000","last_undegraded":"2023-10-16T08:51:23.654978+0000","last_fullsized":"2023-10-16T08:51:23.654978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:25.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928140+0000","last_change":"2023-10-16T08:51:09.503647+0000","last_active":"2023-10-16T08:51:23.928140+0000","last_peered":"2023-10-16T08:51:23.928140+0000","last_clean":"2023-10-16T08:51:23.928140+0000","last_became_active":"2023-10-16T08:51:09.501573+0000","last_became_peered":"2023-10-16T08:51:09.501573+0000","last_unstale":"2023-10-16T08:51:23.928140+0000","last_undegraded":"2023-10-16T08:51:23.928140+0000","last_fullsized":"2023-10-16T08:51:23.928140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_clean_scrub_stamp":"2023-10-16T08:51:08.277379+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:32.541738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632345+0000","last_change":"2023-10-16T08:51:23.937102+0000","last_active":"2023-10-16T08:51:24.632345+0000","last_peered":"2023-10-16T08:51:24.632345+0000","last_clean":"2023-10-16T08:51:24.632345+0000","last_became_active":"2023-10-16T08:51:23.935917+0000","last_became_peered":"2023-10-16T08:51:23.935917+0000","last_unstale":"2023-10-16T08:51:24.632345+0000","last_undegraded":"2023-10-16T08:51:24.632345+0000","last_fullsized":"2023-10-16T08:51:24.632345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932357+0000","last_change":"2023-10-16T08:51:19.482065+0000","last_active":"2023-10-16T08:51:23.932357+0000","last_peered":"2023-10-16T08:51:23.932357+0000","last_clean":"2023-10-16T08:51:23.932357+0000","last_became_active":"2023-10-16T08:51:19.481709+0000","last_became_peered":"2023-10-16T08:51:19.481709+0000","last_unstale":"2023-10-16T08:51:23.932357+0000","last_undegraded":"2023-10-16T08:51:23.932357+0000","last_fullsized":"2023-10-16T08:51:23.932357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:52.502214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656330+0000","last_change":"2023-10-16T08:51:18.461990+0000","last_active":"2023-10-16T08:51:23.656330+0000","last_peered":"2023-10-16T08:51:23.656330+0000","last_clean":"2023-10-16T08:51:23.656330+0000","last_became_active":"2023-10-16T08:51:18.461726+0000","last_became_peered":"2023-10-16T08:51:18.461726+0000","last_unstale":"2023-10-16T08:51:23.656330+0000","last_undegraded":"2023-10-16T08:51:23.656330+0000","last_fullsized":"2023-10-16T08:51:23.656330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:00.458386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631811+0000","last_change":"2023-10-16T08:51:23.931184+0000","last_active":"2023-10-16T08:51:24.631811+0000","last_peered":"2023-10-16T08:51:24.631811+0000","last_clean":"2023-10-16T08:51:24.631811+0000","last_became_active":"2023-10-16T08:51:23.929798+0000","last_became_peered":"2023-10-16T08:51:23.929798+0000","last_unstale":"2023-10-16T08:51:24.631811+0000","last_undegraded":"2023-10-16T08:51:24.631811+0000","last_fullsized":"2023-10-16T08:51:24.631811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:24.877683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655861+0000","last_change":"2023-10-16T08:51:19.498976+0000","last_active":"2023-10-16T08:51:23.655861+0000","last_peered":"2023-10-16T08:51:23.655861+0000","last_clean":"2023-10-16T08:51:23.655861+0000","last_became_active":"2023-10-16T08:51:19.498594+0000","last_became_peered":"2023-10-16T08:51:19.498594+0000","last_unstale":"2023-10-16T08:51:23.655861+0000","last_undegraded":"2023-10-16T08:51:23.655861+0000","last_fullsized":"2023-10-16T08:51:23.655861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.675885+0000","last_change":"2023-10-16T08:51:18.466809+0000","last_active":"2023-10-16T08:51:23.675885+0000","last_peered":"2023-10-16T08:51:23.675885+0000","last_clean":"2023-10-16T08:51:23.675885+0000","last_became_active":"2023-10-16T08:51:18.466510+0000","last_became_peered":"2023-10-16T08:51:18.466510+0000","last_unstale":"2023-10-16T08:51:23.675885+0000","last_undegraded":"2023-10-16T08:51:23.675885+0000","last_fullsized":"2023-10-16T08:51:23.675885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:21:49.782547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780180+0000","last_change":"2023-10-16T08:51:23.685215+0000","last_active":"2023-10-16T08:51:24.780180+0000","last_peered":"2023-10-16T08:51:24.780180+0000","last_clean":"2023-10-16T08:51:24.780180+0000","last_became_active":"2023-10-16T08:51:23.684822+0000","last_became_peered":"2023-10-16T08:51:23.684822+0000","last_unstale":"2023-10-16T08:51:24.780180+0000","last_undegraded":"2023-10-16T08:51:24.780180+0000","last_fullsized":"2023-10-16T08:51:24.780180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933980+0000","last_change":"2023-10-16T08:51:19.499775+0000","last_active":"2023-10-16T08:51:23.933980+0000","last_peered":"2023-10-16T08:51:23.933980+0000","last_clean":"2023-10-16T08:51:23.933980+0000","last_became_active":"2023-10-16T08:51:19.499561+0000","last_became_peered":"2023-10-16T08:51:19.499561+0000","last_unstale":"2023-10-16T08:51:23.933980+0000","last_undegraded":"2023-10-16T08:51:23.933980+0000","last_fullsized":"2023-10-16T08:51:23.933980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:58:34.736828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655991+0000","last_change":"2023-10-16T08:51:18.461494+0000","last_active":"2023-10-16T08:51:23.655991+0000","last_peered":"2023-10-16T08:51:23.655991+0000","last_clean":"2023-10-16T08:51:23.655991+0000","last_became_active":"2023-10-16T08:51:18.461196+0000","last_became_peered":"2023-10-16T08:51:18.461196+0000","last_unstale":"2023-10-16T08:51:23.655991+0000","last_undegraded":"2023-10-16T08:51:23.655991+0000","last_fullsized":"2023-10-16T08:51:23.655991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004761+0000","last_change":"2023-10-16T08:51:23.942518+0000","last_active":"2023-10-16T08:51:25.004761+0000","last_peered":"2023-10-16T08:51:25.004761+0000","last_clean":"2023-10-16T08:51:25.004761+0000","last_became_active":"2023-10-16T08:51:23.940495+0000","last_became_peered":"2023-10-16T08:51:23.940495+0000","last_unstale":"2023-10-16T08:51:25.004761+0000","last_undegraded":"2023-10-16T08:51:25.004761+0000","last_fullsized":"2023-10-16T08:51:25.004761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932360+0000","last_change":"2023-10-16T08:51:19.502686+0000","last_active":"2023-10-16T08:51:23.932360+0000","last_peered":"2023-10-16T08:51:23.932360+0000","last_clean":"2023-10-16T08:51:23.932360+0000","last_became_active":"2023-10-16T08:51:19.502370+0000","last_became_peered":"2023-10-16T08:51:19.502370+0000","last_unstale":"2023-10-16T08:51:23.932360+0000","last_undegraded":"2023-10-16T08:51:23.932360+0000","last_fullsized":"2023-10-16T08:51:23.932360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:33.452930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682777+0000","last_change":"2023-10-16T08:51:18.457359+0000","last_active":"2023-10-16T08:51:23.682777+0000","last_peered":"2023-10-16T08:51:23.682777+0000","last_clean":"2023-10-16T08:51:23.682777+0000","last_became_active":"2023-10-16T08:51:18.454341+0000","last_became_peered":"2023-10-16T08:51:18.454341+0000","last_unstale":"2023-10-16T08:51:23.682777+0000","last_undegraded":"2023-10-16T08:51:23.682777+0000","last_fullsized":"2023-10-16T08:51:23.682777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001723+0000","last_change":"2023-10-16T08:51:23.687589+0000","last_active":"2023-10-16T08:51:25.001723+0000","last_peered":"2023-10-16T08:51:25.001723+0000","last_clean":"2023-10-16T08:51:25.001723+0000","last_became_active":"2023-10-16T08:51:23.687045+0000","last_became_peered":"2023-10-16T08:51:23.687045+0000","last_unstale":"2023-10-16T08:51:25.001723+0000","last_undegraded":"2023-10-16T08:51:25.001723+0000","last_fullsized":"2023-10-16T08:51:25.001723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:16.195721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927678+0000","last_change":"2023-10-16T08:51:19.499551+0000","last_active":"2023-10-16T08:51:23.927678+0000","last_peered":"2023-10-16T08:51:23.927678+0000","last_clean":"2023-10-16T08:51:23.927678+0000","last_became_active":"2023-10-16T08:51:19.499250+0000","last_became_peered":"2023-10-16T08:51:19.499250+0000","last_unstale":"2023-10-16T08:51:23.927678+0000","last_undegraded":"2023-10-16T08:51:23.927678+0000","last_fullsized":"2023-10-16T08:51:23.927678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:08.959209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653215+0000","last_change":"2023-10-16T08:51:18.452602+0000","last_active":"2023-10-16T08:51:23.653215+0000","last_peered":"2023-10-16T08:51:23.653215+0000","last_clean":"2023-10-16T08:51:23.653215+0000","last_became_active":"2023-10-16T08:51:18.452286+0000","last_became_peered":"2023-10-16T08:51:18.452286+0000","last_unstale":"2023-10-16T08:51:23.653215+0000","last_undegraded":"2023-10-16T08:51:23.653215+0000","last_fullsized":"2023-10-16T08:51:23.653215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:09.991021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780619+0000","last_change":"2023-10-16T08:51:23.680434+0000","last_active":"2023-10-16T08:51:24.780619+0000","last_peered":"2023-10-16T08:51:24.780619+0000","last_clean":"2023-10-16T08:51:24.780619+0000","last_became_active":"2023-10-16T08:51:23.679325+0000","last_became_peered":"2023-10-16T08:51:23.679325+0000","last_unstale":"2023-10-16T08:51:24.780619+0000","last_undegraded":"2023-10-16T08:51:24.780619+0000","last_fullsized":"2023-10-16T08:51:24.780619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:54.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666563+0000","last_change":"2023-10-16T08:51:19.477576+0000","last_active":"2023-10-16T08:51:23.666563+0000","last_peered":"2023-10-16T08:51:23.666563+0000","last_clean":"2023-10-16T08:51:23.666563+0000","last_became_active":"2023-10-16T08:51:19.477091+0000","last_became_peered":"2023-10-16T08:51:19.477091+0000","last_unstale":"2023-10-16T08:51:23.666563+0000","last_undegraded":"2023-10-16T08:51:23.666563+0000","last_fullsized":"2023-10-16T08:51:23.666563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669994+0000","last_change":"2023-10-16T08:51:18.471810+0000","last_active":"2023-10-16T08:51:23.669994+0000","last_peered":"2023-10-16T08:51:23.669994+0000","last_clean":"2023-10-16T08:51:23.669994+0000","last_became_active":"2023-10-16T08:51:18.471510+0000","last_became_peered":"2023-10-16T08:51:18.471510+0000","last_unstale":"2023-10-16T08:51:23.669994+0000","last_undegraded":"2023-10-16T08:51:23.669994+0000","last_fullsized":"2023-10-16T08:51:23.669994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633912+0000","last_change":"2023-10-16T08:51:23.938213+0000","last_active":"2023-10-16T08:51:24.633912+0000","last_peered":"2023-10-16T08:51:24.633912+0000","last_clean":"2023-10-16T08:51:24.633912+0000","last_became_active":"2023-10-16T08:51:23.937788+0000","last_became_peered":"2023-10-16T08:51:23.937788+0000","last_unstale":"2023-10-16T08:51:24.633912+0000","last_undegraded":"2023-10-16T08:51:24.633912+0000","last_fullsized":"2023-10-16T08:51:24.633912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:49:28.604941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932586+0000","last_change":"2023-10-16T08:51:19.505378+0000","last_active":"2023-10-16T08:51:23.932586+0000","last_peered":"2023-10-16T08:51:23.932586+0000","last_clean":"2023-10-16T08:51:23.932586+0000","last_became_active":"2023-10-16T08:51:19.500129+0000","last_became_peered":"2023-10-16T08:51:19.500129+0000","last_unstale":"2023-10-16T08:51:23.932586+0000","last_undegraded":"2023-10-16T08:51:23.932586+0000","last_fullsized":"2023-10-16T08:51:23.932586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:33.223548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656405+0000","last_change":"2023-10-16T08:51:18.462956+0000","last_active":"2023-10-16T08:51:23.656405+0000","last_peered":"2023-10-16T08:51:23.656405+0000","last_clean":"2023-10-16T08:51:23.656405+0000","last_became_active":"2023-10-16T08:51:18.462673+0000","last_became_peered":"2023-10-16T08:51:18.462673+0000","last_unstale":"2023-10-16T08:51:23.656405+0000","last_undegraded":"2023-10-16T08:51:23.656405+0000","last_fullsized":"2023-10-16T08:51:23.656405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:34.739453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.634200+0000","last_change":"2023-10-16T08:51:23.938458+0000","last_active":"2023-10-16T08:51:24.634200+0000","last_peered":"2023-10-16T08:51:24.634200+0000","last_clean":"2023-10-16T08:51:24.634200+0000","last_became_active":"2023-10-16T08:51:23.938009+0000","last_became_peered":"2023-10-16T08:51:23.938009+0000","last_unstale":"2023-10-16T08:51:24.634200+0000","last_undegraded":"2023-10-16T08:51:24.634200+0000","last_fullsized":"2023-10-16T08:51:24.634200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:17:08.498890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663209+0000","last_change":"2023-10-16T08:51:19.490700+0000","last_active":"2023-10-16T08:51:23.663209+0000","last_peered":"2023-10-16T08:51:23.663209+0000","last_clean":"2023-10-16T08:51:23.663209+0000","last_became_active":"2023-10-16T08:51:19.490423+0000","last_became_peered":"2023-10-16T08:51:19.490423+0000","last_unstale":"2023-10-16T08:51:23.663209+0000","last_undegraded":"2023-10-16T08:51:23.663209+0000","last_fullsized":"2023-10-16T08:51:23.663209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:19.773784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663431+0000","last_change":"2023-10-16T08:51:18.467662+0000","last_active":"2023-10-16T08:51:23.663431+0000","last_peered":"2023-10-16T08:51:23.663431+0000","last_clean":"2023-10-16T08:51:23.663431+0000","last_became_active":"2023-10-16T08:51:18.466371+0000","last_became_peered":"2023-10-16T08:51:18.466371+0000","last_unstale":"2023-10-16T08:51:23.663431+0000","last_undegraded":"2023-10-16T08:51:23.663431+0000","last_fullsized":"2023-10-16T08:51:23.663431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:41:34.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.009698+0000","last_change":"2023-10-16T08:51:23.933148+0000","last_active":"2023-10-16T08:51:25.009698+0000","last_peered":"2023-10-16T08:51:25.009698+0000","last_clean":"2023-10-16T08:51:25.009698+0000","last_became_active":"2023-10-16T08:51:23.929507+0000","last_became_peered":"2023-10-16T08:51:23.929507+0000","last_unstale":"2023-10-16T08:51:25.009698+0000","last_undegraded":"2023-10-16T08:51:25.009698+0000","last_fullsized":"2023-10-16T08:51:25.009698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932219+0000","last_change":"2023-10-16T08:51:19.489578+0000","last_active":"2023-10-16T08:51:23.932219+0000","last_peered":"2023-10-16T08:51:23.932219+0000","last_clean":"2023-10-16T08:51:23.932219+0000","last_became_active":"2023-10-16T08:51:19.489229+0000","last_became_peered":"2023-10-16T08:51:19.489229+0000","last_unstale":"2023-10-16T08:51:23.932219+0000","last_undegraded":"2023-10-16T08:51:23.932219+0000","last_fullsized":"2023-10-16T08:51:23.932219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:30.514244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:37.318046+0000","last_change":"2023-10-16T08:51:18.473025+0000","last_active":"2023-10-16T08:51:37.318046+0000","last_peered":"2023-10-16T08:51:37.318046+0000","last_clean":"2023-10-16T08:51:37.318046+0000","last_became_active":"2023-10-16T08:51:18.471838+0000","last_became_peered":"2023-10-16T08:51:18.471838+0000","last_unstale":"2023-10-16T08:51:37.318046+0000","last_undegraded":"2023-10-16T08:51:37.318046+0000","last_fullsized":"2023-10-16T08:51:37.318046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:29.907304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629165+0000","last_change":"2023-10-16T08:51:23.687837+0000","last_active":"2023-10-16T08:51:24.629165+0000","last_peered":"2023-10-16T08:51:24.629165+0000","last_clean":"2023-10-16T08:51:24.629165+0000","last_became_active":"2023-10-16T08:51:23.687415+0000","last_became_peered":"2023-10-16T08:51:23.687415+0000","last_unstale":"2023-10-16T08:51:24.629165+0000","last_undegraded":"2023-10-16T08:51:24.629165+0000","last_fullsized":"2023-10-16T08:51:24.629165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681874+0000","last_change":"2023-10-16T08:51:19.493209+0000","last_active":"2023-10-16T08:51:23.681874+0000","last_peered":"2023-10-16T08:51:23.681874+0000","last_clean":"2023-10-16T08:51:23.681874+0000","last_became_active":"2023-10-16T08:51:19.493039+0000","last_became_peered":"2023-10-16T08:51:19.493039+0000","last_unstale":"2023-10-16T08:51:23.681874+0000","last_undegraded":"2023-10-16T08:51:23.681874+0000","last_fullsized":"2023-10-16T08:51:23.681874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674711+0000","last_change":"2023-10-16T08:51:18.463657+0000","last_active":"2023-10-16T08:51:23.674711+0000","last_peered":"2023-10-16T08:51:23.674711+0000","last_clean":"2023-10-16T08:51:23.674711+0000","last_became_active":"2023-10-16T08:51:18.463329+0000","last_became_peered":"2023-10-16T08:51:18.463329+0000","last_unstale":"2023-10-16T08:51:23.674711+0000","last_undegraded":"2023-10-16T08:51:23.674711+0000","last_fullsized":"2023-10-16T08:51:23.674711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002944+0000","last_change":"2023-10-16T08:51:23.690913+0000","last_active":"2023-10-16T08:51:25.002944+0000","last_peered":"2023-10-16T08:51:25.002944+0000","last_clean":"2023-10-16T08:51:25.002944+0000","last_became_active":"2023-10-16T08:51:23.690240+0000","last_became_peered":"2023-10-16T08:51:23.690240+0000","last_unstale":"2023-10-16T08:51:25.002944+0000","last_undegraded":"2023-10-16T08:51:25.002944+0000","last_fullsized":"2023-10-16T08:51:25.002944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:12.508988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664438+0000","last_change":"2023-10-16T08:51:19.479453+0000","last_active":"2023-10-16T08:51:23.664438+0000","last_peered":"2023-10-16T08:51:23.664438+0000","last_clean":"2023-10-16T08:51:23.664438+0000","last_became_active":"2023-10-16T08:51:19.479175+0000","last_became_peered":"2023-10-16T08:51:19.479175+0000","last_unstale":"2023-10-16T08:51:23.664438+0000","last_undegraded":"2023-10-16T08:51:23.664438+0000","last_fullsized":"2023-10-16T08:51:23.664438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655640+0000","last_change":"2023-10-16T08:51:18.477626+0000","last_active":"2023-10-16T08:51:23.655640+0000","last_peered":"2023-10-16T08:51:23.655640+0000","last_clean":"2023-10-16T08:51:23.655640+0000","last_became_active":"2023-10-16T08:51:18.476856+0000","last_became_peered":"2023-10-16T08:51:18.476856+0000","last_unstale":"2023-10-16T08:51:23.655640+0000","last_undegraded":"2023-10-16T08:51:23.655640+0000","last_fullsized":"2023-10-16T08:51:23.655640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:06.623099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632401+0000","last_change":"2023-10-16T08:51:23.684289+0000","last_active":"2023-10-16T08:51:24.632401+0000","last_peered":"2023-10-16T08:51:24.632401+0000","last_clean":"2023-10-16T08:51:24.632401+0000","last_became_active":"2023-10-16T08:51:23.682351+0000","last_became_peered":"2023-10-16T08:51:23.682351+0000","last_unstale":"2023-10-16T08:51:24.632401+0000","last_undegraded":"2023-10-16T08:51:24.632401+0000","last_fullsized":"2023-10-16T08:51:24.632401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:19:24.423311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655380+0000","last_change":"2023-10-16T08:51:19.496098+0000","last_active":"2023-10-16T08:51:23.655380+0000","last_peered":"2023-10-16T08:51:23.655380+0000","last_clean":"2023-10-16T08:51:23.655380+0000","last_became_active":"2023-10-16T08:51:19.495623+0000","last_became_peered":"2023-10-16T08:51:19.495623+0000","last_unstale":"2023-10-16T08:51:23.655380+0000","last_undegraded":"2023-10-16T08:51:23.655380+0000","last_fullsized":"2023-10-16T08:51:23.655380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:50.322181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673307+0000","last_change":"2023-10-16T08:51:18.474818+0000","last_active":"2023-10-16T08:51:23.673307+0000","last_peered":"2023-10-16T08:51:23.673307+0000","last_clean":"2023-10-16T08:51:23.673307+0000","last_became_active":"2023-10-16T08:51:18.473153+0000","last_became_peered":"2023-10-16T08:51:18.473153+0000","last_unstale":"2023-10-16T08:51:23.673307+0000","last_undegraded":"2023-10-16T08:51:23.673307+0000","last_fullsized":"2023-10-16T08:51:23.673307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632414+0000","last_change":"2023-10-16T08:51:23.943636+0000","last_active":"2023-10-16T08:51:24.632414+0000","last_peered":"2023-10-16T08:51:24.632414+0000","last_clean":"2023-10-16T08:51:24.632414+0000","last_became_active":"2023-10-16T08:51:23.943081+0000","last_became_peered":"2023-10-16T08:51:23.943081+0000","last_unstale":"2023-10-16T08:51:24.632414+0000","last_undegraded":"2023-10-16T08:51:24.632414+0000","last_fullsized":"2023-10-16T08:51:24.632414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780507+0000","last_change":"2023-10-16T08:51:23.941536+0000","last_active":"2023-10-16T08:51:24.780507+0000","last_peered":"2023-10-16T08:51:24.780507+0000","last_clean":"2023-10-16T08:51:24.780507+0000","last_became_active":"2023-10-16T08:51:23.940210+0000","last_became_peered":"2023-10-16T08:51:23.940210+0000","last_unstale":"2023-10-16T08:51:24.780507+0000","last_undegraded":"2023-10-16T08:51:24.780507+0000","last_fullsized":"2023-10-16T08:51:24.780507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:20.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676073+0000","last_change":"2023-10-16T08:51:19.492153+0000","last_active":"2023-10-16T08:51:23.676073+0000","last_peered":"2023-10-16T08:51:23.676073+0000","last_clean":"2023-10-16T08:51:23.676073+0000","last_became_active":"2023-10-16T08:51:19.491873+0000","last_became_peered":"2023-10-16T08:51:19.491873+0000","last_unstale":"2023-10-16T08:51:23.676073+0000","last_undegraded":"2023-10-16T08:51:23.676073+0000","last_fullsized":"2023-10-16T08:51:23.676073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:20.049093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656917+0000","last_change":"2023-10-16T08:51:18.470467+0000","last_active":"2023-10-16T08:51:23.656917+0000","last_peered":"2023-10-16T08:51:23.656917+0000","last_clean":"2023-10-16T08:51:23.656917+0000","last_became_active":"2023-10-16T08:51:18.469986+0000","last_became_peered":"2023-10-16T08:51:18.469986+0000","last_unstale":"2023-10-16T08:51:23.656917+0000","last_undegraded":"2023-10-16T08:51:23.656917+0000","last_fullsized":"2023-10-16T08:51:23.656917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:00.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632702+0000","last_change":"2023-10-16T08:51:23.694583+0000","last_active":"2023-10-16T08:51:24.632702+0000","last_peered":"2023-10-16T08:51:24.632702+0000","last_clean":"2023-10-16T08:51:24.632702+0000","last_became_active":"2023-10-16T08:51:23.694186+0000","last_became_peered":"2023-10-16T08:51:23.694186+0000","last_unstale":"2023-10-16T08:51:24.632702+0000","last_undegraded":"2023-10-16T08:51:24.632702+0000","last_fullsized":"2023-10-16T08:51:24.632702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658643+0000","last_change":"2023-10-16T08:51:19.477096+0000","last_active":"2023-10-16T08:51:23.658643+0000","last_peered":"2023-10-16T08:51:23.658643+0000","last_clean":"2023-10-16T08:51:23.658643+0000","last_became_active":"2023-10-16T08:51:19.473590+0000","last_became_peered":"2023-10-16T08:51:19.473590+0000","last_unstale":"2023-10-16T08:51:23.658643+0000","last_undegraded":"2023-10-16T08:51:23.658643+0000","last_fullsized":"2023-10-16T08:51:23.658643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654035+0000","last_change":"2023-10-16T08:51:18.471924+0000","last_active":"2023-10-16T08:51:23.654035+0000","last_peered":"2023-10-16T08:51:23.654035+0000","last_clean":"2023-10-16T08:51:23.654035+0000","last_became_active":"2023-10-16T08:51:18.471592+0000","last_became_peered":"2023-10-16T08:51:18.471592+0000","last_unstale":"2023-10-16T08:51:23.654035+0000","last_undegraded":"2023-10-16T08:51:23.654035+0000","last_fullsized":"2023-10-16T08:51:23.654035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:47:19.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669470+0000","last_change":"2023-10-16T08:51:18.474173+0000","last_active":"2023-10-16T08:51:23.669470+0000","last_peered":"2023-10-16T08:51:23.669470+0000","last_clean":"2023-10-16T08:51:23.669470+0000","last_became_active":"2023-10-16T08:51:18.473185+0000","last_became_peered":"2023-10-16T08:51:18.473185+0000","last_unstale":"2023-10-16T08:51:23.669470+0000","last_undegraded":"2023-10-16T08:51:23.669470+0000","last_fullsized":"2023-10-16T08:51:23.669470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:09:12.237149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663356+0000","last_change":"2023-10-16T08:51:19.488282+0000","last_active":"2023-10-16T08:51:23.663356+0000","last_peered":"2023-10-16T08:51:23.663356+0000","last_clean":"2023-10-16T08:51:23.663356+0000","last_became_active":"2023-10-16T08:51:19.487960+0000","last_became_peered":"2023-10-16T08:51:19.487960+0000","last_unstale":"2023-10-16T08:51:23.663356+0000","last_undegraded":"2023-10-16T08:51:23.663356+0000","last_fullsized":"2023-10-16T08:51:23.663356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002055+0000","last_change":"2023-10-16T08:51:23.689131+0000","last_active":"2023-10-16T08:51:25.002055+0000","last_peered":"2023-10-16T08:51:25.002055+0000","last_clean":"2023-10-16T08:51:25.002055+0000","last_became_active":"2023-10-16T08:51:23.686763+0000","last_became_peered":"2023-10-16T08:51:23.686763+0000","last_unstale":"2023-10-16T08:51:25.002055+0000","last_undegraded":"2023-10-16T08:51:25.002055+0000","last_fullsized":"2023-10-16T08:51:25.002055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:19.111523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:18.475217+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:18.474923+0000","last_became_peered":"2023-10-16T08:51:18.474923+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681558+0000","last_change":"2023-10-16T08:51:19.490076+0000","last_active":"2023-10-16T08:51:23.681558+0000","last_peered":"2023-10-16T08:51:23.681558+0000","last_clean":"2023-10-16T08:51:23.681558+0000","last_became_active":"2023-10-16T08:51:19.489836+0000","last_became_peered":"2023-10-16T08:51:19.489836+0000","last_unstale":"2023-10-16T08:51:23.681558+0000","last_undegraded":"2023-10-16T08:51:23.681558+0000","last_fullsized":"2023-10-16T08:51:23.681558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:01.471157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633844+0000","last_change":"2023-10-16T08:51:23.681986+0000","last_active":"2023-10-16T08:51:24.633844+0000","last_peered":"2023-10-16T08:51:24.633844+0000","last_clean":"2023-10-16T08:51:24.633844+0000","last_became_active":"2023-10-16T08:51:23.681604+0000","last_became_peered":"2023-10-16T08:51:23.681604+0000","last_unstale":"2023-10-16T08:51:24.633844+0000","last_undegraded":"2023-10-16T08:51:24.633844+0000","last_fullsized":"2023-10-16T08:51:24.633844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666407+0000","last_change":"2023-10-16T08:51:19.477397+0000","last_active":"2023-10-16T08:51:23.666407+0000","last_peered":"2023-10-16T08:51:23.666407+0000","last_clean":"2023-10-16T08:51:23.666407+0000","last_became_active":"2023-10-16T08:51:19.476711+0000","last_became_peered":"2023-10-16T08:51:19.476711+0000","last_unstale":"2023-10-16T08:51:23.666407+0000","last_undegraded":"2023-10-16T08:51:23.666407+0000","last_fullsized":"2023-10-16T08:51:23.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:19.481363+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:19.480970+0000","last_became_peered":"2023-10-16T08:51:19.480970+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656160+0000","last_change":"2023-10-16T08:51:19.477774+0000","last_active":"2023-10-16T08:51:23.656160+0000","last_peered":"2023-10-16T08:51:23.656160+0000","last_clean":"2023-10-16T08:51:23.656160+0000","last_became_active":"2023-10-16T08:51:19.475123+0000","last_became_peered":"2023-10-16T08:51:19.475123+0000","last_unstale":"2023-10-16T08:51:23.656160+0000","last_undegraded":"2023-10-16T08:51:23.656160+0000","last_fullsized":"2023-10-16T08:51:23.656160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:28.688010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663346+0000","last_change":"2023-10-16T08:51:19.470555+0000","last_active":"2023-10-16T08:51:23.663346+0000","last_peered":"2023-10-16T08:51:23.663346+0000","last_clean":"2023-10-16T08:51:23.663346+0000","last_became_active":"2023-10-16T08:51:19.470021+0000","last_became_peered":"2023-10-16T08:51:19.470021+0000","last_unstale":"2023-10-16T08:51:23.663346+0000","last_undegraded":"2023-10-16T08:51:23.663346+0000","last_fullsized":"2023-10-16T08:51:23.663346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655354+0000","last_change":"2023-10-16T08:51:19.477990+0000","last_active":"2023-10-16T08:51:23.655354+0000","last_peered":"2023-10-16T08:51:23.655354+0000","last_clean":"2023-10-16T08:51:23.655354+0000","last_became_active":"2023-10-16T08:51:19.477299+0000","last_became_peered":"2023-10-16T08:51:19.477299+0000","last_unstale":"2023-10-16T08:51:23.655354+0000","last_undegraded":"2023-10-16T08:51:23.655354+0000","last_fullsized":"2023-10-16T08:51:23.655354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674606+0000","last_change":"2023-10-16T08:51:19.492134+0000","last_active":"2023-10-16T08:51:23.674606+0000","last_peered":"2023-10-16T08:51:23.674606+0000","last_clean":"2023-10-16T08:51:23.674606+0000","last_became_active":"2023-10-16T08:51:19.491859+0000","last_became_peered":"2023-10-16T08:51:19.491859+0000","last_unstale":"2023-10-16T08:51:23.674606+0000","last_undegraded":"2023-10-16T08:51:23.674606+0000","last_fullsized":"2023-10-16T08:51:23.674606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:50:38.473722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671269+0000","last_change":"2023-10-16T08:51:19.491815+0000","last_active":"2023-10-16T08:51:23.671269+0000","last_peered":"2023-10-16T08:51:23.671269+0000","last_clean":"2023-10-16T08:51:23.671269+0000","last_became_active":"2023-10-16T08:51:19.491422+0000","last_became_peered":"2023-10-16T08:51:19.491422+0000","last_unstale":"2023-10-16T08:51:23.671269+0000","last_undegraded":"2023-10-16T08:51:23.671269+0000","last_fullsized":"2023-10-16T08:51:23.671269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657516+0000","last_change":"2023-10-16T08:51:19.492217+0000","last_active":"2023-10-16T08:51:23.657516+0000","last_peered":"2023-10-16T08:51:23.657516+0000","last_clean":"2023-10-16T08:51:23.657516+0000","last_became_active":"2023-10-16T08:51:19.491892+0000","last_became_peered":"2023-10-16T08:51:19.491892+0000","last_unstale":"2023-10-16T08:51:23.657516+0000","last_undegraded":"2023-10-16T08:51:23.657516+0000","last_fullsized":"2023-10-16T08:51:23.657516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656714+0000","last_change":"2023-10-16T08:51:19.475841+0000","last_active":"2023-10-16T08:51:23.656714+0000","last_peered":"2023-10-16T08:51:23.656714+0000","last_clean":"2023-10-16T08:51:23.656714+0000","last_became_active":"2023-10-16T08:51:19.475196+0000","last_became_peered":"2023-10-16T08:51:19.475196+0000","last_unstale":"2023-10-16T08:51:23.656714+0000","last_undegraded":"2023-10-16T08:51:23.656714+0000","last_fullsized":"2023-10-16T08:51:23.656714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653907+0000","last_change":"2023-10-16T08:51:19.492583+0000","last_active":"2023-10-16T08:51:23.653907+0000","last_peered":"2023-10-16T08:51:23.653907+0000","last_clean":"2023-10-16T08:51:23.653907+0000","last_became_active":"2023-10-16T08:51:19.492322+0000","last_became_peered":"2023-10-16T08:51:19.492322+0000","last_unstale":"2023-10-16T08:51:23.653907+0000","last_undegraded":"2023-10-16T08:51:23.653907+0000","last_fullsized":"2023-10-16T08:51:23.653907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655778+0000","last_change":"2023-10-16T08:51:19.484234+0000","last_active":"2023-10-16T08:51:23.655778+0000","last_peered":"2023-10-16T08:51:23.655778+0000","last_clean":"2023-10-16T08:51:23.655778+0000","last_became_active":"2023-10-16T08:51:19.483921+0000","last_became_peered":"2023-10-16T08:51:19.483921+0000","last_unstale":"2023-10-16T08:51:23.655778+0000","last_undegraded":"2023-10-16T08:51:23.655778+0000","last_fullsized":"2023-10-16T08:51:23.655778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:20.666617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663277+0000","last_change":"2023-10-16T08:51:19.487699+0000","last_active":"2023-10-16T08:51:23.663277+0000","last_peered":"2023-10-16T08:51:23.663277+0000","last_clean":"2023-10-16T08:51:23.663277+0000","last_became_active":"2023-10-16T08:51:19.487423+0000","last_became_peered":"2023-10-16T08:51:19.487423+0000","last_unstale":"2023-10-16T08:51:23.663277+0000","last_undegraded":"2023-10-16T08:51:23.663277+0000","last_fullsized":"2023-10-16T08:51:23.663277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669411+0000","last_change":"2023-10-16T08:51:19.496931+0000","last_active":"2023-10-16T08:51:23.669411+0000","last_peered":"2023-10-16T08:51:23.669411+0000","last_clean":"2023-10-16T08:51:23.669411+0000","last_became_active":"2023-10-16T08:51:19.494302+0000","last_became_peered":"2023-10-16T08:51:19.494302+0000","last_unstale":"2023-10-16T08:51:23.669411+0000","last_undegraded":"2023-10-16T08:51:23.669411+0000","last_fullsized":"2023-10-16T08:51:23.669411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.934841+0000","last_change":"2023-10-16T08:51:19.482651+0000","last_active":"2023-10-16T08:51:23.934841+0000","last_peered":"2023-10-16T08:51:23.934841+0000","last_clean":"2023-10-16T08:51:23.934841+0000","last_became_active":"2023-10-16T08:51:19.482392+0000","last_became_peered":"2023-10-16T08:51:19.482392+0000","last_unstale":"2023-10-16T08:51:23.934841+0000","last_undegraded":"2023-10-16T08:51:23.934841+0000","last_fullsized":"2023-10-16T08:51:23.934841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:50.214064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655880+0000","last_change":"2023-10-16T08:51:19.492889+0000","last_active":"2023-10-16T08:51:23.655880+0000","last_peered":"2023-10-16T08:51:23.655880+0000","last_clean":"2023-10-16T08:51:23.655880+0000","last_became_active":"2023-10-16T08:51:19.492576+0000","last_became_peered":"2023-10-16T08:51:19.492576+0000","last_unstale":"2023-10-16T08:51:23.655880+0000","last_undegraded":"2023-10-16T08:51:23.655880+0000","last_fullsized":"2023-10-16T08:51:23.655880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656813+0000","last_change":"2023-10-16T08:51:19.497299+0000","last_active":"2023-10-16T08:51:23.656813+0000","last_peered":"2023-10-16T08:51:23.656813+0000","last_clean":"2023-10-16T08:51:23.656813+0000","last_became_active":"2023-10-16T08:51:19.495738+0000","last_became_peered":"2023-10-16T08:51:19.495738+0000","last_unstale":"2023-10-16T08:51:23.656813+0000","last_undegraded":"2023-10-16T08:51:23.656813+0000","last_fullsized":"2023-10-16T08:51:23.656813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:01.994879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656466+0000","last_change":"2023-10-16T08:51:19.476970+0000","last_active":"2023-10-16T08:51:23.656466+0000","last_peered":"2023-10-16T08:51:23.656466+0000","last_clean":"2023-10-16T08:51:23.656466+0000","last_became_active":"2023-10-16T08:51:19.475512+0000","last_became_peered":"2023-10-16T08:51:19.475512+0000","last_unstale":"2023-10-16T08:51:23.656466+0000","last_undegraded":"2023-10-16T08:51:23.656466+0000","last_fullsized":"2023-10-16T08:51:23.656466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676171+0000","last_change":"2023-10-16T08:51:19.495546+0000","last_active":"2023-10-16T08:51:23.676171+0000","last_peered":"2023-10-16T08:51:23.676171+0000","last_clean":"2023-10-16T08:51:23.676171+0000","last_became_active":"2023-10-16T08:51:19.495247+0000","last_became_peered":"2023-10-16T08:51:19.495247+0000","last_unstale":"2023-10-16T08:51:23.676171+0000","last_undegraded":"2023-10-16T08:51:23.676171+0000","last_fullsized":"2023-10-16T08:51:23.676171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:20.976839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663138+0000","last_change":"2023-10-16T08:51:19.483501+0000","last_active":"2023-10-16T08:51:23.663138+0000","last_peered":"2023-10-16T08:51:23.663138+0000","last_clean":"2023-10-16T08:51:23.663138+0000","last_became_active":"2023-10-16T08:51:19.482944+0000","last_became_peered":"2023-10-16T08:51:19.482944+0000","last_unstale":"2023-10-16T08:51:23.663138+0000","last_undegraded":"2023-10-16T08:51:23.663138+0000","last_fullsized":"2023-10-16T08:51:23.663138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:53.572062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653847+0000","last_change":"2023-10-16T08:51:19.478486+0000","last_active":"2023-10-16T08:51:23.653847+0000","last_peered":"2023-10-16T08:51:23.653847+0000","last_clean":"2023-10-16T08:51:23.653847+0000","last_became_active":"2023-10-16T08:51:19.478148+0000","last_became_peered":"2023-10-16T08:51:19.478148+0000","last_unstale":"2023-10-16T08:51:23.653847+0000","last_undegraded":"2023-10-16T08:51:23.653847+0000","last_fullsized":"2023-10-16T08:51:23.653847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681778+0000","last_change":"2023-10-16T08:51:19.489601+0000","last_active":"2023-10-16T08:51:23.681778+0000","last_peered":"2023-10-16T08:51:23.681778+0000","last_clean":"2023-10-16T08:51:23.681778+0000","last_became_active":"2023-10-16T08:51:19.489183+0000","last_became_peered":"2023-10-16T08:51:19.489183+0000","last_unstale":"2023-10-16T08:51:23.681778+0000","last_undegraded":"2023-10-16T08:51:23.681778+0000","last_fullsized":"2023-10-16T08:51:23.681778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669156+0000","last_change":"2023-10-16T08:51:19.487335+0000","last_active":"2023-10-16T08:51:23.669156+0000","last_peered":"2023-10-16T08:51:23.669156+0000","last_clean":"2023-10-16T08:51:23.669156+0000","last_became_active":"2023-10-16T08:51:19.487075+0000","last_became_peered":"2023-10-16T08:51:19.487075+0000","last_unstale":"2023-10-16T08:51:23.669156+0000","last_undegraded":"2023-10-16T08:51:23.669156+0000","last_fullsized":"2023-10-16T08:51:23.669156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671049+0000","last_change":"2023-10-16T08:51:19.481528+0000","last_active":"2023-10-16T08:51:23.671049+0000","last_peered":"2023-10-16T08:51:23.671049+0000","last_clean":"2023-10-16T08:51:23.671049+0000","last_became_active":"2023-10-16T08:51:19.481200+0000","last_became_peered":"2023-10-16T08:51:19.481200+0000","last_unstale":"2023-10-16T08:51:23.671049+0000","last_undegraded":"2023-10-16T08:51:23.671049+0000","last_fullsized":"2023-10-16T08:51:23.671049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933808+0000","last_change":"2023-10-16T08:51:19.485179+0000","last_active":"2023-10-16T08:51:23.933808+0000","last_peered":"2023-10-16T08:51:23.933808+0000","last_clean":"2023-10-16T08:51:23.933808+0000","last_became_active":"2023-10-16T08:51:19.484475+0000","last_became_peered":"2023-10-16T08:51:19.484475+0000","last_unstale":"2023-10-16T08:51:23.933808+0000","last_undegraded":"2023-10-16T08:51:23.933808+0000","last_fullsized":"2023-10-16T08:51:23.933808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:26.362066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656954+0000","last_change":"2023-10-16T08:51:19.489098+0000","last_active":"2023-10-16T08:51:23.656954+0000","last_peered":"2023-10-16T08:51:23.656954+0000","last_clean":"2023-10-16T08:51:23.656954+0000","last_became_active":"2023-10-16T08:51:19.488810+0000","last_became_peered":"2023-10-16T08:51:19.488810+0000","last_unstale":"2023-10-16T08:51:23.656954+0000","last_undegraded":"2023-10-16T08:51:23.656954+0000","last_fullsized":"2023-10-16T08:51:23.656954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927711+0000","last_change":"2023-10-16T08:51:19.481280+0000","last_active":"2023-10-16T08:51:23.927711+0000","last_peered":"2023-10-16T08:51:23.927711+0000","last_clean":"2023-10-16T08:51:23.927711+0000","last_became_active":"2023-10-16T08:51:19.480918+0000","last_became_peered":"2023-10-16T08:51:19.480918+0000","last_unstale":"2023-10-16T08:51:23.927711+0000","last_undegraded":"2023-10-16T08:51:23.927711+0000","last_fullsized":"2023-10-16T08:51:23.927711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:27.239511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655534+0000","last_change":"2023-10-16T08:51:19.477823+0000","last_active":"2023-10-16T08:51:23.655534+0000","last_peered":"2023-10-16T08:51:23.655534+0000","last_clean":"2023-10-16T08:51:23.655534+0000","last_became_active":"2023-10-16T08:51:19.477234+0000","last_became_peered":"2023-10-16T08:51:19.477234+0000","last_unstale":"2023-10-16T08:51:23.655534+0000","last_undegraded":"2023-10-16T08:51:23.655534+0000","last_fullsized":"2023-10-16T08:51:23.655534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928445+0000","last_change":"2023-10-16T08:51:19.489820+0000","last_active":"2023-10-16T08:51:23.928445+0000","last_peered":"2023-10-16T08:51:23.928445+0000","last_clean":"2023-10-16T08:51:23.928445+0000","last_became_active":"2023-10-16T08:51:19.489507+0000","last_became_peered":"2023-10-16T08:51:19.489507+0000","last_unstale":"2023-10-16T08:51:23.928445+0000","last_undegraded":"2023-10-16T08:51:23.928445+0000","last_fullsized":"2023-10-16T08:51:23.928445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:08.297922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655383+0000","last_change":"2023-10-16T08:51:19.500564+0000","last_active":"2023-10-16T08:51:23.655383+0000","last_peered":"2023-10-16T08:51:23.655383+0000","last_clean":"2023-10-16T08:51:23.655383+0000","last_became_active":"2023-10-16T08:51:19.500259+0000","last_became_peered":"2023-10-16T08:51:19.500259+0000","last_unstale":"2023-10-16T08:51:23.655383+0000","last_undegraded":"2023-10-16T08:51:23.655383+0000","last_fullsized":"2023-10-16T08:51:23.655383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.662732+0000","last_change":"2023-10-16T08:51:19.475776+0000","last_active":"2023-10-16T08:51:23.662732+0000","last_peered":"2023-10-16T08:51:23.662732+0000","last_clean":"2023-10-16T08:51:23.662732+0000","last_became_active":"2023-10-16T08:51:19.475490+0000","last_became_peered":"2023-10-16T08:51:19.475490+0000","last_unstale":"2023-10-16T08:51:23.662732+0000","last_undegraded":"2023-10-16T08:51:23.662732+0000","last_fullsized":"2023-10-16T08:51:23.662732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681106+0000","last_change":"2023-10-16T08:51:19.478163+0000","last_active":"2023-10-16T08:51:23.681106+0000","last_peered":"2023-10-16T08:51:23.681106+0000","last_clean":"2023-10-16T08:51:23.681106+0000","last_became_active":"2023-10-16T08:51:19.477845+0000","last_became_peered":"2023-10-16T08:51:19.477845+0000","last_unstale":"2023-10-16T08:51:23.681106+0000","last_undegraded":"2023-10-16T08:51:23.681106+0000","last_fullsized":"2023-10-16T08:51:23.681106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:11.984655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933468+0000","last_change":"2023-10-16T08:51:19.484764+0000","last_active":"2023-10-16T08:51:23.933468+0000","last_peered":"2023-10-16T08:51:23.933468+0000","last_clean":"2023-10-16T08:51:23.933468+0000","last_became_active":"2023-10-16T08:51:19.480771+0000","last_became_peered":"2023-10-16T08:51:19.480771+0000","last_unstale":"2023-10-16T08:51:23.933468+0000","last_undegraded":"2023-10-16T08:51:23.933468+0000","last_fullsized":"2023-10-16T08:51:23.933468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:34.680318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":697914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":106964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":107124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":697970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T08:51:48.084 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T08:51:48.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.324+0000 7fbc3f94e640 1 Processor -- start 2023-10-16T08:51:48.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.324+0000 7fbc3f94e640 1 -- start start 2023-10-16T08:51:48.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.325+0000 7fbc3f94e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbc380b0010 0x7fbc380701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3f94e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbc3815ad00 0x7fbc3815f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3f94e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3815f580 con 0x7fbc380b03f0 2023-10-16T08:51:48.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3f94e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380707f0 con 0x7fbc3815ad00 2023-10-16T08:51:48.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3f94e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38070ad0 con 0x7fbc380b0010 2023-10-16T08:51:48.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3deeb640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbc380b03f0 0x7fbc3815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50806/0 (socket says 172.21.15.94:50806) 2023-10-16T08:51:48.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3deeb640 1 -- 172.21.15.94:0/3620746832 learned_addr learned my addr 172.21.15.94:0/3620746832 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:48.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3cee9640 1 --2- 172.21.15.94:0/3620746832 >> v2:172.21.15.94:3300/0 conn(0x7fbc3815ad00 0x7fbc3815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc3d6ea640 1 --2- 172.21.15.94:0/3620746832 >> v2:172.21.15.130:3300/0 conn(0x7fbc380b0010 0x7fbc380701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc2ffff640 1 -- 172.21.15.94:0/3620746832 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326967870 0 0) 0x7fbc30001490 con 0x7fbc380b03f0 2023-10-16T08:51:48.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.326+0000 7fbc2ffff640 1 -- 172.21.15.94:0/3620746832 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc24003520 con 0x7fbc380b03f0 2023-10-16T08:51:48.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.327+0000 7fbc3cee9640 1 -- 172.21.15.94:0/3620746832 >> v2:172.21.15.130:3300/0 conn(0x7fbc380b0010 msgr2=0x7fbc380701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:48.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.327+0000 7fbc3cee9640 1 --2- 172.21.15.94:0/3620746832 >> v2:172.21.15.130:3300/0 conn(0x7fbc380b0010 0x7fbc380701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.331 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.327+0000 7fbc3cee9640 1 -- 172.21.15.94:0/3620746832 >> v1:172.21.15.94:6789/0 conn(0x7fbc380b03f0 legacy=0x7fbc3815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.331 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.327+0000 7fbc3cee9640 1 -- 172.21.15.94:0/3620746832 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3815b1d0 con 0x7fbc3815ad00 2023-10-16T08:51:48.331 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.328+0000 7fbc3cee9640 1 --2- 172.21.15.94:0/3620746832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc3815ad00 0x7fbc3815f040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc380cf690 tx=0x7fbc2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9d4f3bfb04f952 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:48.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.328+0000 7fbc2ffff640 1 -- 172.21.15.94:0/3620746832 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28031830 con 0x7fbc3815ad00 2023-10-16T08:51:48.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.328+0000 7fbc2ffff640 1 -- 172.21.15.94:0/3620746832 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28031990 con 0x7fbc3815ad00 2023-10-16T08:51:48.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.328+0000 7fbc2ffff640 1 -- 172.21.15.94:0/3620746832 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28031d20 con 0x7fbc3815ad00 2023-10-16T08:51:48.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3620746832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc3815ad00 msgr2=0x7fbc3815f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3620746832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc3815ad00 0x7fbc3815f040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc380cf690 tx=0x7fbc2802b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3620746832 shutdown_connections 2023-10-16T08:51:48.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3620746832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc3815ad00 0x7fbc3815f040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3620746832 >> v2:172.21.15.130:3300/0 conn(0x7fbc380b0010 0x7fbc380701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3620746832 >> 172.21.15.94:0/3620746832 conn(0x7fbc3806c1c0 msgr2=0x7fbc3806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:48.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3620746832 shutdown_connections 2023-10-16T08:51:48.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.329+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3620746832 wait complete. 2023-10-16T08:51:48.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.330+0000 7fbc3f94e640 1 Processor -- start 2023-10-16T08:51:48.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.331+0000 7fbc3f94e640 1 -- start start 2023-10-16T08:51:48.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.331+0000 7fbc3f94e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 0x7fbc3815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.331+0000 7fbc3f94e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc380b03f0 0x7fbc381548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.331+0000 7fbc3f94e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbc3815ad00 0x7fbc3814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3f94e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ccc30 con 0x7fbc380b0010 2023-10-16T08:51:48.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3f94e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3815ca70 con 0x7fbc380b03f0 2023-10-16T08:51:48.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3f94e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3815cc80 con 0x7fbc3815ad00 2023-10-16T08:51:48.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 0x7fbc3815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 0x7fbc3815c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56830/0 (socket says 172.21.15.94:56830) 2023-10-16T08:51:48.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 -- 172.21.15.94:0/3565460101 learned_addr learned my addr 172.21.15.94:0/3565460101 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:48.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 -- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbc3815ad00 msgr2=0x7fbc3814a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbc3815ad00 0x7fbc3814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3cee9640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc380b03f0 0x7fbc381548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 -- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc380b03f0 msgr2=0x7fbc381548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc380b03f0 0x7fbc381548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.332+0000 7fbc3d6ea640 1 -- 172.21.15.94:0/3565460101 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc28009400 con 0x7fbc380b0010 2023-10-16T08:51:48.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.333+0000 7fbc3d6ea640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 0x7fbc3815c530 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400d800 tx=0x7fbc3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:48.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.333+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400b6c0 con 0x7fbc380b0010 2023-10-16T08:51:48.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.333+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400b820 con 0x7fbc380b0010 2023-10-16T08:51:48.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.333+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bbb0 con 0x7fbc380b0010 2023-10-16T08:51:48.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.333+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc380cc290 con 0x7fbc380b0010 2023-10-16T08:51:48.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.333+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc380cc850 con 0x7fbc380b0010 2023-10-16T08:51:48.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.334+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc38073ef0 con 0x7fbc380b0010 2023-10-16T08:51:48.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.335+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc3400bd10 con 0x7fbc380b0010 2023-10-16T08:51:48.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.336+0000 7fbc2dffb640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbc1c06ae70 0x7fbc1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.336+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc34089e10 con 0x7fbc380b0010 2023-10-16T08:51:48.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.336+0000 7fbc3cee9640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbc1c06ae70 0x7fbc1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.337+0000 7fbc3cee9640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbc1c06ae70 0x7fbc1c06d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbc28036000 tx=0x7fbc2803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:48.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.340+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc34054c60 con 0x7fbc380b0010 2023-10-16T08:51:48.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.527+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 --> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc3815b4b0 con 0x7fbc1c06ae70 2023-10-16T08:51:48.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.553+0000 7fbc2dffb640 1 -- 172.21.15.94:0/3565460101 <== mgr.4107 v2:172.21.15.94:6832/2208206022 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345111 (secure 0 0 0) 0x7fbc2803a420 con 0x7fbc1c06ae70 2023-10-16T08:51:48.559 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:48.561 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2023-10-16T08:51:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbc1c06ae70 msgr2=0x7fbc1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbc1c06ae70 0x7fbc1c06d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbc28036000 tx=0x7fbc2803c040 comp rx=0 tx=0).stop 2023-10-16T08:51:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 msgr2=0x7fbc3815c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 0x7fbc3815c530 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400d800 tx=0x7fbc3400dcc0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 shutdown_connections 2023-10-16T08:51:48.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbc3815ad00 0x7fbc3814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbc1c06ae70 0x7fbc1c06d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc380b03f0 0x7fbc381548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 --2- 172.21.15.94:0/3565460101 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc380b0010 0x7fbc3815c530 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 >> 172.21.15.94:0/3565460101 conn(0x7fbc3806c1c0 msgr2=0x7fbc3815a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:48.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 shutdown_connections 2023-10-16T08:51:48.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.558+0000 7fbc3f94e640 1 -- 172.21.15.94:0/3565460101 wait complete. 2023-10-16T08:51:48.577 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-10-16T08:51:47.822676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236140,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":3416064,"data_stored":2045726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005022"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664629+0000","last_change":"2023-10-16T08:51:18.472763+0000","last_active":"2023-10-16T08:51:23.664629+0000","last_peered":"2023-10-16T08:51:23.664629+0000","last_clean":"2023-10-16T08:51:23.664629+0000","last_became_active":"2023-10-16T08:51:18.472447+0000","last_became_peered":"2023-10-16T08:51:18.472447+0000","last_unstale":"2023-10-16T08:51:23.664629+0000","last_undegraded":"2023-10-16T08:51:23.664629+0000","last_fullsized":"2023-10-16T08:51:23.664629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:21.069905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656591+0000","last_change":"2023-10-16T08:51:19.478851+0000","last_active":"2023-10-16T08:51:23.656591+0000","last_peered":"2023-10-16T08:51:23.656591+0000","last_clean":"2023-10-16T08:51:23.656591+0000","last_became_active":"2023-10-16T08:51:19.478587+0000","last_became_peered":"2023-10-16T08:51:19.478587+0000","last_unstale":"2023-10-16T08:51:23.656591+0000","last_undegraded":"2023-10-16T08:51:23.656591+0000","last_fullsized":"2023-10-16T08:51:23.656591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632168+0000","last_change":"2023-10-16T08:51:23.936156+0000","last_active":"2023-10-16T08:51:24.632168+0000","last_peered":"2023-10-16T08:51:24.632168+0000","last_clean":"2023-10-16T08:51:24.632168+0000","last_became_active":"2023-10-16T08:51:23.935275+0000","last_became_peered":"2023-10-16T08:51:23.935275+0000","last_unstale":"2023-10-16T08:51:24.632168+0000","last_undegraded":"2023-10-16T08:51:24.632168+0000","last_fullsized":"2023-10-16T08:51:24.632168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:23.584433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656765+0000","last_change":"2023-10-16T08:51:18.463620+0000","last_active":"2023-10-16T08:51:23.656765+0000","last_peered":"2023-10-16T08:51:23.656765+0000","last_clean":"2023-10-16T08:51:23.656765+0000","last_became_active":"2023-10-16T08:51:18.463088+0000","last_became_peered":"2023-10-16T08:51:18.463088+0000","last_unstale":"2023-10-16T08:51:23.656765+0000","last_undegraded":"2023-10-16T08:51:23.656765+0000","last_fullsized":"2023-10-16T08:51:23.656765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664153+0000","last_change":"2023-10-16T08:51:19.483778+0000","last_active":"2023-10-16T08:51:23.664153+0000","last_peered":"2023-10-16T08:51:23.664153+0000","last_clean":"2023-10-16T08:51:23.664153+0000","last_became_active":"2023-10-16T08:51:19.479538+0000","last_became_peered":"2023-10-16T08:51:19.479538+0000","last_unstale":"2023-10-16T08:51:23.664153+0000","last_undegraded":"2023-10-16T08:51:23.664153+0000","last_fullsized":"2023-10-16T08:51:23.664153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001998+0000","last_change":"2023-10-16T08:51:23.687361+0000","last_active":"2023-10-16T08:51:25.001998+0000","last_peered":"2023-10-16T08:51:25.001998+0000","last_clean":"2023-10-16T08:51:25.001998+0000","last_became_active":"2023-10-16T08:51:23.686758+0000","last_became_peered":"2023-10-16T08:51:23.686758+0000","last_unstale":"2023-10-16T08:51:25.001998+0000","last_undegraded":"2023-10-16T08:51:25.001998+0000","last_fullsized":"2023-10-16T08:51:25.001998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:04.836076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932744+0000","last_change":"2023-10-16T08:51:18.479211+0000","last_active":"2023-10-16T08:51:23.932744+0000","last_peered":"2023-10-16T08:51:23.932744+0000","last_clean":"2023-10-16T08:51:23.932744+0000","last_became_active":"2023-10-16T08:51:18.478753+0000","last_became_peered":"2023-10-16T08:51:18.478753+0000","last_unstale":"2023-10-16T08:51:23.932744+0000","last_undegraded":"2023-10-16T08:51:23.932744+0000","last_fullsized":"2023-10-16T08:51:23.932744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:13.887687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655634+0000","last_change":"2023-10-16T08:51:19.497246+0000","last_active":"2023-10-16T08:51:23.655634+0000","last_peered":"2023-10-16T08:51:23.655634+0000","last_clean":"2023-10-16T08:51:23.655634+0000","last_became_active":"2023-10-16T08:51:19.496966+0000","last_became_peered":"2023-10-16T08:51:19.496966+0000","last_unstale":"2023-10-16T08:51:23.655634+0000","last_undegraded":"2023-10-16T08:51:23.655634+0000","last_fullsized":"2023-10-16T08:51:23.655634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002504+0000","last_change":"2023-10-16T08:51:23.694314+0000","last_active":"2023-10-16T08:51:25.002504+0000","last_peered":"2023-10-16T08:51:25.002504+0000","last_clean":"2023-10-16T08:51:25.002504+0000","last_became_active":"2023-10-16T08:51:23.693789+0000","last_became_peered":"2023-10-16T08:51:23.693789+0000","last_unstale":"2023-10-16T08:51:25.002504+0000","last_undegraded":"2023-10-16T08:51:25.002504+0000","last_fullsized":"2023-10-16T08:51:25.002504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:34.725310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928781+0000","last_change":"2023-10-16T08:51:18.480432+0000","last_active":"2023-10-16T08:51:23.928781+0000","last_peered":"2023-10-16T08:51:23.928781+0000","last_clean":"2023-10-16T08:51:23.928781+0000","last_became_active":"2023-10-16T08:51:18.479649+0000","last_became_peered":"2023-10-16T08:51:18.479649+0000","last_unstale":"2023-10-16T08:51:23.928781+0000","last_undegraded":"2023-10-16T08:51:23.928781+0000","last_fullsized":"2023-10-16T08:51:23.928781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:59.612239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657088+0000","last_change":"2023-10-16T08:51:19.501369+0000","last_active":"2023-10-16T08:51:23.657088+0000","last_peered":"2023-10-16T08:51:23.657088+0000","last_clean":"2023-10-16T08:51:23.657088+0000","last_became_active":"2023-10-16T08:51:19.501077+0000","last_became_peered":"2023-10-16T08:51:19.501077+0000","last_unstale":"2023-10-16T08:51:23.657088+0000","last_undegraded":"2023-10-16T08:51:23.657088+0000","last_fullsized":"2023-10-16T08:51:23.657088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:04.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002122+0000","last_change":"2023-10-16T08:51:23.684667+0000","last_active":"2023-10-16T08:51:25.002122+0000","last_peered":"2023-10-16T08:51:25.002122+0000","last_clean":"2023-10-16T08:51:25.002122+0000","last_became_active":"2023-10-16T08:51:23.683885+0000","last_became_peered":"2023-10-16T08:51:23.683885+0000","last_unstale":"2023-10-16T08:51:25.002122+0000","last_undegraded":"2023-10-16T08:51:25.002122+0000","last_fullsized":"2023-10-16T08:51:25.002122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:31.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669202+0000","last_change":"2023-10-16T08:51:19.494151+0000","last_active":"2023-10-16T08:51:23.669202+0000","last_peered":"2023-10-16T08:51:23.669202+0000","last_clean":"2023-10-16T08:51:23.669202+0000","last_became_active":"2023-10-16T08:51:19.493825+0000","last_became_peered":"2023-10-16T08:51:19.493825+0000","last_unstale":"2023-10-16T08:51:23.669202+0000","last_undegraded":"2023-10-16T08:51:23.669202+0000","last_fullsized":"2023-10-16T08:51:23.669202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932601+0000","last_change":"2023-10-16T08:51:18.475975+0000","last_active":"2023-10-16T08:51:23.932601+0000","last_peered":"2023-10-16T08:51:23.932601+0000","last_clean":"2023-10-16T08:51:23.932601+0000","last_became_active":"2023-10-16T08:51:18.474515+0000","last_became_peered":"2023-10-16T08:51:18.474515+0000","last_unstale":"2023-10-16T08:51:23.932601+0000","last_undegraded":"2023-10-16T08:51:23.932601+0000","last_fullsized":"2023-10-16T08:51:23.932601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:19.036322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004645+0000","last_change":"2023-10-16T08:51:23.687410+0000","last_active":"2023-10-16T08:51:25.004645+0000","last_peered":"2023-10-16T08:51:25.004645+0000","last_clean":"2023-10-16T08:51:25.004645+0000","last_became_active":"2023-10-16T08:51:23.686729+0000","last_became_peered":"2023-10-16T08:51:23.686729+0000","last_unstale":"2023-10-16T08:51:25.004645+0000","last_undegraded":"2023-10-16T08:51:25.004645+0000","last_fullsized":"2023-10-16T08:51:25.004645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653922+0000","last_change":"2023-10-16T08:51:19.472792+0000","last_active":"2023-10-16T08:51:23.653922+0000","last_peered":"2023-10-16T08:51:23.653922+0000","last_clean":"2023-10-16T08:51:23.653922+0000","last_became_active":"2023-10-16T08:51:19.472538+0000","last_became_peered":"2023-10-16T08:51:19.472538+0000","last_unstale":"2023-10-16T08:51:23.653922+0000","last_undegraded":"2023-10-16T08:51:23.653922+0000","last_fullsized":"2023-10-16T08:51:23.653922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676788+0000","last_change":"2023-10-16T08:51:18.460657+0000","last_active":"2023-10-16T08:51:23.676788+0000","last_peered":"2023-10-16T08:51:23.676788+0000","last_clean":"2023-10-16T08:51:23.676788+0000","last_became_active":"2023-10-16T08:51:18.460294+0000","last_became_peered":"2023-10-16T08:51:18.460294+0000","last_unstale":"2023-10-16T08:51:23.676788+0000","last_undegraded":"2023-10-16T08:51:23.676788+0000","last_fullsized":"2023-10-16T08:51:23.676788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003182+0000","last_change":"2023-10-16T08:51:23.687710+0000","last_active":"2023-10-16T08:51:25.003182+0000","last_peered":"2023-10-16T08:51:25.003182+0000","last_clean":"2023-10-16T08:51:25.003182+0000","last_became_active":"2023-10-16T08:51:23.686904+0000","last_became_peered":"2023-10-16T08:51:23.686904+0000","last_unstale":"2023-10-16T08:51:25.003182+0000","last_undegraded":"2023-10-16T08:51:25.003182+0000","last_fullsized":"2023-10-16T08:51:25.003182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658779+0000","last_change":"2023-10-16T08:51:19.493284+0000","last_active":"2023-10-16T08:51:23.658779+0000","last_peered":"2023-10-16T08:51:23.658779+0000","last_clean":"2023-10-16T08:51:23.658779+0000","last_became_active":"2023-10-16T08:51:19.493001+0000","last_became_peered":"2023-10-16T08:51:19.493001+0000","last_unstale":"2023-10-16T08:51:23.658779+0000","last_undegraded":"2023-10-16T08:51:23.658779+0000","last_fullsized":"2023-10-16T08:51:23.658779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676274+0000","last_change":"2023-10-16T08:51:18.474813+0000","last_active":"2023-10-16T08:51:23.676274+0000","last_peered":"2023-10-16T08:51:23.676274+0000","last_clean":"2023-10-16T08:51:23.676274+0000","last_became_active":"2023-10-16T08:51:18.474551+0000","last_became_peered":"2023-10-16T08:51:18.474551+0000","last_unstale":"2023-10-16T08:51:23.676274+0000","last_undegraded":"2023-10-16T08:51:23.676274+0000","last_fullsized":"2023-10-16T08:51:23.676274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:14:07.961126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630476+0000","last_change":"2023-10-16T08:51:23.936794+0000","last_active":"2023-10-16T08:51:24.630476+0000","last_peered":"2023-10-16T08:51:24.630476+0000","last_clean":"2023-10-16T08:51:24.630476+0000","last_became_active":"2023-10-16T08:51:23.936108+0000","last_became_peered":"2023-10-16T08:51:23.936108+0000","last_unstale":"2023-10-16T08:51:24.630476+0000","last_undegraded":"2023-10-16T08:51:24.630476+0000","last_fullsized":"2023-10-16T08:51:24.630476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:54.425130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674596+0000","last_change":"2023-10-16T08:51:19.487794+0000","last_active":"2023-10-16T08:51:23.674596+0000","last_peered":"2023-10-16T08:51:23.674596+0000","last_clean":"2023-10-16T08:51:23.674596+0000","last_became_active":"2023-10-16T08:51:19.487394+0000","last_became_peered":"2023-10-16T08:51:19.487394+0000","last_unstale":"2023-10-16T08:51:23.674596+0000","last_undegraded":"2023-10-16T08:51:23.674596+0000","last_fullsized":"2023-10-16T08:51:23.674596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:55.545822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927706+0000","last_change":"2023-10-16T08:51:18.475910+0000","last_active":"2023-10-16T08:51:23.927706+0000","last_peered":"2023-10-16T08:51:23.927706+0000","last_clean":"2023-10-16T08:51:23.927706+0000","last_became_active":"2023-10-16T08:51:18.475567+0000","last_became_peered":"2023-10-16T08:51:18.475567+0000","last_unstale":"2023-10-16T08:51:23.927706+0000","last_undegraded":"2023-10-16T08:51:23.927706+0000","last_fullsized":"2023-10-16T08:51:23.927706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003131+0000","last_change":"2023-10-16T08:51:23.688779+0000","last_active":"2023-10-16T08:51:25.003131+0000","last_peered":"2023-10-16T08:51:25.003131+0000","last_clean":"2023-10-16T08:51:25.003131+0000","last_became_active":"2023-10-16T08:51:23.688065+0000","last_became_peered":"2023-10-16T08:51:23.688065+0000","last_unstale":"2023-10-16T08:51:25.003131+0000","last_undegraded":"2023-10-16T08:51:25.003131+0000","last_fullsized":"2023-10-16T08:51:25.003131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:37.434614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.668428+0000","last_change":"2023-10-16T08:51:19.483164+0000","last_active":"2023-10-16T08:51:23.668428+0000","last_peered":"2023-10-16T08:51:23.668428+0000","last_clean":"2023-10-16T08:51:23.668428+0000","last_became_active":"2023-10-16T08:51:19.482701+0000","last_became_peered":"2023-10-16T08:51:19.482701+0000","last_unstale":"2023-10-16T08:51:23.668428+0000","last_undegraded":"2023-10-16T08:51:23.668428+0000","last_fullsized":"2023-10-16T08:51:23.668428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:30:05.215149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673453+0000","last_change":"2023-10-16T08:51:18.479436+0000","last_active":"2023-10-16T08:51:23.673453+0000","last_peered":"2023-10-16T08:51:23.673453+0000","last_clean":"2023-10-16T08:51:23.673453+0000","last_became_active":"2023-10-16T08:51:18.479112+0000","last_became_peered":"2023-10-16T08:51:18.479112+0000","last_unstale":"2023-10-16T08:51:23.673453+0000","last_undegraded":"2023-10-16T08:51:23.673453+0000","last_fullsized":"2023-10-16T08:51:23.673453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:18.761013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002204+0000","last_change":"2023-10-16T08:51:23.941023+0000","last_active":"2023-10-16T08:51:25.002204+0000","last_peered":"2023-10-16T08:51:25.002204+0000","last_clean":"2023-10-16T08:51:25.002204+0000","last_became_active":"2023-10-16T08:51:23.939686+0000","last_became_peered":"2023-10-16T08:51:23.939686+0000","last_unstale":"2023-10-16T08:51:25.002204+0000","last_undegraded":"2023-10-16T08:51:25.002204+0000","last_fullsized":"2023-10-16T08:51:25.002204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:13.170275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657614+0000","last_change":"2023-10-16T08:51:19.480568+0000","last_active":"2023-10-16T08:51:23.657614+0000","last_peered":"2023-10-16T08:51:23.657614+0000","last_clean":"2023-10-16T08:51:23.657614+0000","last_became_active":"2023-10-16T08:51:19.480223+0000","last_became_peered":"2023-10-16T08:51:19.480223+0000","last_unstale":"2023-10-16T08:51:23.657614+0000","last_undegraded":"2023-10-16T08:51:23.657614+0000","last_fullsized":"2023-10-16T08:51:23.657614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.426065+0000","last_change":"2023-10-16T08:51:18.478908+0000","last_active":"2023-10-16T08:51:24.426065+0000","last_peered":"2023-10-16T08:51:24.426065+0000","last_clean":"2023-10-16T08:51:24.426065+0000","last_became_active":"2023-10-16T08:51:18.478555+0000","last_became_peered":"2023-10-16T08:51:18.478555+0000","last_unstale":"2023-10-16T08:51:24.426065+0000","last_undegraded":"2023-10-16T08:51:24.426065+0000","last_fullsized":"2023-10-16T08:51:24.426065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:08.306658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631947+0000","last_change":"2023-10-16T08:51:23.932191+0000","last_active":"2023-10-16T08:51:24.631947+0000","last_peered":"2023-10-16T08:51:24.631947+0000","last_clean":"2023-10-16T08:51:24.631947+0000","last_became_active":"2023-10-16T08:51:23.930143+0000","last_became_peered":"2023-10-16T08:51:23.930143+0000","last_unstale":"2023-10-16T08:51:24.631947+0000","last_undegraded":"2023-10-16T08:51:24.631947+0000","last_fullsized":"2023-10-16T08:51:24.631947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:39:17.871021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676364+0000","last_change":"2023-10-16T08:51:19.485482+0000","last_active":"2023-10-16T08:51:23.676364+0000","last_peered":"2023-10-16T08:51:23.676364+0000","last_clean":"2023-10-16T08:51:23.676364+0000","last_became_active":"2023-10-16T08:51:19.485128+0000","last_became_peered":"2023-10-16T08:51:19.485128+0000","last_unstale":"2023-10-16T08:51:23.676364+0000","last_undegraded":"2023-10-16T08:51:23.676364+0000","last_fullsized":"2023-10-16T08:51:23.676364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:44:22.627895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933002+0000","last_change":"2023-10-16T08:51:18.478714+0000","last_active":"2023-10-16T08:51:23.933002+0000","last_peered":"2023-10-16T08:51:23.933002+0000","last_clean":"2023-10-16T08:51:23.933002+0000","last_became_active":"2023-10-16T08:51:18.478354+0000","last_became_peered":"2023-10-16T08:51:18.478354+0000","last_unstale":"2023-10-16T08:51:23.933002+0000","last_undegraded":"2023-10-16T08:51:23.933002+0000","last_fullsized":"2023-10-16T08:51:23.933002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780092+0000","last_change":"2023-10-16T08:51:23.929043+0000","last_active":"2023-10-16T08:51:24.780092+0000","last_peered":"2023-10-16T08:51:24.780092+0000","last_clean":"2023-10-16T08:51:24.780092+0000","last_became_active":"2023-10-16T08:51:23.928546+0000","last_became_peered":"2023-10-16T08:51:23.928546+0000","last_unstale":"2023-10-16T08:51:24.780092+0000","last_undegraded":"2023-10-16T08:51:24.780092+0000","last_fullsized":"2023-10-16T08:51:24.780092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656981+0000","last_change":"2023-10-16T08:51:19.489157+0000","last_active":"2023-10-16T08:51:23.656981+0000","last_peered":"2023-10-16T08:51:23.656981+0000","last_clean":"2023-10-16T08:51:23.656981+0000","last_became_active":"2023-10-16T08:51:19.488862+0000","last_became_peered":"2023-10-16T08:51:19.488862+0000","last_unstale":"2023-10-16T08:51:23.656981+0000","last_undegraded":"2023-10-16T08:51:23.656981+0000","last_fullsized":"2023-10-16T08:51:23.656981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:15.931317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676443+0000","last_change":"2023-10-16T08:51:18.453987+0000","last_active":"2023-10-16T08:51:23.676443+0000","last_peered":"2023-10-16T08:51:23.676443+0000","last_clean":"2023-10-16T08:51:23.676443+0000","last_became_active":"2023-10-16T08:51:18.453706+0000","last_became_peered":"2023-10-16T08:51:18.453706+0000","last_unstale":"2023-10-16T08:51:23.676443+0000","last_undegraded":"2023-10-16T08:51:23.676443+0000","last_fullsized":"2023-10-16T08:51:23.676443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:24.379905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629365+0000","last_change":"2023-10-16T08:51:23.690542+0000","last_active":"2023-10-16T08:51:24.629365+0000","last_peered":"2023-10-16T08:51:24.629365+0000","last_clean":"2023-10-16T08:51:24.629365+0000","last_became_active":"2023-10-16T08:51:23.690171+0000","last_became_peered":"2023-10-16T08:51:23.690171+0000","last_unstale":"2023-10-16T08:51:24.629365+0000","last_undegraded":"2023-10-16T08:51:24.629365+0000","last_fullsized":"2023-10-16T08:51:24.629365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682083+0000","last_change":"2023-10-16T08:51:19.486242+0000","last_active":"2023-10-16T08:51:23.682083+0000","last_peered":"2023-10-16T08:51:23.682083+0000","last_clean":"2023-10-16T08:51:23.682083+0000","last_became_active":"2023-10-16T08:51:19.485941+0000","last_became_peered":"2023-10-16T08:51:19.485941+0000","last_unstale":"2023-10-16T08:51:23.682083+0000","last_undegraded":"2023-10-16T08:51:23.682083+0000","last_fullsized":"2023-10-16T08:51:23.682083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:06.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656642+0000","last_change":"2023-10-16T08:51:18.457937+0000","last_active":"2023-10-16T08:51:23.656642+0000","last_peered":"2023-10-16T08:51:23.656642+0000","last_clean":"2023-10-16T08:51:23.656642+0000","last_became_active":"2023-10-16T08:51:18.457566+0000","last_became_peered":"2023-10-16T08:51:18.457566+0000","last_unstale":"2023-10-16T08:51:23.656642+0000","last_undegraded":"2023-10-16T08:51:23.656642+0000","last_fullsized":"2023-10-16T08:51:23.656642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:38.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630284+0000","last_change":"2023-10-16T08:51:23.690160+0000","last_active":"2023-10-16T08:51:24.630284+0000","last_peered":"2023-10-16T08:51:24.630284+0000","last_clean":"2023-10-16T08:51:24.630284+0000","last_became_active":"2023-10-16T08:51:23.689134+0000","last_became_peered":"2023-10-16T08:51:23.689134+0000","last_unstale":"2023-10-16T08:51:24.630284+0000","last_undegraded":"2023-10-16T08:51:24.630284+0000","last_fullsized":"2023-10-16T08:51:24.630284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:38.891384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674275+0000","last_change":"2023-10-16T08:51:19.477337+0000","last_active":"2023-10-16T08:51:23.674275+0000","last_peered":"2023-10-16T08:51:23.674275+0000","last_clean":"2023-10-16T08:51:23.674275+0000","last_became_active":"2023-10-16T08:51:19.476998+0000","last_became_peered":"2023-10-16T08:51:19.476998+0000","last_unstale":"2023-10-16T08:51:23.674275+0000","last_undegraded":"2023-10-16T08:51:23.674275+0000","last_fullsized":"2023-10-16T08:51:23.674275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:33.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654094+0000","last_change":"2023-10-16T08:51:18.463848+0000","last_active":"2023-10-16T08:51:23.654094+0000","last_peered":"2023-10-16T08:51:23.654094+0000","last_clean":"2023-10-16T08:51:23.654094+0000","last_became_active":"2023-10-16T08:51:18.463071+0000","last_became_peered":"2023-10-16T08:51:18.463071+0000","last_unstale":"2023-10-16T08:51:23.654094+0000","last_undegraded":"2023-10-16T08:51:23.654094+0000","last_fullsized":"2023-10-16T08:51:23.654094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630687+0000","last_change":"2023-10-16T08:51:23.691542+0000","last_active":"2023-10-16T08:51:24.630687+0000","last_peered":"2023-10-16T08:51:24.630687+0000","last_clean":"2023-10-16T08:51:24.630687+0000","last_became_active":"2023-10-16T08:51:23.691184+0000","last_became_peered":"2023-10-16T08:51:23.691184+0000","last_unstale":"2023-10-16T08:51:24.630687+0000","last_undegraded":"2023-10-16T08:51:24.630687+0000","last_fullsized":"2023-10-16T08:51:24.630687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:30.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663653+0000","last_change":"2023-10-16T08:51:19.489377+0000","last_active":"2023-10-16T08:51:23.663653+0000","last_peered":"2023-10-16T08:51:23.663653+0000","last_clean":"2023-10-16T08:51:23.663653+0000","last_became_active":"2023-10-16T08:51:19.488616+0000","last_became_peered":"2023-10-16T08:51:19.488616+0000","last_unstale":"2023-10-16T08:51:23.663653+0000","last_undegraded":"2023-10-16T08:51:23.663653+0000","last_fullsized":"2023-10-16T08:51:23.663653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927969+0000","last_change":"2023-10-16T08:51:18.476307+0000","last_active":"2023-10-16T08:51:23.927969+0000","last_peered":"2023-10-16T08:51:23.927969+0000","last_clean":"2023-10-16T08:51:23.927969+0000","last_became_active":"2023-10-16T08:51:18.475934+0000","last_became_peered":"2023-10-16T08:51:18.475934+0000","last_unstale":"2023-10-16T08:51:23.927969+0000","last_undegraded":"2023-10-16T08:51:23.927969+0000","last_fullsized":"2023-10-16T08:51:23.927969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780681+0000","last_change":"2023-10-16T08:51:23.940016+0000","last_active":"2023-10-16T08:51:24.780681+0000","last_peered":"2023-10-16T08:51:24.780681+0000","last_clean":"2023-10-16T08:51:24.780681+0000","last_became_active":"2023-10-16T08:51:23.939540+0000","last_became_peered":"2023-10-16T08:51:23.939540+0000","last_unstale":"2023-10-16T08:51:24.780681+0000","last_undegraded":"2023-10-16T08:51:24.780681+0000","last_fullsized":"2023-10-16T08:51:24.780681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:06.205944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655322+0000","last_change":"2023-10-16T08:51:19.488905+0000","last_active":"2023-10-16T08:51:23.655322+0000","last_peered":"2023-10-16T08:51:23.655322+0000","last_clean":"2023-10-16T08:51:23.655322+0000","last_became_active":"2023-10-16T08:51:19.488447+0000","last_became_peered":"2023-10-16T08:51:19.488447+0000","last_unstale":"2023-10-16T08:51:23.655322+0000","last_undegraded":"2023-10-16T08:51:23.655322+0000","last_fullsized":"2023-10-16T08:51:23.655322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654978+0000","last_change":"2023-10-16T08:51:18.461925+0000","last_active":"2023-10-16T08:51:23.654978+0000","last_peered":"2023-10-16T08:51:23.654978+0000","last_clean":"2023-10-16T08:51:23.654978+0000","last_became_active":"2023-10-16T08:51:18.461503+0000","last_became_peered":"2023-10-16T08:51:18.461503+0000","last_unstale":"2023-10-16T08:51:23.654978+0000","last_undegraded":"2023-10-16T08:51:23.654978+0000","last_fullsized":"2023-10-16T08:51:23.654978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:25.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928140+0000","last_change":"2023-10-16T08:51:09.503647+0000","last_active":"2023-10-16T08:51:23.928140+0000","last_peered":"2023-10-16T08:51:23.928140+0000","last_clean":"2023-10-16T08:51:23.928140+0000","last_became_active":"2023-10-16T08:51:09.501573+0000","last_became_peered":"2023-10-16T08:51:09.501573+0000","last_unstale":"2023-10-16T08:51:23.928140+0000","last_undegraded":"2023-10-16T08:51:23.928140+0000","last_fullsized":"2023-10-16T08:51:23.928140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_clean_scrub_stamp":"2023-10-16T08:51:08.277379+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:32.541738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632345+0000","last_change":"2023-10-16T08:51:23.937102+0000","last_active":"2023-10-16T08:51:24.632345+0000","last_peered":"2023-10-16T08:51:24.632345+0000","last_clean":"2023-10-16T08:51:24.632345+0000","last_became_active":"2023-10-16T08:51:23.935917+0000","last_became_peered":"2023-10-16T08:51:23.935917+0000","last_unstale":"2023-10-16T08:51:24.632345+0000","last_undegraded":"2023-10-16T08:51:24.632345+0000","last_fullsized":"2023-10-16T08:51:24.632345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932357+0000","last_change":"2023-10-16T08:51:19.482065+0000","last_active":"2023-10-16T08:51:23.932357+0000","last_peered":"2023-10-16T08:51:23.932357+0000","last_clean":"2023-10-16T08:51:23.932357+0000","last_became_active":"2023-10-16T08:51:19.481709+0000","last_became_peered":"2023-10-16T08:51:19.481709+0000","last_unstale":"2023-10-16T08:51:23.932357+0000","last_undegraded":"2023-10-16T08:51:23.932357+0000","last_fullsized":"2023-10-16T08:51:23.932357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:52.502214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656330+0000","last_change":"2023-10-16T08:51:18.461990+0000","last_active":"2023-10-16T08:51:23.656330+0000","last_peered":"2023-10-16T08:51:23.656330+0000","last_clean":"2023-10-16T08:51:23.656330+0000","last_became_active":"2023-10-16T08:51:18.461726+0000","last_became_peered":"2023-10-16T08:51:18.461726+0000","last_unstale":"2023-10-16T08:51:23.656330+0000","last_undegraded":"2023-10-16T08:51:23.656330+0000","last_fullsized":"2023-10-16T08:51:23.656330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:00.458386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631811+0000","last_change":"2023-10-16T08:51:23.931184+0000","last_active":"2023-10-16T08:51:24.631811+0000","last_peered":"2023-10-16T08:51:24.631811+0000","last_clean":"2023-10-16T08:51:24.631811+0000","last_became_active":"2023-10-16T08:51:23.929798+0000","last_became_peered":"2023-10-16T08:51:23.929798+0000","last_unstale":"2023-10-16T08:51:24.631811+0000","last_undegraded":"2023-10-16T08:51:24.631811+0000","last_fullsized":"2023-10-16T08:51:24.631811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:24.877683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655861+0000","last_change":"2023-10-16T08:51:19.498976+0000","last_active":"2023-10-16T08:51:23.655861+0000","last_peered":"2023-10-16T08:51:23.655861+0000","last_clean":"2023-10-16T08:51:23.655861+0000","last_became_active":"2023-10-16T08:51:19.498594+0000","last_became_peered":"2023-10-16T08:51:19.498594+0000","last_unstale":"2023-10-16T08:51:23.655861+0000","last_undegraded":"2023-10-16T08:51:23.655861+0000","last_fullsized":"2023-10-16T08:51:23.655861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.675885+0000","last_change":"2023-10-16T08:51:18.466809+0000","last_active":"2023-10-16T08:51:23.675885+0000","last_peered":"2023-10-16T08:51:23.675885+0000","last_clean":"2023-10-16T08:51:23.675885+0000","last_became_active":"2023-10-16T08:51:18.466510+0000","last_became_peered":"2023-10-16T08:51:18.466510+0000","last_unstale":"2023-10-16T08:51:23.675885+0000","last_undegraded":"2023-10-16T08:51:23.675885+0000","last_fullsized":"2023-10-16T08:51:23.675885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:21:49.782547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780180+0000","last_change":"2023-10-16T08:51:23.685215+0000","last_active":"2023-10-16T08:51:24.780180+0000","last_peered":"2023-10-16T08:51:24.780180+0000","last_clean":"2023-10-16T08:51:24.780180+0000","last_became_active":"2023-10-16T08:51:23.684822+0000","last_became_peered":"2023-10-16T08:51:23.684822+0000","last_unstale":"2023-10-16T08:51:24.780180+0000","last_undegraded":"2023-10-16T08:51:24.780180+0000","last_fullsized":"2023-10-16T08:51:24.780180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933980+0000","last_change":"2023-10-16T08:51:19.499775+0000","last_active":"2023-10-16T08:51:23.933980+0000","last_peered":"2023-10-16T08:51:23.933980+0000","last_clean":"2023-10-16T08:51:23.933980+0000","last_became_active":"2023-10-16T08:51:19.499561+0000","last_became_peered":"2023-10-16T08:51:19.499561+0000","last_unstale":"2023-10-16T08:51:23.933980+0000","last_undegraded":"2023-10-16T08:51:23.933980+0000","last_fullsized":"2023-10-16T08:51:23.933980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:58:34.736828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655991+0000","last_change":"2023-10-16T08:51:18.461494+0000","last_active":"2023-10-16T08:51:23.655991+0000","last_peered":"2023-10-16T08:51:23.655991+0000","last_clean":"2023-10-16T08:51:23.655991+0000","last_became_active":"2023-10-16T08:51:18.461196+0000","last_became_peered":"2023-10-16T08:51:18.461196+0000","last_unstale":"2023-10-16T08:51:23.655991+0000","last_undegraded":"2023-10-16T08:51:23.655991+0000","last_fullsized":"2023-10-16T08:51:23.655991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004761+0000","last_change":"2023-10-16T08:51:23.942518+0000","last_active":"2023-10-16T08:51:25.004761+0000","last_peered":"2023-10-16T08:51:25.004761+0000","last_clean":"2023-10-16T08:51:25.004761+0000","last_became_active":"2023-10-16T08:51:23.940495+0000","last_became_peered":"2023-10-16T08:51:23.940495+0000","last_unstale":"2023-10-16T08:51:25.004761+0000","last_undegraded":"2023-10-16T08:51:25.004761+0000","last_fullsized":"2023-10-16T08:51:25.004761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932360+0000","last_change":"2023-10-16T08:51:19.502686+0000","last_active":"2023-10-16T08:51:23.932360+0000","last_peered":"2023-10-16T08:51:23.932360+0000","last_clean":"2023-10-16T08:51:23.932360+0000","last_became_active":"2023-10-16T08:51:19.502370+0000","last_became_peered":"2023-10-16T08:51:19.502370+0000","last_unstale":"2023-10-16T08:51:23.932360+0000","last_undegraded":"2023-10-16T08:51:23.932360+0000","last_fullsized":"2023-10-16T08:51:23.932360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:33.452930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682777+0000","last_change":"2023-10-16T08:51:18.457359+0000","last_active":"2023-10-16T08:51:23.682777+0000","last_peered":"2023-10-16T08:51:23.682777+0000","last_clean":"2023-10-16T08:51:23.682777+0000","last_became_active":"2023-10-16T08:51:18.454341+0000","last_became_peered":"2023-10-16T08:51:18.454341+0000","last_unstale":"2023-10-16T08:51:23.682777+0000","last_undegraded":"2023-10-16T08:51:23.682777+0000","last_fullsized":"2023-10-16T08:51:23.682777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001723+0000","last_change":"2023-10-16T08:51:23.687589+0000","last_active":"2023-10-16T08:51:25.001723+0000","last_peered":"2023-10-16T08:51:25.001723+0000","last_clean":"2023-10-16T08:51:25.001723+0000","last_became_active":"2023-10-16T08:51:23.687045+0000","last_became_peered":"2023-10-16T08:51:23.687045+0000","last_unstale":"2023-10-16T08:51:25.001723+0000","last_undegraded":"2023-10-16T08:51:25.001723+0000","last_fullsized":"2023-10-16T08:51:25.001723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:16.195721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927678+0000","last_change":"2023-10-16T08:51:19.499551+0000","last_active":"2023-10-16T08:51:23.927678+0000","last_peered":"2023-10-16T08:51:23.927678+0000","last_clean":"2023-10-16T08:51:23.927678+0000","last_became_active":"2023-10-16T08:51:19.499250+0000","last_became_peered":"2023-10-16T08:51:19.499250+0000","last_unstale":"2023-10-16T08:51:23.927678+0000","last_undegraded":"2023-10-16T08:51:23.927678+0000","last_fullsized":"2023-10-16T08:51:23.927678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:08.959209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653215+0000","last_change":"2023-10-16T08:51:18.452602+0000","last_active":"2023-10-16T08:51:23.653215+0000","last_peered":"2023-10-16T08:51:23.653215+0000","last_clean":"2023-10-16T08:51:23.653215+0000","last_became_active":"2023-10-16T08:51:18.452286+0000","last_became_peered":"2023-10-16T08:51:18.452286+0000","last_unstale":"2023-10-16T08:51:23.653215+0000","last_undegraded":"2023-10-16T08:51:23.653215+0000","last_fullsized":"2023-10-16T08:51:23.653215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:09.991021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780619+0000","last_change":"2023-10-16T08:51:23.680434+0000","last_active":"2023-10-16T08:51:24.780619+0000","last_peered":"2023-10-16T08:51:24.780619+0000","last_clean":"2023-10-16T08:51:24.780619+0000","last_became_active":"2023-10-16T08:51:23.679325+0000","last_became_peered":"2023-10-16T08:51:23.679325+0000","last_unstale":"2023-10-16T08:51:24.780619+0000","last_undegraded":"2023-10-16T08:51:24.780619+0000","last_fullsized":"2023-10-16T08:51:24.780619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:54.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666563+0000","last_change":"2023-10-16T08:51:19.477576+0000","last_active":"2023-10-16T08:51:23.666563+0000","last_peered":"2023-10-16T08:51:23.666563+0000","last_clean":"2023-10-16T08:51:23.666563+0000","last_became_active":"2023-10-16T08:51:19.477091+0000","last_became_peered":"2023-10-16T08:51:19.477091+0000","last_unstale":"2023-10-16T08:51:23.666563+0000","last_undegraded":"2023-10-16T08:51:23.666563+0000","last_fullsized":"2023-10-16T08:51:23.666563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669994+0000","last_change":"2023-10-16T08:51:18.471810+0000","last_active":"2023-10-16T08:51:23.669994+0000","last_peered":"2023-10-16T08:51:23.669994+0000","last_clean":"2023-10-16T08:51:23.669994+0000","last_became_active":"2023-10-16T08:51:18.471510+0000","last_became_peered":"2023-10-16T08:51:18.471510+0000","last_unstale":"2023-10-16T08:51:23.669994+0000","last_undegraded":"2023-10-16T08:51:23.669994+0000","last_fullsized":"2023-10-16T08:51:23.669994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633912+0000","last_change":"2023-10-16T08:51:23.938213+0000","last_active":"2023-10-16T08:51:24.633912+0000","last_peered":"2023-10-16T08:51:24.633912+0000","last_clean":"2023-10-16T08:51:24.633912+0000","last_became_active":"2023-10-16T08:51:23.937788+0000","last_became_peered":"2023-10-16T08:51:23.937788+0000","last_unstale":"2023-10-16T08:51:24.633912+0000","last_undegraded":"2023-10-16T08:51:24.633912+0000","last_fullsized":"2023-10-16T08:51:24.633912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:49:28.604941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932586+0000","last_change":"2023-10-16T08:51:19.505378+0000","last_active":"2023-10-16T08:51:23.932586+0000","last_peered":"2023-10-16T08:51:23.932586+0000","last_clean":"2023-10-16T08:51:23.932586+0000","last_became_active":"2023-10-16T08:51:19.500129+0000","last_became_peered":"2023-10-16T08:51:19.500129+0000","last_unstale":"2023-10-16T08:51:23.932586+0000","last_undegraded":"2023-10-16T08:51:23.932586+0000","last_fullsized":"2023-10-16T08:51:23.932586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:33.223548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656405+0000","last_change":"2023-10-16T08:51:18.462956+0000","last_active":"2023-10-16T08:51:23.656405+0000","last_peered":"2023-10-16T08:51:23.656405+0000","last_clean":"2023-10-16T08:51:23.656405+0000","last_became_active":"2023-10-16T08:51:18.462673+0000","last_became_peered":"2023-10-16T08:51:18.462673+0000","last_unstale":"2023-10-16T08:51:23.656405+0000","last_undegraded":"2023-10-16T08:51:23.656405+0000","last_fullsized":"2023-10-16T08:51:23.656405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:34.739453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.634200+0000","last_change":"2023-10-16T08:51:23.938458+0000","last_active":"2023-10-16T08:51:24.634200+0000","last_peered":"2023-10-16T08:51:24.634200+0000","last_clean":"2023-10-16T08:51:24.634200+0000","last_became_active":"2023-10-16T08:51:23.938009+0000","last_became_peered":"2023-10-16T08:51:23.938009+0000","last_unstale":"2023-10-16T08:51:24.634200+0000","last_undegraded":"2023-10-16T08:51:24.634200+0000","last_fullsized":"2023-10-16T08:51:24.634200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:17:08.498890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663209+0000","last_change":"2023-10-16T08:51:19.490700+0000","last_active":"2023-10-16T08:51:23.663209+0000","last_peered":"2023-10-16T08:51:23.663209+0000","last_clean":"2023-10-16T08:51:23.663209+0000","last_became_active":"2023-10-16T08:51:19.490423+0000","last_became_peered":"2023-10-16T08:51:19.490423+0000","last_unstale":"2023-10-16T08:51:23.663209+0000","last_undegraded":"2023-10-16T08:51:23.663209+0000","last_fullsized":"2023-10-16T08:51:23.663209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:19.773784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663431+0000","last_change":"2023-10-16T08:51:18.467662+0000","last_active":"2023-10-16T08:51:23.663431+0000","last_peered":"2023-10-16T08:51:23.663431+0000","last_clean":"2023-10-16T08:51:23.663431+0000","last_became_active":"2023-10-16T08:51:18.466371+0000","last_became_peered":"2023-10-16T08:51:18.466371+0000","last_unstale":"2023-10-16T08:51:23.663431+0000","last_undegraded":"2023-10-16T08:51:23.663431+0000","last_fullsized":"2023-10-16T08:51:23.663431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:41:34.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.009698+0000","last_change":"2023-10-16T08:51:23.933148+0000","last_active":"2023-10-16T08:51:25.009698+0000","last_peered":"2023-10-16T08:51:25.009698+0000","last_clean":"2023-10-16T08:51:25.009698+0000","last_became_active":"2023-10-16T08:51:23.929507+0000","last_became_peered":"2023-10-16T08:51:23.929507+0000","last_unstale":"2023-10-16T08:51:25.009698+0000","last_undegraded":"2023-10-16T08:51:25.009698+0000","last_fullsized":"2023-10-16T08:51:25.009698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932219+0000","last_change":"2023-10-16T08:51:19.489578+0000","last_active":"2023-10-16T08:51:23.932219+0000","last_peered":"2023-10-16T08:51:23.932219+0000","last_clean":"2023-10-16T08:51:23.932219+0000","last_became_active":"2023-10-16T08:51:19.489229+0000","last_became_peered":"2023-10-16T08:51:19.489229+0000","last_unstale":"2023-10-16T08:51:23.932219+0000","last_undegraded":"2023-10-16T08:51:23.932219+0000","last_fullsized":"2023-10-16T08:51:23.932219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:30.514244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:37.318046+0000","last_change":"2023-10-16T08:51:18.473025+0000","last_active":"2023-10-16T08:51:37.318046+0000","last_peered":"2023-10-16T08:51:37.318046+0000","last_clean":"2023-10-16T08:51:37.318046+0000","last_became_active":"2023-10-16T08:51:18.471838+0000","last_became_peered":"2023-10-16T08:51:18.471838+0000","last_unstale":"2023-10-16T08:51:37.318046+0000","last_undegraded":"2023-10-16T08:51:37.318046+0000","last_fullsized":"2023-10-16T08:51:37.318046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:29.907304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629165+0000","last_change":"2023-10-16T08:51:23.687837+0000","last_active":"2023-10-16T08:51:24.629165+0000","last_peered":"2023-10-16T08:51:24.629165+0000","last_clean":"2023-10-16T08:51:24.629165+0000","last_became_active":"2023-10-16T08:51:23.687415+0000","last_became_peered":"2023-10-16T08:51:23.687415+0000","last_unstale":"2023-10-16T08:51:24.629165+0000","last_undegraded":"2023-10-16T08:51:24.629165+0000","last_fullsized":"2023-10-16T08:51:24.629165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681874+0000","last_change":"2023-10-16T08:51:19.493209+0000","last_active":"2023-10-16T08:51:23.681874+0000","last_peered":"2023-10-16T08:51:23.681874+0000","last_clean":"2023-10-16T08:51:23.681874+0000","last_became_active":"2023-10-16T08:51:19.493039+0000","last_became_peered":"2023-10-16T08:51:19.493039+0000","last_unstale":"2023-10-16T08:51:23.681874+0000","last_undegraded":"2023-10-16T08:51:23.681874+0000","last_fullsized":"2023-10-16T08:51:23.681874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674711+0000","last_change":"2023-10-16T08:51:18.463657+0000","last_active":"2023-10-16T08:51:23.674711+0000","last_peered":"2023-10-16T08:51:23.674711+0000","last_clean":"2023-10-16T08:51:23.674711+0000","last_became_active":"2023-10-16T08:51:18.463329+0000","last_became_peered":"2023-10-16T08:51:18.463329+0000","last_unstale":"2023-10-16T08:51:23.674711+0000","last_undegraded":"2023-10-16T08:51:23.674711+0000","last_fullsized":"2023-10-16T08:51:23.674711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002944+0000","last_change":"2023-10-16T08:51:23.690913+0000","last_active":"2023-10-16T08:51:25.002944+0000","last_peered":"2023-10-16T08:51:25.002944+0000","last_clean":"2023-10-16T08:51:25.002944+0000","last_became_active":"2023-10-16T08:51:23.690240+0000","last_became_peered":"2023-10-16T08:51:23.690240+0000","last_unstale":"2023-10-16T08:51:25.002944+0000","last_undegraded":"2023-10-16T08:51:25.002944+0000","last_fullsized":"2023-10-16T08:51:25.002944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:12.508988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664438+0000","last_change":"2023-10-16T08:51:19.479453+0000","last_active":"2023-10-16T08:51:23.664438+0000","last_peered":"2023-10-16T08:51:23.664438+0000","last_clean":"2023-10-16T08:51:23.664438+0000","last_became_active":"2023-10-16T08:51:19.479175+0000","last_became_peered":"2023-10-16T08:51:19.479175+0000","last_unstale":"2023-10-16T08:51:23.664438+0000","last_undegraded":"2023-10-16T08:51:23.664438+0000","last_fullsized":"2023-10-16T08:51:23.664438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655640+0000","last_change":"2023-10-16T08:51:18.477626+0000","last_active":"2023-10-16T08:51:23.655640+0000","last_peered":"2023-10-16T08:51:23.655640+0000","last_clean":"2023-10-16T08:51:23.655640+0000","last_became_active":"2023-10-16T08:51:18.476856+0000","last_became_peered":"2023-10-16T08:51:18.476856+0000","last_unstale":"2023-10-16T08:51:23.655640+0000","last_undegraded":"2023-10-16T08:51:23.655640+0000","last_fullsized":"2023-10-16T08:51:23.655640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:06.623099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632401+0000","last_change":"2023-10-16T08:51:23.684289+0000","last_active":"2023-10-16T08:51:24.632401+0000","last_peered":"2023-10-16T08:51:24.632401+0000","last_clean":"2023-10-16T08:51:24.632401+0000","last_became_active":"2023-10-16T08:51:23.682351+0000","last_became_peered":"2023-10-16T08:51:23.682351+0000","last_unstale":"2023-10-16T08:51:24.632401+0000","last_undegraded":"2023-10-16T08:51:24.632401+0000","last_fullsized":"2023-10-16T08:51:24.632401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:19:24.423311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655380+0000","last_change":"2023-10-16T08:51:19.496098+0000","last_active":"2023-10-16T08:51:23.655380+0000","last_peered":"2023-10-16T08:51:23.655380+0000","last_clean":"2023-10-16T08:51:23.655380+0000","last_became_active":"2023-10-16T08:51:19.495623+0000","last_became_peered":"2023-10-16T08:51:19.495623+0000","last_unstale":"2023-10-16T08:51:23.655380+0000","last_undegraded":"2023-10-16T08:51:23.655380+0000","last_fullsized":"2023-10-16T08:51:23.655380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:50.322181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673307+0000","last_change":"2023-10-16T08:51:18.474818+0000","last_active":"2023-10-16T08:51:23.673307+0000","last_peered":"2023-10-16T08:51:23.673307+0000","last_clean":"2023-10-16T08:51:23.673307+0000","last_became_active":"2023-10-16T08:51:18.473153+0000","last_became_peered":"2023-10-16T08:51:18.473153+0000","last_unstale":"2023-10-16T08:51:23.673307+0000","last_undegraded":"2023-10-16T08:51:23.673307+0000","last_fullsized":"2023-10-16T08:51:23.673307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632414+0000","last_change":"2023-10-16T08:51:23.943636+0000","last_active":"2023-10-16T08:51:24.632414+0000","last_peered":"2023-10-16T08:51:24.632414+0000","last_clean":"2023-10-16T08:51:24.632414+0000","last_became_active":"2023-10-16T08:51:23.943081+0000","last_became_peered":"2023-10-16T08:51:23.943081+0000","last_unstale":"2023-10-16T08:51:24.632414+0000","last_undegraded":"2023-10-16T08:51:24.632414+0000","last_fullsized":"2023-10-16T08:51:24.632414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780507+0000","last_change":"2023-10-16T08:51:23.941536+0000","last_active":"2023-10-16T08:51:24.780507+0000","last_peered":"2023-10-16T08:51:24.780507+0000","last_clean":"2023-10-16T08:51:24.780507+0000","last_became_active":"2023-10-16T08:51:23.940210+0000","last_became_peered":"2023-10-16T08:51:23.940210+0000","last_unstale":"2023-10-16T08:51:24.780507+0000","last_undegraded":"2023-10-16T08:51:24.780507+0000","last_fullsized":"2023-10-16T08:51:24.780507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:20.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676073+0000","last_change":"2023-10-16T08:51:19.492153+0000","last_active":"2023-10-16T08:51:23.676073+0000","last_peered":"2023-10-16T08:51:23.676073+0000","last_clean":"2023-10-16T08:51:23.676073+0000","last_became_active":"2023-10-16T08:51:19.491873+0000","last_became_peered":"2023-10-16T08:51:19.491873+0000","last_unstale":"2023-10-16T08:51:23.676073+0000","last_undegraded":"2023-10-16T08:51:23.676073+0000","last_fullsized":"2023-10-16T08:51:23.676073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:20.049093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656917+0000","last_change":"2023-10-16T08:51:18.470467+0000","last_active":"2023-10-16T08:51:23.656917+0000","last_peered":"2023-10-16T08:51:23.656917+0000","last_clean":"2023-10-16T08:51:23.656917+0000","last_became_active":"2023-10-16T08:51:18.469986+0000","last_became_peered":"2023-10-16T08:51:18.469986+0000","last_unstale":"2023-10-16T08:51:23.656917+0000","last_undegraded":"2023-10-16T08:51:23.656917+0000","last_fullsized":"2023-10-16T08:51:23.656917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:00.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632702+0000","last_change":"2023-10-16T08:51:23.694583+0000","last_active":"2023-10-16T08:51:24.632702+0000","last_peered":"2023-10-16T08:51:24.632702+0000","last_clean":"2023-10-16T08:51:24.632702+0000","last_became_active":"2023-10-16T08:51:23.694186+0000","last_became_peered":"2023-10-16T08:51:23.694186+0000","last_unstale":"2023-10-16T08:51:24.632702+0000","last_undegraded":"2023-10-16T08:51:24.632702+0000","last_fullsized":"2023-10-16T08:51:24.632702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658643+0000","last_change":"2023-10-16T08:51:19.477096+0000","last_active":"2023-10-16T08:51:23.658643+0000","last_peered":"2023-10-16T08:51:23.658643+0000","last_clean":"2023-10-16T08:51:23.658643+0000","last_became_active":"2023-10-16T08:51:19.473590+0000","last_became_peered":"2023-10-16T08:51:19.473590+0000","last_unstale":"2023-10-16T08:51:23.658643+0000","last_undegraded":"2023-10-16T08:51:23.658643+0000","last_fullsized":"2023-10-16T08:51:23.658643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654035+0000","last_change":"2023-10-16T08:51:18.471924+0000","last_active":"2023-10-16T08:51:23.654035+0000","last_peered":"2023-10-16T08:51:23.654035+0000","last_clean":"2023-10-16T08:51:23.654035+0000","last_became_active":"2023-10-16T08:51:18.471592+0000","last_became_peered":"2023-10-16T08:51:18.471592+0000","last_unstale":"2023-10-16T08:51:23.654035+0000","last_undegraded":"2023-10-16T08:51:23.654035+0000","last_fullsized":"2023-10-16T08:51:23.654035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:47:19.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669470+0000","last_change":"2023-10-16T08:51:18.474173+0000","last_active":"2023-10-16T08:51:23.669470+0000","last_peered":"2023-10-16T08:51:23.669470+0000","last_clean":"2023-10-16T08:51:23.669470+0000","last_became_active":"2023-10-16T08:51:18.473185+0000","last_became_peered":"2023-10-16T08:51:18.473185+0000","last_unstale":"2023-10-16T08:51:23.669470+0000","last_undegraded":"2023-10-16T08:51:23.669470+0000","last_fullsized":"2023-10-16T08:51:23.669470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:09:12.237149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663356+0000","last_change":"2023-10-16T08:51:19.488282+0000","last_active":"2023-10-16T08:51:23.663356+0000","last_peered":"2023-10-16T08:51:23.663356+0000","last_clean":"2023-10-16T08:51:23.663356+0000","last_became_active":"2023-10-16T08:51:19.487960+0000","last_became_peered":"2023-10-16T08:51:19.487960+0000","last_unstale":"2023-10-16T08:51:23.663356+0000","last_undegraded":"2023-10-16T08:51:23.663356+0000","last_fullsized":"2023-10-16T08:51:23.663356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002055+0000","last_change":"2023-10-16T08:51:23.689131+0000","last_active":"2023-10-16T08:51:25.002055+0000","last_peered":"2023-10-16T08:51:25.002055+0000","last_clean":"2023-10-16T08:51:25.002055+0000","last_became_active":"2023-10-16T08:51:23.686763+0000","last_became_peered":"2023-10-16T08:51:23.686763+0000","last_unstale":"2023-10-16T08:51:25.002055+0000","last_undegraded":"2023-10-16T08:51:25.002055+0000","last_fullsized":"2023-10-16T08:51:25.002055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:19.111523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:18.475217+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:18.474923+0000","last_became_peered":"2023-10-16T08:51:18.474923+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681558+0000","last_change":"2023-10-16T08:51:19.490076+0000","last_active":"2023-10-16T08:51:23.681558+0000","last_peered":"2023-10-16T08:51:23.681558+0000","last_clean":"2023-10-16T08:51:23.681558+0000","last_became_active":"2023-10-16T08:51:19.489836+0000","last_became_peered":"2023-10-16T08:51:19.489836+0000","last_unstale":"2023-10-16T08:51:23.681558+0000","last_undegraded":"2023-10-16T08:51:23.681558+0000","last_fullsized":"2023-10-16T08:51:23.681558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:01.471157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633844+0000","last_change":"2023-10-16T08:51:23.681986+0000","last_active":"2023-10-16T08:51:24.633844+0000","last_peered":"2023-10-16T08:51:24.633844+0000","last_clean":"2023-10-16T08:51:24.633844+0000","last_became_active":"2023-10-16T08:51:23.681604+0000","last_became_peered":"2023-10-16T08:51:23.681604+0000","last_unstale":"2023-10-16T08:51:24.633844+0000","last_undegraded":"2023-10-16T08:51:24.633844+0000","last_fullsized":"2023-10-16T08:51:24.633844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666407+0000","last_change":"2023-10-16T08:51:19.477397+0000","last_active":"2023-10-16T08:51:23.666407+0000","last_peered":"2023-10-16T08:51:23.666407+0000","last_clean":"2023-10-16T08:51:23.666407+0000","last_became_active":"2023-10-16T08:51:19.476711+0000","last_became_peered":"2023-10-16T08:51:19.476711+0000","last_unstale":"2023-10-16T08:51:23.666407+0000","last_undegraded":"2023-10-16T08:51:23.666407+0000","last_fullsized":"2023-10-16T08:51:23.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:19.481363+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:19.480970+0000","last_became_peered":"2023-10-16T08:51:19.480970+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656160+0000","last_change":"2023-10-16T08:51:19.477774+0000","last_active":"2023-10-16T08:51:23.656160+0000","last_peered":"2023-10-16T08:51:23.656160+0000","last_clean":"2023-10-16T08:51:23.656160+0000","last_became_active":"2023-10-16T08:51:19.475123+0000","last_became_peered":"2023-10-16T08:51:19.475123+0000","last_unstale":"2023-10-16T08:51:23.656160+0000","last_undegraded":"2023-10-16T08:51:23.656160+0000","last_fullsized":"2023-10-16T08:51:23.656160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:28.688010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663346+0000","last_change":"2023-10-16T08:51:19.470555+0000","last_active":"2023-10-16T08:51:23.663346+0000","last_peered":"2023-10-16T08:51:23.663346+0000","last_clean":"2023-10-16T08:51:23.663346+0000","last_became_active":"2023-10-16T08:51:19.470021+0000","last_became_peered":"2023-10-16T08:51:19.470021+0000","last_unstale":"2023-10-16T08:51:23.663346+0000","last_undegraded":"2023-10-16T08:51:23.663346+0000","last_fullsized":"2023-10-16T08:51:23.663346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655354+0000","last_change":"2023-10-16T08:51:19.477990+0000","last_active":"2023-10-16T08:51:23.655354+0000","last_peered":"2023-10-16T08:51:23.655354+0000","last_clean":"2023-10-16T08:51:23.655354+0000","last_became_active":"2023-10-16T08:51:19.477299+0000","last_became_peered":"2023-10-16T08:51:19.477299+0000","last_unstale":"2023-10-16T08:51:23.655354+0000","last_undegraded":"2023-10-16T08:51:23.655354+0000","last_fullsized":"2023-10-16T08:51:23.655354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674606+0000","last_change":"2023-10-16T08:51:19.492134+0000","last_active":"2023-10-16T08:51:23.674606+0000","last_peered":"2023-10-16T08:51:23.674606+0000","last_clean":"2023-10-16T08:51:23.674606+0000","last_became_active":"2023-10-16T08:51:19.491859+0000","last_became_peered":"2023-10-16T08:51:19.491859+0000","last_unstale":"2023-10-16T08:51:23.674606+0000","last_undegraded":"2023-10-16T08:51:23.674606+0000","last_fullsized":"2023-10-16T08:51:23.674606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:50:38.473722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671269+0000","last_change":"2023-10-16T08:51:19.491815+0000","last_active":"2023-10-16T08:51:23.671269+0000","last_peered":"2023-10-16T08:51:23.671269+0000","last_clean":"2023-10-16T08:51:23.671269+0000","last_became_active":"2023-10-16T08:51:19.491422+0000","last_became_peered":"2023-10-16T08:51:19.491422+0000","last_unstale":"2023-10-16T08:51:23.671269+0000","last_undegraded":"2023-10-16T08:51:23.671269+0000","last_fullsized":"2023-10-16T08:51:23.671269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657516+0000","last_change":"2023-10-16T08:51:19.492217+0000","last_active":"2023-10-16T08:51:23.657516+0000","last_peered":"2023-10-16T08:51:23.657516+0000","last_clean":"2023-10-16T08:51:23.657516+0000","last_became_active":"2023-10-16T08:51:19.491892+0000","last_became_peered":"2023-10-16T08:51:19.491892+0000","last_unstale":"2023-10-16T08:51:23.657516+0000","last_undegraded":"2023-10-16T08:51:23.657516+0000","last_fullsized":"2023-10-16T08:51:23.657516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656714+0000","last_change":"2023-10-16T08:51:19.475841+0000","last_active":"2023-10-16T08:51:23.656714+0000","last_peered":"2023-10-16T08:51:23.656714+0000","last_clean":"2023-10-16T08:51:23.656714+0000","last_became_active":"2023-10-16T08:51:19.475196+0000","last_became_peered":"2023-10-16T08:51:19.475196+0000","last_unstale":"2023-10-16T08:51:23.656714+0000","last_undegraded":"2023-10-16T08:51:23.656714+0000","last_fullsized":"2023-10-16T08:51:23.656714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653907+0000","last_change":"2023-10-16T08:51:19.492583+0000","last_active":"2023-10-16T08:51:23.653907+0000","last_peered":"2023-10-16T08:51:23.653907+0000","last_clean":"2023-10-16T08:51:23.653907+0000","last_became_active":"2023-10-16T08:51:19.492322+0000","last_became_peered":"2023-10-16T08:51:19.492322+0000","last_unstale":"2023-10-16T08:51:23.653907+0000","last_undegraded":"2023-10-16T08:51:23.653907+0000","last_fullsized":"2023-10-16T08:51:23.653907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655778+0000","last_change":"2023-10-16T08:51:19.484234+0000","last_active":"2023-10-16T08:51:23.655778+0000","last_peered":"2023-10-16T08:51:23.655778+0000","last_clean":"2023-10-16T08:51:23.655778+0000","last_became_active":"2023-10-16T08:51:19.483921+0000","last_became_peered":"2023-10-16T08:51:19.483921+0000","last_unstale":"2023-10-16T08:51:23.655778+0000","last_undegraded":"2023-10-16T08:51:23.655778+0000","last_fullsized":"2023-10-16T08:51:23.655778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:20.666617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663277+0000","last_change":"2023-10-16T08:51:19.487699+0000","last_active":"2023-10-16T08:51:23.663277+0000","last_peered":"2023-10-16T08:51:23.663277+0000","last_clean":"2023-10-16T08:51:23.663277+0000","last_became_active":"2023-10-16T08:51:19.487423+0000","last_became_peered":"2023-10-16T08:51:19.487423+0000","last_unstale":"2023-10-16T08:51:23.663277+0000","last_undegraded":"2023-10-16T08:51:23.663277+0000","last_fullsized":"2023-10-16T08:51:23.663277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669411+0000","last_change":"2023-10-16T08:51:19.496931+0000","last_active":"2023-10-16T08:51:23.669411+0000","last_peered":"2023-10-16T08:51:23.669411+0000","last_clean":"2023-10-16T08:51:23.669411+0000","last_became_active":"2023-10-16T08:51:19.494302+0000","last_became_peered":"2023-10-16T08:51:19.494302+0000","last_unstale":"2023-10-16T08:51:23.669411+0000","last_undegraded":"2023-10-16T08:51:23.669411+0000","last_fullsized":"2023-10-16T08:51:23.669411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.934841+0000","last_change":"2023-10-16T08:51:19.482651+0000","last_active":"2023-10-16T08:51:23.934841+0000","last_peered":"2023-10-16T08:51:23.934841+0000","last_clean":"2023-10-16T08:51:23.934841+0000","last_became_active":"2023-10-16T08:51:19.482392+0000","last_became_peered":"2023-10-16T08:51:19.482392+0000","last_unstale":"2023-10-16T08:51:23.934841+0000","last_undegraded":"2023-10-16T08:51:23.934841+0000","last_fullsized":"2023-10-16T08:51:23.934841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:50.214064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655880+0000","last_change":"2023-10-16T08:51:19.492889+0000","last_active":"2023-10-16T08:51:23.655880+0000","last_peered":"2023-10-16T08:51:23.655880+0000","last_clean":"2023-10-16T08:51:23.655880+0000","last_became_active":"2023-10-16T08:51:19.492576+0000","last_became_peered":"2023-10-16T08:51:19.492576+0000","last_unstale":"2023-10-16T08:51:23.655880+0000","last_undegraded":"2023-10-16T08:51:23.655880+0000","last_fullsized":"2023-10-16T08:51:23.655880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656813+0000","last_change":"2023-10-16T08:51:19.497299+0000","last_active":"2023-10-16T08:51:23.656813+0000","last_peered":"2023-10-16T08:51:23.656813+0000","last_clean":"2023-10-16T08:51:23.656813+0000","last_became_active":"2023-10-16T08:51:19.495738+0000","last_became_peered":"2023-10-16T08:51:19.495738+0000","last_unstale":"2023-10-16T08:51:23.656813+0000","last_undegraded":"2023-10-16T08:51:23.656813+0000","last_fullsized":"2023-10-16T08:51:23.656813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:01.994879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656466+0000","last_change":"2023-10-16T08:51:19.476970+0000","last_active":"2023-10-16T08:51:23.656466+0000","last_peered":"2023-10-16T08:51:23.656466+0000","last_clean":"2023-10-16T08:51:23.656466+0000","last_became_active":"2023-10-16T08:51:19.475512+0000","last_became_peered":"2023-10-16T08:51:19.475512+0000","last_unstale":"2023-10-16T08:51:23.656466+0000","last_undegraded":"2023-10-16T08:51:23.656466+0000","last_fullsized":"2023-10-16T08:51:23.656466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676171+0000","last_change":"2023-10-16T08:51:19.495546+0000","last_active":"2023-10-16T08:51:23.676171+0000","last_peered":"2023-10-16T08:51:23.676171+0000","last_clean":"2023-10-16T08:51:23.676171+0000","last_became_active":"2023-10-16T08:51:19.495247+0000","last_became_peered":"2023-10-16T08:51:19.495247+0000","last_unstale":"2023-10-16T08:51:23.676171+0000","last_undegraded":"2023-10-16T08:51:23.676171+0000","last_fullsized":"2023-10-16T08:51:23.676171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:20.976839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663138+0000","last_change":"2023-10-16T08:51:19.483501+0000","last_active":"2023-10-16T08:51:23.663138+0000","last_peered":"2023-10-16T08:51:23.663138+0000","last_clean":"2023-10-16T08:51:23.663138+0000","last_became_active":"2023-10-16T08:51:19.482944+0000","last_became_peered":"2023-10-16T08:51:19.482944+0000","last_unstale":"2023-10-16T08:51:23.663138+0000","last_undegraded":"2023-10-16T08:51:23.663138+0000","last_fullsized":"2023-10-16T08:51:23.663138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:53.572062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653847+0000","last_change":"2023-10-16T08:51:19.478486+0000","last_active":"2023-10-16T08:51:23.653847+0000","last_peered":"2023-10-16T08:51:23.653847+0000","last_clean":"2023-10-16T08:51:23.653847+0000","last_became_active":"2023-10-16T08:51:19.478148+0000","last_became_peered":"2023-10-16T08:51:19.478148+0000","last_unstale":"2023-10-16T08:51:23.653847+0000","last_undegraded":"2023-10-16T08:51:23.653847+0000","last_fullsized":"2023-10-16T08:51:23.653847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681778+0000","last_change":"2023-10-16T08:51:19.489601+0000","last_active":"2023-10-16T08:51:23.681778+0000","last_peered":"2023-10-16T08:51:23.681778+0000","last_clean":"2023-10-16T08:51:23.681778+0000","last_became_active":"2023-10-16T08:51:19.489183+0000","last_became_peered":"2023-10-16T08:51:19.489183+0000","last_unstale":"2023-10-16T08:51:23.681778+0000","last_undegraded":"2023-10-16T08:51:23.681778+0000","last_fullsized":"2023-10-16T08:51:23.681778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669156+0000","last_change":"2023-10-16T08:51:19.487335+0000","last_active":"2023-10-16T08:51:23.669156+0000","last_peered":"2023-10-16T08:51:23.669156+0000","last_clean":"2023-10-16T08:51:23.669156+0000","last_became_active":"2023-10-16T08:51:19.487075+0000","last_became_peered":"2023-10-16T08:51:19.487075+0000","last_unstale":"2023-10-16T08:51:23.669156+0000","last_undegraded":"2023-10-16T08:51:23.669156+0000","last_fullsized":"2023-10-16T08:51:23.669156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671049+0000","last_change":"2023-10-16T08:51:19.481528+0000","last_active":"2023-10-16T08:51:23.671049+0000","last_peered":"2023-10-16T08:51:23.671049+0000","last_clean":"2023-10-16T08:51:23.671049+0000","last_became_active":"2023-10-16T08:51:19.481200+0000","last_became_peered":"2023-10-16T08:51:19.481200+0000","last_unstale":"2023-10-16T08:51:23.671049+0000","last_undegraded":"2023-10-16T08:51:23.671049+0000","last_fullsized":"2023-10-16T08:51:23.671049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933808+0000","last_change":"2023-10-16T08:51:19.485179+0000","last_active":"2023-10-16T08:51:23.933808+0000","last_peered":"2023-10-16T08:51:23.933808+0000","last_clean":"2023-10-16T08:51:23.933808+0000","last_became_active":"2023-10-16T08:51:19.484475+0000","last_became_peered":"2023-10-16T08:51:19.484475+0000","last_unstale":"2023-10-16T08:51:23.933808+0000","last_undegraded":"2023-10-16T08:51:23.933808+0000","last_fullsized":"2023-10-16T08:51:23.933808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:26.362066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656954+0000","last_change":"2023-10-16T08:51:19.489098+0000","last_active":"2023-10-16T08:51:23.656954+0000","last_peered":"2023-10-16T08:51:23.656954+0000","last_clean":"2023-10-16T08:51:23.656954+0000","last_became_active":"2023-10-16T08:51:19.488810+0000","last_became_peered":"2023-10-16T08:51:19.488810+0000","last_unstale":"2023-10-16T08:51:23.656954+0000","last_undegraded":"2023-10-16T08:51:23.656954+0000","last_fullsized":"2023-10-16T08:51:23.656954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927711+0000","last_change":"2023-10-16T08:51:19.481280+0000","last_active":"2023-10-16T08:51:23.927711+0000","last_peered":"2023-10-16T08:51:23.927711+0000","last_clean":"2023-10-16T08:51:23.927711+0000","last_became_active":"2023-10-16T08:51:19.480918+0000","last_became_peered":"2023-10-16T08:51:19.480918+0000","last_unstale":"2023-10-16T08:51:23.927711+0000","last_undegraded":"2023-10-16T08:51:23.927711+0000","last_fullsized":"2023-10-16T08:51:23.927711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:27.239511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655534+0000","last_change":"2023-10-16T08:51:19.477823+0000","last_active":"2023-10-16T08:51:23.655534+0000","last_peered":"2023-10-16T08:51:23.655534+0000","last_clean":"2023-10-16T08:51:23.655534+0000","last_became_active":"2023-10-16T08:51:19.477234+0000","last_became_peered":"2023-10-16T08:51:19.477234+0000","last_unstale":"2023-10-16T08:51:23.655534+0000","last_undegraded":"2023-10-16T08:51:23.655534+0000","last_fullsized":"2023-10-16T08:51:23.655534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928445+0000","last_change":"2023-10-16T08:51:19.489820+0000","last_active":"2023-10-16T08:51:23.928445+0000","last_peered":"2023-10-16T08:51:23.928445+0000","last_clean":"2023-10-16T08:51:23.928445+0000","last_became_active":"2023-10-16T08:51:19.489507+0000","last_became_peered":"2023-10-16T08:51:19.489507+0000","last_unstale":"2023-10-16T08:51:23.928445+0000","last_undegraded":"2023-10-16T08:51:23.928445+0000","last_fullsized":"2023-10-16T08:51:23.928445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:08.297922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655383+0000","last_change":"2023-10-16T08:51:19.500564+0000","last_active":"2023-10-16T08:51:23.655383+0000","last_peered":"2023-10-16T08:51:23.655383+0000","last_clean":"2023-10-16T08:51:23.655383+0000","last_became_active":"2023-10-16T08:51:19.500259+0000","last_became_peered":"2023-10-16T08:51:19.500259+0000","last_unstale":"2023-10-16T08:51:23.655383+0000","last_undegraded":"2023-10-16T08:51:23.655383+0000","last_fullsized":"2023-10-16T08:51:23.655383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.662732+0000","last_change":"2023-10-16T08:51:19.475776+0000","last_active":"2023-10-16T08:51:23.662732+0000","last_peered":"2023-10-16T08:51:23.662732+0000","last_clean":"2023-10-16T08:51:23.662732+0000","last_became_active":"2023-10-16T08:51:19.475490+0000","last_became_peered":"2023-10-16T08:51:19.475490+0000","last_unstale":"2023-10-16T08:51:23.662732+0000","last_undegraded":"2023-10-16T08:51:23.662732+0000","last_fullsized":"2023-10-16T08:51:23.662732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681106+0000","last_change":"2023-10-16T08:51:19.478163+0000","last_active":"2023-10-16T08:51:23.681106+0000","last_peered":"2023-10-16T08:51:23.681106+0000","last_clean":"2023-10-16T08:51:23.681106+0000","last_became_active":"2023-10-16T08:51:19.477845+0000","last_became_peered":"2023-10-16T08:51:19.477845+0000","last_unstale":"2023-10-16T08:51:23.681106+0000","last_undegraded":"2023-10-16T08:51:23.681106+0000","last_fullsized":"2023-10-16T08:51:23.681106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:11.984655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933468+0000","last_change":"2023-10-16T08:51:19.484764+0000","last_active":"2023-10-16T08:51:23.933468+0000","last_peered":"2023-10-16T08:51:23.933468+0000","last_clean":"2023-10-16T08:51:23.933468+0000","last_became_active":"2023-10-16T08:51:19.480771+0000","last_became_peered":"2023-10-16T08:51:19.480771+0000","last_unstale":"2023-10-16T08:51:23.933468+0000","last_undegraded":"2023-10-16T08:51:23.933468+0000","last_fullsized":"2023-10-16T08:51:23.933468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:34.680318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":697914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":106964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":107124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":697970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T08:51:48.585 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T08:51:48.585 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T08:51:48.586 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T08:51:48.586 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T08:51:48.587 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T08:51:48.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.832+0000 7f56192af640 1 Processor -- start 2023-10-16T08:51:48.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.832+0000 7f56192af640 1 -- start start 2023-10-16T08:51:48.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56192af640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f56140c9e00 0x7f56140c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56192af640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5614071c10 con 0x7f5614071800 2023-10-16T08:51:48.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56192af640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5614071e40 con 0x7f56140ca1e0 2023-10-16T08:51:48.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56192af640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140cde00 con 0x7f56140c9e00 2023-10-16T08:51:48.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56137fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5614071800 0x7f56140cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50820/0 (socket says 172.21.15.94:50820) 2023-10-16T08:51:48.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56137fe640 1 -- 172.21.15.94:0/3155711720 learned_addr learned my addr 172.21.15.94:0/3155711720 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:48.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f5612ffd640 1 --2- 172.21.15.94:0/3155711720 >> v2:172.21.15.130:3300/0 conn(0x7f56140c9e00 0x7f56140c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624438223 0 0) 0x7f5614071c10 con 0x7f5614071800 2023-10-16T08:51:48.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.834+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5600005730 con 0x7f5614071800 2023-10-16T08:51:48.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832367543 0 0) 0x7f5600005730 con 0x7f5614071800 2023-10-16T08:51:48.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 >> v2:172.21.15.130:3300/0 conn(0x7f56140c9e00 msgr2=0x7f56140c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:48.839 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 --2- 172.21.15.94:0/3155711720 >> v2:172.21.15.130:3300/0 conn(0x7f56140c9e00 0x7f56140c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 >> v1:172.21.15.130:6789/0 conn(0x7f56140ca1e0 legacy=0x7f56140710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:48.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614072120 con 0x7f5614071800 2023-10-16T08:51:48.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f560c0019f0 con 0x7f5614071800 2023-10-16T08:51:48.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 >> v1:172.21.15.94:6789/0 conn(0x7f5614071800 legacy=0x7f56140cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5600005c40 0x7f5600006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56000069d0 0x7f5600006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5600007390 0x7f560000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140cde00 con 0x7f56000069d0 2023-10-16T08:51:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560000e330 con 0x7f5600005c40 2023-10-16T08:51:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560000e4f0 con 0x7f5600007390 2023-10-16T08:51:48.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f560bfff640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56000069d0 0x7f5600006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.835+0000 7f5612ffd640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5600005c40 0x7f5600006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f56137fe640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5600007390 0x7f560000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f560bfff640 1 -- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5600007390 msgr2=0x7f560000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:48.842 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f560bfff640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5600007390 0x7f560000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f560bfff640 1 -- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5600005c40 msgr2=0x7f5600006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:48.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f560bfff640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5600005c40 0x7f5600006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f560bfff640 1 -- 172.21.15.94:0/3155711720 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600005730 con 0x7f56000069d0 2023-10-16T08:51:48.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.836+0000 7f56137fe640 1 -- 172.21.15.94:0/3155711720 reap_dead start 2023-10-16T08:51:48.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.837+0000 7f560bfff640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56000069d0 0x7f5600006e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55fc003db0 tx=0x7f5600007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d12f8bb1cc74c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.837+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc032600 con 0x7f56000069d0 2023-10-16T08:51:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.837+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc02e050 con 0x7f56000069d0 2023-10-16T08:51:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.837+0000 7f56127fc640 1 -- 172.21.15.94:0/3155711720 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0329e0 con 0x7f56000069d0 2023-10-16T08:51:48.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 -- 172.21.15.94:0/3155711720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56000069d0 msgr2=0x7f5600006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56000069d0 0x7f5600006e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55fc003db0 tx=0x7f5600007a00 comp rx=0 tx=0).stop 2023-10-16T08:51:48.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 -- 172.21.15.94:0/3155711720 shutdown_connections 2023-10-16T08:51:48.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 --2- 172.21.15.94:0/3155711720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56000069d0 0x7f5600006e50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 -- 172.21.15.94:0/3155711720 >> 172.21.15.94:0/3155711720 conn(0x7f561406c1c0 msgr2=0x7f561406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:48.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 -- 172.21.15.94:0/3155711720 shutdown_connections 2023-10-16T08:51:48.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.838+0000 7f56192af640 1 -- 172.21.15.94:0/3155711720 wait complete. 2023-10-16T08:51:48.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.840+0000 7f56192af640 1 Processor -- start 2023-10-16T08:51:48.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.840+0000 7f56192af640 1 -- start start 2023-10-16T08:51:48.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56192af640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56000069d0 0x7f5614150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56192af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56140c7830 0x7f56140c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56192af640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 0x7f5614155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56192af640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614156420 con 0x7f5614155a60 2023-10-16T08:51:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56192af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141538c0 con 0x7f56140c7830 2023-10-16T08:51:48.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56192af640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140c82f0 con 0x7f56000069d0 2023-10-16T08:51:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 0x7f5614155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 0x7f5614155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56844/0 (socket says 172.21.15.94:56844) 2023-10-16T08:51:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 -- 172.21.15.94:0/3556244143 learned_addr learned my addr 172.21.15.94:0/3556244143 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 -- 172.21.15.94:0/3556244143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56000069d0 msgr2=0x7f5614150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56000069d0 0x7f5614150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 -- 172.21.15.94:0/3556244143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56140c7830 msgr2=0x7f56140c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:48.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56140c7830 0x7f56140c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:48.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.841+0000 7f56137fe640 1 -- 172.21.15.94:0/3556244143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56141506c0 con 0x7f5614155a60 2023-10-16T08:51:48.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.842+0000 7f56137fe640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 0x7f5614155ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f560c0013d0 tx=0x7f560c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:48.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.842+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c00ab30 con 0x7f5614155a60 2023-10-16T08:51:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.842+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c00acb0 con 0x7f5614155a60 2023-10-16T08:51:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.842+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c013630 con 0x7f5614155a60 2023-10-16T08:51:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.842+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614152f90 con 0x7f5614155a60 2023-10-16T08:51:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.842+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5614153550 con 0x7f5614155a60 2023-10-16T08:51:48.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.843+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56140715d0 con 0x7f5614155a60 2023-10-16T08:51:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.844+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f560c013790 con 0x7f5614155a60 2023-10-16T08:51:48.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.845+0000 7f560b7fe640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f55f406ae70 0x7f55f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.845+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f560c08a060 con 0x7f5614155a60 2023-10-16T08:51:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.845+0000 7f5612ffd640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f55f406ae70 0x7f55f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:48.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.846+0000 7f5612ffd640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f55f406ae70 0x7f55f406d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5604006b10 tx=0x7f5604006aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:48.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:48.850+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f560c054d80 con 0x7f5614155a60 2023-10-16T08:51:49.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.088+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5614073ef0 con 0x7f5614155a60 2023-10-16T08:51:49.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.096+0000 7f560b7fe640 1 -- 172.21.15.94:0/3556244143 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171029 (secure 0 0 0) 0x7f560c0583a0 con 0x7f5614155a60 2023-10-16T08:51:49.101 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:49.102 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.100+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f55f406ae70 msgr2=0x7f55f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.100+0000 7f56192af640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f55f406ae70 0x7f55f406d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5604006b10 tx=0x7f5604006aa0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.100+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 msgr2=0x7f5614155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.100+0000 7f56192af640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 0x7f5614155ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f560c0013d0 tx=0x7f560c007bd0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 shutdown_connections 2023-10-16T08:51:49.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5614155a60 0x7f5614155ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f55f406ae70 0x7f55f406d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56140c7830 0x7f56140c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 --2- 172.21.15.94:0/3556244143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56000069d0 0x7f5614150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 >> 172.21.15.94:0/3556244143 conn(0x7f561406c1c0 msgr2=0x7f56140af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:49.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 shutdown_connections 2023-10-16T08:51:49.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.101+0000 7f56192af640 1 -- 172.21.15.94:0/3556244143 wait complete. 2023-10-16T08:51:49.121 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2208206022},{"type":"v1","addr":"172.21.15.94:6833","nonce":2208206022}]},"active_addr":"172.21.15.94:6833/2208206022","active_change":"2023-10-16T08:50:59.797151+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":744706881}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":1565464340}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":1786206776}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":1885770873}]}]} 2023-10-16T08:51:49.125 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T08:51:49.126 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T08:51:49.126 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:49.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.331+0000 7f7d7d875640 1 Processor -- start 2023-10-16T08:51:49.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.331+0000 7f7d7d875640 1 -- start start 2023-10-16T08:51:49.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.333+0000 7f7d7d875640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d7815cd10 0x7f7d780d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.333+0000 7f7d7d875640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d781617d0 con 0x7f7d781611b0 2023-10-16T08:51:49.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.333+0000 7f7d7d875640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780d0c30 con 0x7f7d780cd9b0 2023-10-16T08:51:49.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.333+0000 7f7d7d875640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d781615c0 con 0x7f7d7815cd10 2023-10-16T08:51:49.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.333+0000 7f7d777fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f7d781611b0 0x7f7d780b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50830/0 (socket says 172.21.15.94:50830) 2023-10-16T08:51:49.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.333+0000 7f7d777fe640 1 -- 172.21.15.94:0/1195461694 learned_addr learned my addr 172.21.15.94:0/1195461694 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:49.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.334+0000 7f7d76ffd640 1 --2- 172.21.15.94:0/1195461694 >> v2:172.21.15.94:3300/0 conn(0x7f7d7815cd10 0x7f7d780d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.334+0000 7f7d767fc640 1 -- 172.21.15.94:0/1195461694 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145008636 0 0) 0x7f7d781617d0 con 0x7f7d781611b0 2023-10-16T08:51:49.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.334+0000 7f7d767fc640 1 -- 172.21.15.94:0/1195461694 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d64003520 con 0x7f7d781611b0 2023-10-16T08:51:49.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.334+0000 7f7d76ffd640 1 -- 172.21.15.94:0/1195461694 >> v1:172.21.15.130:6789/0 conn(0x7f7d780cd9b0 legacy=0x7f7d78160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.334+0000 7f7d76ffd640 1 -- 172.21.15.94:0/1195461694 >> v1:172.21.15.94:6789/0 conn(0x7f7d781611b0 legacy=0x7f7d780b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.334+0000 7f7d76ffd640 1 -- 172.21.15.94:0/1195461694 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780d0f10 con 0x7f7d7815cd10 2023-10-16T08:51:49.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.336+0000 7f7d76ffd640 1 --2- 172.21.15.94:0/1195461694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780d19f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d680097a0 tx=0x7f7d6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f333864baaa13fec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:49.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.336+0000 7f7d767fc640 1 -- 172.21.15.94:0/1195461694 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68031830 con 0x7f7d7815cd10 2023-10-16T08:51:49.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.336+0000 7f7d767fc640 1 -- 172.21.15.94:0/1195461694 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d68031990 con 0x7f7d7815cd10 2023-10-16T08:51:49.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.336+0000 7f7d767fc640 1 -- 172.21.15.94:0/1195461694 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68031d20 con 0x7f7d7815cd10 2023-10-16T08:51:49.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.336+0000 7f7d7d875640 1 -- 172.21.15.94:0/1195461694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 msgr2=0x7f7d780d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.336+0000 7f7d7d875640 1 --2- 172.21.15.94:0/1195461694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780d19f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d680097a0 tx=0x7f7d6802b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.337+0000 7f7d7d875640 1 -- 172.21.15.94:0/1195461694 shutdown_connections 2023-10-16T08:51:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.337+0000 7f7d7d875640 1 --2- 172.21.15.94:0/1195461694 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780d19f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.337+0000 7f7d7d875640 1 -- 172.21.15.94:0/1195461694 >> 172.21.15.94:0/1195461694 conn(0x7f7d780b44a0 msgr2=0x7f7d780b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:49.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.337+0000 7f7d7d875640 1 -- 172.21.15.94:0/1195461694 shutdown_connections 2023-10-16T08:51:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.337+0000 7f7d7d875640 1 -- 172.21.15.94:0/1195461694 wait complete. 2023-10-16T08:51:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.338+0000 7f7d7d875640 1 Processor -- start 2023-10-16T08:51:49.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.338+0000 7f7d7d875640 1 -- start start 2023-10-16T08:51:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.339+0000 7f7d7d875640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d780cd9b0 0x7f7d78145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.339+0000 7f7d7d875640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.339+0000 7f7d7d875640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d781611b0 0x7f7d78142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.339+0000 7f7d7d875640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781f6ae0 con 0x7f7d7815cd10 2023-10-16T08:51:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.339+0000 7f7d7d875640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c5a20 con 0x7f7d780cd9b0 2023-10-16T08:51:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.339+0000 7f7d7d875640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78142b40 con 0x7f7d781611b0 2023-10-16T08:51:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56856/0 (socket says 172.21.15.94:56856) 2023-10-16T08:51:49.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 -- 172.21.15.94:0/3901504524 learned_addr learned my addr 172.21.15.94:0/3901504524 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d76ffd640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d780cd9b0 0x7f7d78145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 -- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d781611b0 msgr2=0x7f7d78142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d781611b0 0x7f7d78142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 -- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d780cd9b0 msgr2=0x7f7d78145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d780cd9b0 0x7f7d78145d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 -- 172.21.15.94:0/3901504524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68009400 con 0x7f7d7815cd10 2023-10-16T08:51:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.340+0000 7f7d6ffff640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780c54e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c480 tx=0x7f7d6000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.341+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d600052d0 con 0x7f7d7815cd10 2023-10-16T08:51:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.341+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60005430 con 0x7f7d7815cd10 2023-10-16T08:51:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.341+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60012870 con 0x7f7d7815cd10 2023-10-16T08:51:49.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.341+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d781f5e60 con 0x7f7d7815cd10 2023-10-16T08:51:49.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.341+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d781f6420 con 0x7f7d7815cd10 2023-10-16T08:51:49.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.342+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78073ef0 con 0x7f7d7815cd10 2023-10-16T08:51:49.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.343+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7d600129d0 con 0x7f7d7815cd10 2023-10-16T08:51:49.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.344+0000 7f7d74ff9640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d5806ae70 0x7f7d5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.344+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d600894d0 con 0x7f7d7815cd10 2023-10-16T08:51:49.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.344+0000 7f7d76ffd640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d5806ae70 0x7f7d5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.345+0000 7f7d76ffd640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d5806ae70 0x7f7d5806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d68036000 tx=0x7f7d68008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:49.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.348+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d60054280 con 0x7f7d7815cd10 2023-10-16T08:51:49.540 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.538+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d780d08e0 con 0x7f7d7815cd10 2023-10-16T08:51:49.543 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.541+0000 7f7d74ff9640 1 -- 172.21.15.94:0/3901504524 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f7d600578a0 con 0x7f7d7815cd10 2023-10-16T08:51:49.543 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:49.544 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:49.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d5806ae70 msgr2=0x7f7d5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d5806ae70 0x7f7d5806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d68036000 tx=0x7f7d68008030 comp rx=0 tx=0).stop 2023-10-16T08:51:49.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 msgr2=0x7f7d780c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780c54e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c480 tx=0x7f7d6000c940 comp rx=0 tx=0).stop 2023-10-16T08:51:49.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 shutdown_connections 2023-10-16T08:51:49.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d781611b0 0x7f7d78142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d7815cd10 0x7f7d780c54e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d5806ae70 0x7f7d5806d330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.547 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 --2- 172.21.15.94:0/3901504524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d780cd9b0 0x7f7d78145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.543+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 >> 172.21.15.94:0/3901504524 conn(0x7f7d780b44a0 msgr2=0x7f7d7815bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:49.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.544+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 shutdown_connections 2023-10-16T08:51:49.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.544+0000 7f7d7d875640 1 -- 172.21.15.94:0/3901504524 wait complete. 2023-10-16T08:51:49.565 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T08:51:49.566 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:49.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.770+0000 7f8e755f0640 1 Processor -- start 2023-10-16T08:51:49.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.770+0000 7f8e755f0640 1 -- start start 2023-10-16T08:51:49.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.771+0000 7f8e755f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e700701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.771+0000 7f8e755f0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8e7015ad00 0x7f8e7015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e755f0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7015f580 con 0x7f8e700b03f0 2023-10-16T08:51:49.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e755f0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e700707f0 con 0x7f8e7015ad00 2023-10-16T08:51:49.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e755f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70070ad0 con 0x7f8e700b0010 2023-10-16T08:51:49.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8e7015ad00 0x7f8e7015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8e7015ad00 0x7f8e7015f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56860/0 (socket says 172.21.15.94:56860) 2023-10-16T08:51:49.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 -- 172.21.15.94:0/3922655428 learned_addr learned my addr 172.21.15.94:0/3922655428 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:49.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8e700b03f0 0x7f8e7015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50846/0 (socket says 172.21.15.94:50846) 2023-10-16T08:51:49.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 -- 172.21.15.94:0/3922655428 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 msgr2=0x7f8e700701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:49.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6effd640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e700701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6dffb640 1 -- 172.21.15.94:0/3922655428 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253766225 0 0) 0x7f8e68001490 con 0x7f8e700b03f0 2023-10-16T08:51:49.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e700701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 -- 172.21.15.94:0/3922655428 >> v1:172.21.15.94:6789/0 conn(0x7f8e700b03f0 legacy=0x7f8e7015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6e7fc640 1 -- 172.21.15.94:0/3922655428 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7015b1d0 con 0x7f8e7015ad00 2023-10-16T08:51:49.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.772+0000 7f8e6effd640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e700701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:49.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.773+0000 7f8e6e7fc640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e7015f040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009870 tx=0x7f8e6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d8969087a93551 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:49.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e6dffb640 1 -- 172.21.15.94:0/3922655428 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64030840 con 0x7f8e7015ad00 2023-10-16T08:51:49.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e6dffb640 1 -- 172.21.15.94:0/3922655428 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e640309a0 con 0x7f8e7015ad00 2023-10-16T08:51:49.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e6dffb640 1 -- 172.21.15.94:0/3922655428 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64030d30 con 0x7f8e7015ad00 2023-10-16T08:51:49.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 -- 172.21.15.94:0/3922655428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 msgr2=0x7f8e7015f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e7015f040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009870 tx=0x7f8e6402b980 comp rx=0 tx=0).stop 2023-10-16T08:51:49.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 -- 172.21.15.94:0/3922655428 shutdown_connections 2023-10-16T08:51:49.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e7015f040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 --2- 172.21.15.94:0/3922655428 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e700701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 -- 172.21.15.94:0/3922655428 >> 172.21.15.94:0/3922655428 conn(0x7f8e7006c1c0 msgr2=0x7f8e7006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:49.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 -- 172.21.15.94:0/3922655428 shutdown_connections 2023-10-16T08:51:49.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.774+0000 7f8e755f0640 1 -- 172.21.15.94:0/3922655428 wait complete. 2023-10-16T08:51:49.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.776+0000 7f8e755f0640 1 Processor -- start 2023-10-16T08:51:49.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.776+0000 7f8e755f0640 1 -- start start 2023-10-16T08:51:49.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e755f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e7015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e755f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e700b03f0 0x7f8e70152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e755f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e700c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e755f0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700c2f10 con 0x7f8e7015ad00 2023-10-16T08:51:49.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e755f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701533a0 con 0x7f8e700b03f0 2023-10-16T08:51:49.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e755f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700c2c30 con 0x7f8e700b0010 2023-10-16T08:51:49.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e6f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e700c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e6f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e700c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56862/0 (socket says 172.21.15.94:56862) 2023-10-16T08:51:49.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.777+0000 7f8e6f7fe640 1 -- 172.21.15.94:0/1098684153 learned_addr learned my addr 172.21.15.94:0/1098684153 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:49.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6effd640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e7015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6e7fc640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e700b03f0 0x7f8e70152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6f7fe640 1 -- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 msgr2=0x7f8e7015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6f7fe640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e7015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6f7fe640 1 -- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e700b03f0 msgr2=0x7f8e70152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6f7fe640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e700b03f0 0x7f8e70152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6f7fe640 1 -- 172.21.15.94:0/1098684153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e640094d0 con 0x7f8e7015ad00 2023-10-16T08:51:49.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e6f7fe640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e700c20c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c7f0 tx=0x7f8e6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:49.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800a5e0 con 0x7f8e7015ad00 2023-10-16T08:51:49.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6800a760 con 0x7f8e7015ad00 2023-10-16T08:51:49.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.778+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7015dc60 con 0x7f8e7015ad00 2023-10-16T08:51:49.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.779+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800ab50 con 0x7f8e7015ad00 2023-10-16T08:51:49.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.779+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7015e220 con 0x7f8e7015ad00 2023-10-16T08:51:49.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.780+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e70073ef0 con 0x7f8e7015ad00 2023-10-16T08:51:49.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.781+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8e6800acb0 con 0x7f8e7015ad00 2023-10-16T08:51:49.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.782+0000 7f8e577fe640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8e5c06ae70 0x7f8e5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:49.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.782+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e68088ed0 con 0x7f8e7015ad00 2023-10-16T08:51:49.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.782+0000 7f8e6effd640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8e5c06ae70 0x7f8e5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:49.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.783+0000 7f8e6effd640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8e5c06ae70 0x7f8e5c06d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000a990 tx=0x7f8e60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:49.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.787+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e68053d20 con 0x7f8e7015ad00 2023-10-16T08:51:49.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.980+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e7015f580 con 0x7f8e7015ad00 2023-10-16T08:51:49.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.981+0000 7f8e577fe640 1 -- 172.21.15.94:0/1098684153 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f8e7015f580 con 0x7f8e7015ad00 2023-10-16T08:51:49.984 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:49.984 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:49.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8e5c06ae70 msgr2=0x7f8e5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8e5c06ae70 0x7f8e5c06d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000a990 tx=0x7f8e60008040 comp rx=0 tx=0).stop 2023-10-16T08:51:49.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 msgr2=0x7f8e700c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:49.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e700c20c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800c7f0 tx=0x7f8e6800ccb0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 shutdown_connections 2023-10-16T08:51:49.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e7015ad00 0x7f8e700c20c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8e5c06ae70 0x7f8e5c06d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e700b03f0 0x7f8e70152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 --2- 172.21.15.94:0/1098684153 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e700b0010 0x7f8e7015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:49.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 >> 172.21.15.94:0/1098684153 conn(0x7f8e7006c1c0 msgr2=0x7f8e7006c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:49.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 shutdown_connections 2023-10-16T08:51:49.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:49.984+0000 7f8e755f0640 1 -- 172.21.15.94:0/1098684153 wait complete. 2023-10-16T08:51:50.004 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T08:51:50.004 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T08:51:50.005 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T08:51:50.005 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T08:51:50.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T08:51:50.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T08:51:50.007 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T08:51:50.007 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T08:51:50.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.309+0000 7f92bfef2640 1 Processor -- start 2023-10-16T08:51:50.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.310+0000 7f92bfef2640 1 -- start start 2023-10-16T08:51:50.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.311+0000 7f89279f5640 1 Processor -- start 2023-10-16T08:51:50.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.311+0000 7f89279f5640 1 -- start start 2023-10-16T08:51:50.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.311+0000 7f92bfef2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92b80c9e10 0x7f92b80c1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.311+0000 7f92bfef2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92b80c18c0 0x7f92b80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.311+0000 7f92bfef2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80c9980 con 0x7f92b8160f40 2023-10-16T08:51:50.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.311+0000 7f92bfef2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b80c1cf0 con 0x7f92b80c18c0 2023-10-16T08:51:50.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.312+0000 7f92bfef2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b80ca2a0 con 0x7f92b80c9e10 2023-10-16T08:51:50.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.312+0000 7f92bd48d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92b80c9e10 0x7f92b80c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.312+0000 7f92bd48d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92b80c9e10 0x7f92b80c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58038/0 (socket says 172.21.15.94:58038) 2023-10-16T08:51:50.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.313+0000 7f92bd48d640 1 -- 172.21.15.94:0/1923882450 learned_addr learned my addr 172.21.15.94:0/1923882450 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.313+0000 7f92be48f640 1 --2- 172.21.15.94:0/1923882450 >> v2:172.21.15.94:3300/0 conn(0x7f92b80c18c0 0x7f92b80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.314+0000 7f92bd48d640 1 -- 172.21.15.94:0/1923882450 >> v2:172.21.15.94:3300/0 conn(0x7f92b80c18c0 msgr2=0x7f92b80b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.314+0000 7f92bd48d640 1 --2- 172.21.15.94:0/1923882450 >> v2:172.21.15.94:3300/0 conn(0x7f92b80c18c0 0x7f92b80b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.314+0000 7f92bd48d640 1 -- 172.21.15.94:0/1923882450 >> v1:172.21.15.94:6789/0 conn(0x7f92b8160f40 legacy=0x7f92b80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.314+0000 7f92bd48d640 1 -- 172.21.15.94:0/1923882450 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80c8d70 con 0x7f92b80c9e10 2023-10-16T08:51:50.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.314+0000 7f92be48f640 1 --2- 172.21.15.94:0/1923882450 >> v2:172.21.15.94:3300/0 conn(0x7f92b80c18c0 0x7f92b80b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:50.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.316+0000 7f89279f5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f89180382c0 0x7f891803c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.316+0000 7f89279f5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8918053cf0 0x7f8918054160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f89279f5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8918057200 con 0x7f89180e64b0 2023-10-16T08:51:50.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f89279f5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89180546a0 con 0x7f8918053cf0 2023-10-16T08:51:50.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f89279f5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89180574a0 con 0x7f89180382c0 2023-10-16T08:51:50.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f8925791640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f89180e64b0 0x7f891803e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:59338/0 (socket says 172.21.15.94:59338) 2023-10-16T08:51:50.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f8925791640 1 -- 172.21.15.94:0/1330673180 learned_addr learned my addr 172.21.15.94:0/1330673180 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f8924f90640 1 --2- 172.21.15.94:0/1330673180 >> v2:172.21.15.130:3300/0 conn(0x7f89180382c0 0x7f891803c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f8925f92640 1 --2- 172.21.15.94:0/1330673180 >> v2:172.21.15.94:3300/0 conn(0x7f8918053cf0 0x7f8918054160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f8917fff640 1 -- 172.21.15.94:0/1330673180 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341035091 0 0) 0x7f8918057200 con 0x7f89180e64b0 2023-10-16T08:51:50.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f8917fff640 1 -- 172.21.15.94:0/1330673180 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890c003520 con 0x7f89180e64b0 2023-10-16T08:51:50.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f8925f92640 1 -- 172.21.15.94:0/1330673180 >> v2:172.21.15.130:3300/0 conn(0x7f89180382c0 msgr2=0x7f891803c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f8925f92640 1 --2- 172.21.15.94:0/1330673180 >> v2:172.21.15.130:3300/0 conn(0x7f89180382c0 0x7f891803c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f8925f92640 1 -- 172.21.15.94:0/1330673180 >> v1:172.21.15.130:6789/0 conn(0x7f89180e64b0 legacy=0x7f891803e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f8925f92640 1 -- 172.21.15.94:0/1330673180 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918057780 con 0x7f8918053cf0 2023-10-16T08:51:50.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7fa046059640 1 Processor -- start 2023-10-16T08:51:50.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7fa046059640 1 -- start start 2023-10-16T08:51:50.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.317+0000 7f92bd48d640 1 --2- 172.21.15.94:0/1923882450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 0x7f92b80c1380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92b8164860 tx=0x7f92b402bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c0514807332714 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f92bcc8c640 1 -- 172.21.15.94:0/1923882450 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b402cb10 con 0x7f92b80c9e10 2023-10-16T08:51:50.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f92bcc8c640 1 -- 172.21.15.94:0/1923882450 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b402cc70 con 0x7f92b80c9e10 2023-10-16T08:51:50.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.318+0000 7f92bcc8c640 1 -- 172.21.15.94:0/1923882450 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40343f0 con 0x7f92b80c9e10 2023-10-16T08:51:50.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.319+0000 7f8acb439640 1 Processor -- start 2023-10-16T08:51:50.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.319+0000 7f92bfef2640 1 -- 172.21.15.94:0/1923882450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 msgr2=0x7f92b80c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.319+0000 7f92bfef2640 1 --2- 172.21.15.94:0/1923882450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 0x7f92b80c1380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92b8164860 tx=0x7f92b402bf70 comp rx=0 tx=0).stop 2023-10-16T08:51:50.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f92bfef2640 1 -- 172.21.15.94:0/1923882450 shutdown_connections 2023-10-16T08:51:50.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f92bfef2640 1 --2- 172.21.15.94:0/1923882450 >> v2:172.21.15.94:3300/0 conn(0x7f92b80c18c0 0x7f92b80b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f92bfef2640 1 --2- 172.21.15.94:0/1923882450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 0x7f92b80c1380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f92bfef2640 1 -- 172.21.15.94:0/1923882450 >> 172.21.15.94:0/1923882450 conn(0x7f92b8071400 msgr2=0x7f92b8071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f92bfef2640 1 -- 172.21.15.94:0/1923882450 shutdown_connections 2023-10-16T08:51:50.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7fa046059640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0400cb490 0x7fa0401590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7fa046059640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa04015d320 0x7fa040159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7fa046059640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04015c5f0 con 0x7fa0401564d0 2023-10-16T08:51:50.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7fa046059640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0400714a0 con 0x7fa0400cb490 2023-10-16T08:51:50.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7fa046059640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa040159e50 con 0x7fa04015d320 2023-10-16T08:51:50.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f92bfef2640 1 -- 172.21.15.94:0/1923882450 wait complete. 2023-10-16T08:51:50.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.320+0000 7f8925f92640 1 --2- 172.21.15.94:0/1330673180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8918053cf0 0x7f8918054160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8918053830 tx=0x7f891c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac226aa9de8a90e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7f8917fff640 1 -- 172.21.15.94:0/1330673180 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c031830 con 0x7f8918053cf0 2023-10-16T08:51:50.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.319+0000 7f8acb439640 1 -- start start 2023-10-16T08:51:50.331 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7f8917fff640 1 -- 172.21.15.94:0/1330673180 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c031990 con 0x7f8918053cf0 2023-10-16T08:51:50.331 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7f8acb439640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8abc054360 0x7f8abc0eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7f8acb439640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc03c070 con 0x7f8abc006b70 2023-10-16T08:51:50.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7f8acb439640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc0070f0 con 0x7f8abc0e3070 2023-10-16T08:51:50.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7f8acb439640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc0073b0 con 0x7f8abc054360 2023-10-16T08:51:50.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7f8ac89d4640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8abc006b70 0x7f8abc053c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50876/0 (socket says 172.21.15.94:50876) 2023-10-16T08:51:50.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7f8ac89d4640 1 -- 172.21.15.94:0/1780317043 learned_addr learned my addr 172.21.15.94:0/1780317043 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7f8ac91d5640 1 --1- 172.21.15.94:0/1780317043 >> v1:172.21.15.130:6789/0 conn(0x7f8abc0e3070 0x7f8abc03ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:59342/0 (socket says 172.21.15.94:59342) 2023-10-16T08:51:50.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7f8ac99d6640 1 --2- 172.21.15.94:0/1780317043 >> v2:172.21.15.130:3300/0 conn(0x7f8abc054360 0x7f8abc0eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.321+0000 7fa045858640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa04015d320 0x7fa040159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7fa044856640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0400cb490 0x7fa0401590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7fa044856640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0400cb490 0x7fa0401590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58056/0 (socket says 172.21.15.94:58056) 2023-10-16T08:51:50.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7f92bfef2640 1 Processor -- start 2023-10-16T08:51:50.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7f8917fff640 1 -- 172.21.15.94:0/1330673180 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c031d20 con 0x7f8918053cf0 2023-10-16T08:51:50.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7f92bfef2640 1 -- start start 2023-10-16T08:51:50.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.322+0000 7fa044856640 1 -- 172.21.15.94:0/1307514787 learned_addr learned my addr 172.21.15.94:0/1307514787 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7fa044856640 1 -- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa04015d320 msgr2=0x7fa040159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7fa044856640 1 --2- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa04015d320 0x7fa040159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7fa044856640 1 -- 172.21.15.94:0/1307514787 >> v1:172.21.15.94:6789/0 conn(0x7fa0401564d0 legacy=0x7fa0400cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7fa044856640 1 -- 172.21.15.94:0/1307514787 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04015c840 con 0x7fa0400cb490 2023-10-16T08:51:50.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7f8ac99d6640 1 -- 172.21.15.94:0/1780317043 >> v1:172.21.15.130:6789/0 conn(0x7f8abc0e3070 legacy=0x7f8abc03ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7f8ac99d6640 1 -- 172.21.15.94:0/1780317043 >> v1:172.21.15.94:6789/0 conn(0x7f8abc006b70 legacy=0x7f8abc053c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.323+0000 7f8ac99d6640 1 -- 172.21.15.94:0/1780317043 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc007690 con 0x7f8abc054360 2023-10-16T08:51:50.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.324+0000 7f89279f5640 1 -- 172.21.15.94:0/1330673180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8918053cf0 msgr2=0x7f8918054160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.324+0000 7f89279f5640 1 --2- 172.21.15.94:0/1330673180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8918053cf0 0x7f8918054160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8918053830 tx=0x7f891c02b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.324+0000 7f8ac99d6640 1 --2- 172.21.15.94:0/1780317043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc0eddc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ac404f940 tx=0x7f8ac40a57f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e3e8e6140faea6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7fa044856640 1 --2- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0400cb490 0x7fa0401590e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00c7d0 tx=0x7fa02c02fff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d9aa991138fcf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f89279f5640 1 -- 172.21.15.94:0/1330673180 shutdown_connections 2023-10-16T08:51:50.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f89279f5640 1 --2- 172.21.15.94:0/1330673180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8918053cf0 0x7f8918054160 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f89279f5640 1 --2- 172.21.15.94:0/1330673180 >> v2:172.21.15.130:3300/0 conn(0x7f89180382c0 0x7f891803c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f89279f5640 1 -- 172.21.15.94:0/1330673180 >> 172.21.15.94:0/1330673180 conn(0x7f8918055a30 msgr2=0x7f8918055e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bfef2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92b80c18c0 0x7f92b815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bfef2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 0x7f92b80c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bfef2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92b8160f40 0x7f92b80b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bfef2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815dc20 con 0x7f92b80c18c0 2023-10-16T08:51:50.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f8abbfff640 1 -- 172.21.15.94:0/1780317043 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40ad640 con 0x7f8abc054360 2023-10-16T08:51:50.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f8abbfff640 1 -- 172.21.15.94:0/1780317043 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac40ad7a0 con 0x7f8abc054360 2023-10-16T08:51:50.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f8abbfff640 1 -- 172.21.15.94:0/1780317043 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40adbd0 con 0x7f8abc054360 2023-10-16T08:51:50.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bfef2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80c28e0 con 0x7f92b80c9e10 2023-10-16T08:51:50.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f89279f5640 1 -- 172.21.15.94:0/1330673180 shutdown_connections 2023-10-16T08:51:50.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f89279f5640 1 -- 172.21.15.94:0/1330673180 wait complete. 2023-10-16T08:51:50.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bfef2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80c2bc0 con 0x7f92b8160f40 2023-10-16T08:51:50.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7fa03ffff640 1 -- 172.21.15.94:0/1307514787 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c030da0 con 0x7fa0400cb490 2023-10-16T08:51:50.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7fa03ffff640 1 -- 172.21.15.94:0/1307514787 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c034070 con 0x7fa0400cb490 2023-10-16T08:51:50.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7fa03ffff640 1 -- 172.21.15.94:0/1307514787 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c03a600 con 0x7fa0400cb490 2023-10-16T08:51:50.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bdc8e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92b80c18c0 0x7f92b815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bdc8e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92b80c18c0 0x7f92b815d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56900/0 (socket says 172.21.15.94:56900) 2023-10-16T08:51:50.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.325+0000 7f92bdc8e640 1 -- 172.21.15.94:0/351199640 learned_addr learned my addr 172.21.15.94:0/351199640 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f92bd48d640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 0x7f92b80c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f8acb439640 1 -- 172.21.15.94:0/1780317043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 msgr2=0x7f8abc0eddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f8acb439640 1 --2- 172.21.15.94:0/1780317043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc0eddc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ac404f940 tx=0x7f8ac40a57f0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f92be48f640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92b8160f40 0x7f92b80b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f8acb439640 1 -- 172.21.15.94:0/1780317043 shutdown_connections 2023-10-16T08:51:50.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f8acb439640 1 --2- 172.21.15.94:0/1780317043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc0eddc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.326+0000 7f8acb439640 1 -- 172.21.15.94:0/1780317043 >> 172.21.15.94:0/1780317043 conn(0x7f8abc055a90 msgr2=0x7f8abc055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 -- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0400cb490 msgr2=0x7fa0401590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 --2- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0400cb490 0x7fa0401590e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00c7d0 tx=0x7fa02c02fff0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f8acb439640 1 -- 172.21.15.94:0/1780317043 shutdown_connections 2023-10-16T08:51:50.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f8acb439640 1 -- 172.21.15.94:0/1780317043 wait complete. 2023-10-16T08:51:50.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 -- 172.21.15.94:0/1307514787 shutdown_connections 2023-10-16T08:51:50.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 --2- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa04015d320 0x7fa040159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 --2- 172.21.15.94:0/1307514787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0400cb490 0x7fa0401590e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 -- 172.21.15.94:0/1307514787 >> 172.21.15.94:0/1307514787 conn(0x7fa04006a470 msgr2=0x7fa0400afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f92be48f640 1 -- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 msgr2=0x7f92b80c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f92be48f640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92b80c9e10 0x7f92b80c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f92be48f640 1 -- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92b80c18c0 msgr2=0x7f92b815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f92be48f640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92b80c18c0 0x7f92b815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7f92be48f640 1 -- 172.21.15.94:0/351199640 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0009400 con 0x7f92b8160f40 2023-10-16T08:51:50.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.327+0000 7fa046059640 1 -- 172.21.15.94:0/1307514787 shutdown_connections 2023-10-16T08:51:50.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.328+0000 7f92bdc8e640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92b80c18c0 0x7f92b815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:50.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.328+0000 7fa046059640 1 -- 172.21.15.94:0/1307514787 wait complete. 2023-10-16T08:51:50.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.328+0000 7f92be48f640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92b8160f40 0x7f92b80b0f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e7d0 tx=0x7f92b000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.328+0000 7f89279f5640 1 Processor -- start 2023-10-16T08:51:50.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.329+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00095b0 con 0x7f92b8160f40 2023-10-16T08:51:50.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.329+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0004020 con 0x7f92b8160f40 2023-10-16T08:51:50.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.329+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00043b0 con 0x7f92b8160f40 2023-10-16T08:51:50.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.329+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b4009b30 con 0x7f92b8160f40 2023-10-16T08:51:50.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.329+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b80c3180 con 0x7f92b8160f40 2023-10-16T08:51:50.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.329+0000 7f89279f5640 1 -- start start 2023-10-16T08:51:50.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.330+0000 7f8acb439640 1 Processor -- start 2023-10-16T08:51:50.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.330+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92b80c9330 con 0x7f92b8160f40 2023-10-16T08:51:50.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.331+0000 7fa046059640 1 Processor -- start 2023-10-16T08:51:50.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.331+0000 7f8acb439640 1 -- start start 2023-10-16T08:51:50.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.331+0000 7fa046059640 1 -- start start 2023-10-16T08:51:50.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.331+0000 7f89279f5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89180382c0 0x7f89180e1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f89279f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918053cf0 0x7f891816f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f89279f5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180e64b0 0x7f891816c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f89279f5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891816e4c0 con 0x7f89180382c0 2023-10-16T08:51:50.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f8acb439640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8abc006b70 0x7f8abc17cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f8acb439640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc04f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f8acb439640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8abc0e3070 0x7f8abc03a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f8acb439640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc17d310 con 0x7f8abc006b70 2023-10-16T08:51:50.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f8acb439640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc04cb40 con 0x7f8abc054360 2023-10-16T08:51:50.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f8acb439640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc03dbb0 con 0x7f8abc0e3070 2023-10-16T08:51:50.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f89279f5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891816ccc0 con 0x7f8918053cf0 2023-10-16T08:51:50.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f89279f5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891816e6f0 con 0x7f89180e64b0 2023-10-16T08:51:50.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f8925791640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89180382c0 0x7f89180e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f8925f92640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180e64b0 0x7f891816c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f8924f90640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918053cf0 0x7f891816f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7fa046059640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0400cb490 0x7fa0400c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f8925791640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89180382c0 0x7f89180e1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56914/0 (socket says 172.21.15.94:56914) 2023-10-16T08:51:50.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f8925791640 1 -- 172.21.15.94:0/235668175 learned_addr learned my addr 172.21.15.94:0/235668175 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7fa046059640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0401564d0 0x7fa0400c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f8ac91d5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8abc006b70 0x7f8abc17cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92b000c940 con 0x7f92b8160f40 2023-10-16T08:51:50.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa046059640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa04015d320 0x7fa0400c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa046059640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c8280 con 0x7fa0401564d0 2023-10-16T08:51:50.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa046059640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400ce5c0 con 0x7fa04015d320 2023-10-16T08:51:50.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa046059640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400ce8a0 con 0x7fa0400cb490 2023-10-16T08:51:50.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa044856640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0401564d0 0x7fa0400c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa044856640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0401564d0 0x7fa0400c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56932/0 (socket says 172.21.15.94:56932) 2023-10-16T08:51:50.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa044856640 1 -- 172.21.15.94:0/1372433774 learned_addr learned my addr 172.21.15.94:0/1372433774 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f8ac99d6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8abc0e3070 0x7f8abc03a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f8ac89d4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc04f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f8ac89d4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc04f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58102/0 (socket says 172.21.15.94:58102) 2023-10-16T08:51:50.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f8ac89d4640 1 -- 172.21.15.94:0/1328235523 learned_addr learned my addr 172.21.15.94:0/1328235523 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7fa045858640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa04015d320 0x7fa0400c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.331+0000 7f50d02da640 1 Processor -- start 2023-10-16T08:51:50.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.332+0000 7f50d02da640 1 -- start start 2023-10-16T08:51:50.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.333+0000 7f50d02da640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50c80c1d20 0x7f50c8161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f50d02da640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c81651e0 con 0x7f50c8070a40 2023-10-16T08:51:50.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f50d02da640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c80c9b50 con 0x7f50c8165670 2023-10-16T08:51:50.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8925791640 1 -- 172.21.15.94:0/235668175 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180e64b0 msgr2=0x7f891816c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f50d02da640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c80c2100 con 0x7f50c80c1d20 2023-10-16T08:51:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f50ce877640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f50c8070a40 0x7f50c8160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50886/0 (socket says 172.21.15.94:50886) 2023-10-16T08:51:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.334+0000 7f50ce877640 1 -- 172.21.15.94:0/3081518995 learned_addr learned my addr 172.21.15.94:0/3081518995 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7fa045057640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0400cb490 0x7fa0400c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8ac89d4640 1 -- 172.21.15.94:0/1328235523 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8abc0e3070 msgr2=0x7f8abc03a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8ac89d4640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8abc0e3070 0x7f8abc03a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8ac89d4640 1 -- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8abc006b70 msgr2=0x7f8abc17cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8ac89d4640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8abc006b70 0x7f8abc17cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8ac89d4640 1 -- 172.21.15.94:0/1328235523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc03de90 con 0x7f8abc054360 2023-10-16T08:51:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8925791640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180e64b0 0x7f891816c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8925791640 1 -- 172.21.15.94:0/235668175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918053cf0 msgr2=0x7f891816f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8925791640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918053cf0 0x7f891816f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f8925791640 1 -- 172.21.15.94:0/235668175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009400 con 0x7f89180382c0 2023-10-16T08:51:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7f50ce076640 1 --2- 172.21.15.94:0/3081518995 >> v2:172.21.15.94:3300/0 conn(0x7f50c80c1d20 0x7f50c8161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.335+0000 7fa044856640 1 -- 172.21.15.94:0/1372433774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0400cb490 msgr2=0x7fa0400c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa044856640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0400cb490 0x7fa0400c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa044856640 1 -- 172.21.15.94:0/1372433774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa04015d320 msgr2=0x7fa0400c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa044856640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa04015d320 0x7fa0400c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa044856640 1 -- 172.21.15.94:0/1372433774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c005fc0 con 0x7fa0401564d0 2023-10-16T08:51:50.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7f8ac89d4640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc04f420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c4a0 tx=0x7f8ab400c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa044856640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0401564d0 0x7fa0400c7800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00c7d0 tx=0x7fa02c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049650092 0 0) 0x7f50c80c9b50 con 0x7f50c8165670 2023-10-16T08:51:50.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7f8925791640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89180382c0 0x7f89180e1380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f892004ef10 tx=0x7f8920072520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c003a20 con 0x7fa0401564d0 2023-10-16T08:51:50.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c003b80 con 0x7fa0401564d0 2023-10-16T08:51:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7f92ae7fc640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f929c06aec0 0x7f929c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92b00899c0 con 0x7f92b8160f40 2023-10-16T08:51:50.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f92ae7fc640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] conn(0x7f929c074500 0x7f929c076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 --> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f929c077010 con 0x7f929c074500 2023-10-16T08:51:50.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b0089e60 con 0x7f92b8160f40 2023-10-16T08:51:50.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0400ceb80 con 0x7fa0401564d0 2023-10-16T08:51:50.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.336+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c043480 con 0x7fa0401564d0 2023-10-16T08:51:50.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b4003520 con 0x7f50c8165670 2023-10-16T08:51:50.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234713908 0 0) 0x7f50c81651e0 con 0x7f50c8070a40 2023-10-16T08:51:50.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c80c9b50 con 0x7f50c8070a40 2023-10-16T08:51:50.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0400c1ea0 con 0x7fa0401564d0 2023-10-16T08:51:50.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4005ce0 con 0x7f8abc054360 2023-10-16T08:51:50.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4005e40 con 0x7f8abc054360 2023-10-16T08:51:50.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920072970 con 0x7f89180382c0 2023-10-16T08:51:50.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.338+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa04015ce00 con 0x7fa0401564d0 2023-10-16T08:51:50.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f92bdc8e640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f929c06aec0 0x7f929c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f92bd48d640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] conn(0x7f929c074500 0x7f929c076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f50ce076640 1 -- 172.21.15.94:0/3081518995 >> v1:172.21.15.130:6789/0 conn(0x7f50c8165670 legacy=0x7f50c8070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f50ce076640 1 -- 172.21.15.94:0/3081518995 >> v1:172.21.15.94:6789/0 conn(0x7f50c8070a40 legacy=0x7f50c8160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f50ce076640 1 -- 172.21.15.94:0/3081518995 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80c9870 con 0x7f50c80c1d20 2023-10-16T08:51:50.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.339+0000 7f92bd48d640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] conn(0x7f929c074500 0x7f929c076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.337+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4007270 con 0x7f8abc054360 2023-10-16T08:51:50.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.338+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc03e170 con 0x7f8abc054360 2023-10-16T08:51:50.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.338+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc04f960 con 0x7f8abc054360 2023-10-16T08:51:50.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.339+0000 7f50ce076640 1 --2- 172.21.15.94:0/3081518995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c8161fa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50c40097a0 tx=0x7f50c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a02e58e004e6161 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.339+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8aa4000fc0 con 0x7f8abc054360 2023-10-16T08:51:50.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.339+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891816e9d0 con 0x7f89180382c0 2023-10-16T08:51:50.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.339+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89180e1eb0 con 0x7f89180382c0 2023-10-16T08:51:50.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.340+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== osd.0 v2:172.21.15.94:6800/838690499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f929c077010 con 0x7f929c074500 2023-10-16T08:51:50.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.340+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892008d070 con 0x7f89180382c0 2023-10-16T08:51:50.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.340+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920072970 con 0x7f89180382c0 2023-10-16T08:51:50.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.341+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8900000fc0 con 0x7f89180382c0 2023-10-16T08:51:50.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.341+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4030860 con 0x7f50c80c1d20 2023-10-16T08:51:50.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.341+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c40309c0 con 0x7f50c80c1d20 2023-10-16T08:51:50.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.341+0000 7f50cd074640 1 -- 172.21.15.94:0/3081518995 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4030d30 con 0x7f50c80c1d20 2023-10-16T08:51:50.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.342+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa02c03a400 con 0x7fa0401564d0 2023-10-16T08:51:50.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.342+0000 7f50d02da640 1 -- 172.21.15.94:0/3081518995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 msgr2=0x7f50c8161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.342+0000 7f50d02da640 1 --2- 172.21.15.94:0/3081518995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c8161fa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50c40097a0 tx=0x7f50c402b9a0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f50d02da640 1 -- 172.21.15.94:0/3081518995 shutdown_connections 2023-10-16T08:51:50.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f50d02da640 1 --2- 172.21.15.94:0/3081518995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c8161fa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8ab4007490 con 0x7f8abc054360 2023-10-16T08:51:50.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f50d02da640 1 -- 172.21.15.94:0/3081518995 >> 172.21.15.94:0/3081518995 conn(0x7f50c806a440 msgr2=0x7f50c80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f50d02da640 1 -- 172.21.15.94:0/3081518995 shutdown_connections 2023-10-16T08:51:50.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f50d02da640 1 -- 172.21.15.94:0/3081518995 wait complete. 2023-10-16T08:51:50.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7fa08cfd0640 1 Processor -- start 2023-10-16T08:51:50.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7f92bdc8e640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f929c06aec0 0x7f929c06d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007fd0 tx=0x7f92a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.344+0000 7f5eeef65640 1 Processor -- start 2023-10-16T08:51:50.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.344+0000 7fa03dffb640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa02406ae70 0x7fa02406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.344+0000 7f5eeef65640 1 -- start start 2023-10-16T08:51:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.344+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa02c0abb50 con 0x7fa0401564d0 2023-10-16T08:51:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7fa045057640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa02406ae70 0x7fa02406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7fa03dffb640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] conn(0x7fa024074430 0x7fa024076870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 --> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa024076f40 con 0x7fa024074430 2023-10-16T08:51:50.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa02c0abec0 con 0x7fa0401564d0 2023-10-16T08:51:50.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.343+0000 7fa08cfd0640 1 -- start start 2023-10-16T08:51:50.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7f50d02da640 1 Processor -- start 2023-10-16T08:51:50.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.344+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8920072b10 con 0x7f89180382c0 2023-10-16T08:51:50.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7f8ab9ffb640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8aa806af40 0x7f8aa806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.345+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ab4089520 con 0x7f8abc054360 2023-10-16T08:51:50.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa08cfd0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880cf210 0x7fa0880cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa08cfd0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa088164640 0x7fa088166a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7f50d02da640 1 -- start start 2023-10-16T08:51:50.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa045858640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] conn(0x7fa024074430 0x7fa024076870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7f5eeef65640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee815c9f0 0x7f5ee8160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7f5eeef65640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ee80b83b0 0x7f5ee80cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7f5eeef65640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee8161520 con 0x7f5ee80cdbc0 2023-10-16T08:51:50.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7f5eeef65640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80ce050 con 0x7f5ee80b83b0 2023-10-16T08:51:50.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7f5eeef65640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8160f60 con 0x7f5ee815c9f0 2023-10-16T08:51:50.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa08cfd0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880cfbb0 con 0x7fa0880b1cc0 2023-10-16T08:51:50.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa08cfd0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880d1430 con 0x7fa088164640 2023-10-16T08:51:50.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa08cfd0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880ccf40 con 0x7fa0880cf210 2023-10-16T08:51:50.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa0877fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa0880b1cc0 0x7fa0880ce120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50888/0 (socket says 172.21.15.94:50888) 2023-10-16T08:51:50.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.346+0000 7fa0877fe640 1 -- 172.21.15.94:0/1478230203 learned_addr learned my addr 172.21.15.94:0/1478230203 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7fa086ffd640 1 --2- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880cf210 0x7fa0880cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7fa087fff640 1 --2- 172.21.15.94:0/1478230203 >> v2:172.21.15.130:3300/0 conn(0x7fa088164640 0x7fa088166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f8ac91d5640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8aa806af40 0x7f8aa806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f5eed502640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5ee80cdbc0 0x7f5ee80b4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:59362/0 (socket says 172.21.15.94:59362) 2023-10-16T08:51:50.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f5eed502640 1 -- 172.21.15.94:0/3667691991 learned_addr learned my addr 172.21.15.94:0/3667691991 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f5edffff640 1 --2- 172.21.15.94:0/3667691991 >> v2:172.21.15.94:3300/0 conn(0x7f5ee80b83b0 0x7f5ee80cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f5eecd01640 1 --2- 172.21.15.94:0/3667691991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee815c9f0 0x7f5ee8160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f8ab9ffb640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] conn(0x7f8aa8074580 0x7f8aa80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8915ffb640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f890406aed0 0x7f890406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7fa087fff640 1 -- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880cf210 msgr2=0x7fa0880cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7fa087fff640 1 --2- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880cf210 0x7fa0880cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7fa087fff640 1 -- 172.21.15.94:0/1478230203 >> v1:172.21.15.94:6789/0 conn(0x7fa0880b1cc0 legacy=0x7fa0880ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7fa087fff640 1 -- 172.21.15.94:0/1478230203 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880b20a0 con 0x7fa088164640 2023-10-16T08:51:50.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.347+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 --> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8aa8077090 con 0x7f8aa8074580 2023-10-16T08:51:50.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab40898d0 con 0x7f8abc054360 2023-10-16T08:51:50.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8ac99d6640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] conn(0x7f8aa8074580 0x7f8aa80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f5edffff640 1 -- 172.21.15.94:0/3667691991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee815c9f0 msgr2=0x7f5ee8160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f5edffff640 1 --2- 172.21.15.94:0/3667691991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee815c9f0 0x7f5ee8160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f5edffff640 1 -- 172.21.15.94:0/3667691991 >> v1:172.21.15.130:6789/0 conn(0x7f5ee80cdbc0 legacy=0x7f5ee80b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f5ee7fff640 1 -- 172.21.15.94:0/3667691991 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982905071 0 0) 0x7f5ee8161520 con 0x7f5ee80cdbc0 2023-10-16T08:51:50.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7fa045057640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa02406ae70 0x7fa02406d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa034005520 tx=0x7fa034009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89201030b0 con 0x7f89180382c0 2023-10-16T08:51:50.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8915ffb640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] conn(0x7f8904074510 0x7f8904076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.414 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 --> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8904077020 con 0x7f8904074510 2023-10-16T08:51:50.414 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.348+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8920103460 con 0x7f89180382c0 2023-10-16T08:51:50.414 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.349+0000 7f8ac91d5640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8aa806af40 0x7f8aa806d400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007680 tx=0x7f8ac0000fb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.349+0000 7f5edffff640 1 -- 172.21.15.94:0/3667691991 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8161240 con 0x7f5ee80b83b0 2023-10-16T08:51:50.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.349+0000 7f8925f92640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] conn(0x7f8904074510 0x7f8904076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.349+0000 7f8924f90640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f890406aed0 0x7f890406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.349+0000 7f50d02da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50c8070a40 0x7f50c80c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f8ac99d6640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] conn(0x7f8aa8074580 0x7f8aa80769c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7fa045858640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] conn(0x7fa024074430 0x7fa024076870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50d02da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50d02da640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50c8165670 0x7f50c80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50d02da640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80c5d40 con 0x7f50c80c1d20 2023-10-16T08:51:50.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50d02da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c814c1e0 con 0x7f50c8070a40 2023-10-16T08:51:50.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50d02da640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80c6010 con 0x7f50c8165670 2023-10-16T08:51:50.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50cd875640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7fa087fff640 1 --2- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 0x7fa088166a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa080009d90 tx=0x7fa08002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e544d4d47f47f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50cd875640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c814bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56952/0 (socket says 172.21.15.94:56952) 2023-10-16T08:51:50.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f50cd875640 1 -- 172.21.15.94:0/1622276678 learned_addr learned my addr 172.21.15.94:0/1622276678 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.350+0000 7f5edffff640 1 --2- 172.21.15.94:0/3667691991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80cd680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00097a0 tx=0x7f5ed002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d29ffab8c00484 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50ce877640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50c8165670 0x7f50c80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50ce076640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50c8070a40 0x7f50c80c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f8925f92640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] conn(0x7f8904074510 0x7f8904076950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f5ee7fff640 1 -- 172.21.15.94:0/3667691991 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0031830 con 0x7f5ee80b83b0 2023-10-16T08:51:50.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f5ee7fff640 1 -- 172.21.15.94:0/3667691991 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0031990 con 0x7f5ee80b83b0 2023-10-16T08:51:50.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50cd875640 1 -- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50c8165670 msgr2=0x7f50c80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50cd875640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50c8165670 0x7f50c80c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50cd875640 1 -- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50c8070a40 msgr2=0x7f50c80c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50cd875640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50c8070a40 0x7f50c80c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f50cd875640 1 -- 172.21.15.94:0/1622276678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009400 con 0x7f50c80c1d20 2023-10-16T08:51:50.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f5ee7fff640 1 -- 172.21.15.94:0/3667691991 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0031830 con 0x7f5ee80b83b0 2023-10-16T08:51:50.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.351+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== osd.2 v2:172.21.15.94:6816/2790169838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8aa8077090 con 0x7f8aa8074580 2023-10-16T08:51:50.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7fa0867fc640 1 -- 172.21.15.94:0/1478230203 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08002cc90 con 0x7fa088164640 2023-10-16T08:51:50.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7fa0867fc640 1 -- 172.21.15.94:0/1478230203 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08002cdf0 con 0x7fa088164640 2023-10-16T08:51:50.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7f50cd875640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c814bca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c3e0 tx=0x7f50b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b80052d0 con 0x7f50c80c1d20 2023-10-16T08:51:50.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b8005430 con 0x7f50c80c1d20 2023-10-16T08:51:50.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003830 con 0x7f50c80c1d20 2023-10-16T08:51:50.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c80c62f0 con 0x7f50c80c1d20 2023-10-16T08:51:50.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.352+0000 7f5eeef65640 1 -- 172.21.15.94:0/3667691991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 msgr2=0x7f5ee80cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7fa0867fc640 1 -- 172.21.15.94:0/1478230203 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080034660 con 0x7fa088164640 2023-10-16T08:51:50.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c80c68b0 con 0x7f50c80c1d20 2023-10-16T08:51:50.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f5eeef65640 1 --2- 172.21.15.94:0/3667691991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80cd680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00097a0 tx=0x7f5ed002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f5eeef65640 1 -- 172.21.15.94:0/3667691991 shutdown_connections 2023-10-16T08:51:50.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f5eeef65640 1 --2- 172.21.15.94:0/3667691991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80cd680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f5eeef65640 1 --2- 172.21.15.94:0/3667691991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee815c9f0 0x7f5ee8160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f5eeef65640 1 -- 172.21.15.94:0/3667691991 >> 172.21.15.94:0/3667691991 conn(0x7f5ee8071510 msgr2=0x7f5ee8071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== osd.1 v2:172.21.15.94:6808/3630710263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8904077020 con 0x7f8904074510 2023-10-16T08:51:50.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.353+0000 7f5eeef65640 1 -- 172.21.15.94:0/3667691991 shutdown_connections 2023-10-16T08:51:50.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 -- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 msgr2=0x7fa088166a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 --2- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 0x7fa088166a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa080009d90 tx=0x7fa08002bee0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7f5eeef65640 1 -- 172.21.15.94:0/3667691991 wait complete. 2023-10-16T08:51:50.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 -- 172.21.15.94:0/1478230203 shutdown_connections 2023-10-16T08:51:50.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 --2- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 0x7fa088166a30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 --2- 172.21.15.94:0/1478230203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880cf210 0x7fa0880cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 -- 172.21.15.94:0/1478230203 >> 172.21.15.94:0/1478230203 conn(0x7fa088089f70 msgr2=0x7fa0880d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7f08567e9640 1 Processor -- start 2023-10-16T08:51:50.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.355+0000 7f08567e9640 1 -- start start 2023-10-16T08:51:50.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 -- 172.21.15.94:0/1478230203 shutdown_connections 2023-10-16T08:51:50.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.354+0000 7fa08cfd0640 1 -- 172.21.15.94:0/1478230203 wait complete. 2023-10-16T08:51:50.436 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.355+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== osd.3 v2:172.21.15.94:6822/1791163836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa024076f40 con 0x7fa024074430 2023-10-16T08:51:50.436 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.356+0000 7f5eeef65640 1 Processor -- start 2023-10-16T08:51:50.436 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.356+0000 7f8924f90640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f890406aed0 0x7f890406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8910006fd0 tx=0x7f8910008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.356+0000 7f08567e9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08480e78b0 0x7f084804f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08567e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480eb2c0 0x7f08480eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08567e9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0848052fe0 0x7f0848053470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f5eeef65640 1 -- start start 2023-10-16T08:51:50.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08567e9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0848050340 con 0x7f0848052fe0 2023-10-16T08:51:50.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08567e9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0848006480 con 0x7f08480e78b0 2023-10-16T08:51:50.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08567e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480ebc40 con 0x7f08480eb2c0 2023-10-16T08:51:50.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7fa08cfd0640 1 Processor -- start 2023-10-16T08:51:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.356+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50c8164e70 con 0x7f50c80c1d20 2023-10-16T08:51:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7fa08cfd0640 1 -- start start 2023-10-16T08:51:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08557e7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08480e78b0 0x7f084804f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f50b8003990 con 0x7f50c80c1d20 2023-10-16T08:51:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08557e7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f08480e78b0 0x7f084804f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58146/0 (socket says 172.21.15.94:58146) 2023-10-16T08:51:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f08557e7640 1 -- 172.21.15.94:0/4044781391 learned_addr learned my addr 172.21.15.94:0/4044781391 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.357+0000 7f0855fe8640 1 --2- 172.21.15.94:0/4044781391 >> v2:172.21.15.94:3300/0 conn(0x7f0848052fe0 0x7f0848053470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f5eeef65640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f5eeef65640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee80cdbc0 0x7f5ee80c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f5eeef65640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee815c9f0 0x7f5ee814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f5eeef65640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c7d10 con 0x7f5ee80b83b0 2023-10-16T08:51:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f5eeef65640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b2950 con 0x7f5ee815c9f0 2023-10-16T08:51:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f5eeef65640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c7190 con 0x7f5ee80cdbc0 2023-10-16T08:51:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.359+0000 7fa08cfd0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880b1cc0 0x7fa088155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.359+0000 7f5eecd01640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.359+0000 7f50beffd640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50ac06ae70 0x7f50ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.359+0000 7fa08cfd0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0880cf210 0x7fa0880b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f08557e7640 1 -- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480eb2c0 msgr2=0x7f08480eb700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T08:51:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f08557e7640 1 --2- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480eb2c0 0x7f08480eb700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f08557e7640 1 -- 172.21.15.94:0/4044781391 >> v2:172.21.15.94:3300/0 conn(0x7f0848052fe0 msgr2=0x7f0848053470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f08557e7640 1 --2- 172.21.15.94:0/4044781391 >> v2:172.21.15.94:3300/0 conn(0x7f0848052fe0 0x7f0848053470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.358+0000 7f08557e7640 1 -- 172.21.15.94:0/4044781391 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084804fd80 con 0x7f08480e78b0 2023-10-16T08:51:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa08cfd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 0x7fa088156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f0855fe8640 1 --2- 172.21.15.94:0/4044781391 >> v2:172.21.15.94:3300/0 conn(0x7f0848052fe0 0x7f0848053470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50b8088f00 con 0x7f50c80c1d20 2023-10-16T08:51:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f5edffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee80cdbc0 0x7f5ee80c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f5edffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee80cdbc0 0x7f5ee80c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:46988/0 (socket says 172.21.15.94:46988) 2023-10-16T08:51:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f5edffff640 1 -- 172.21.15.94:0/510280931 learned_addr learned my addr 172.21.15.94:0/510280931 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f5eed502640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee815c9f0 0x7f5ee814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7f08557e7640 1 --2- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480e78b0 0x7f084804f260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f084800bd70 tx=0x7f084002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b42938f82c1425ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa0877fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880b1cc0 0x7fa088155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa0877fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880b1cc0 0x7fa088155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:46998/0 (socket says 172.21.15.94:46998) 2023-10-16T08:51:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa086ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0880cf210 0x7fa0880b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa086ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0880cf210 0x7fa0880b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:56986/0 (socket says 172.21.15.94:56986) 2023-10-16T08:51:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa0877fe640 1 -- 172.21.15.94:0/2229555681 learned_addr learned my addr 172.21.15.94:0/2229555681 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880cb1b0 con 0x7fa0880cf210 2023-10-16T08:51:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880cb400 con 0x7fa088164640 2023-10-16T08:51:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.360+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880cb6e0 con 0x7fa0880b1cc0 2023-10-16T08:51:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f50ce076640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50ac06ae70 0x7f50ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7fa087fff640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 0x7fa088156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f0847fff640 1 -- 172.21.15.94:0/4044781391 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840031830 con 0x7f08480e78b0 2023-10-16T08:51:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7fa086ffd640 1 -- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880b1cc0 msgr2=0x7fa088155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f5eecd01640 1 -- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee80cdbc0 msgr2=0x7f5ee80c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f5eecd01640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ee80cdbc0 0x7f5ee80c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f5eecd01640 1 -- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee815c9f0 msgr2=0x7f5ee814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f5eecd01640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee815c9f0 0x7f5ee814e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f5eecd01640 1 -- 172.21.15.94:0/510280931 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009400 con 0x7f5ee80b83b0 2023-10-16T08:51:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f50beffd640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] conn(0x7f50ac0744b0 0x7f50ac0768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7fa086ffd640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0880b1cc0 0x7fa088155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7fa086ffd640 1 -- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 msgr2=0x7fa088156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7fa086ffd640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa088164640 0x7fa088156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7fa086ffd640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080009a70 con 0x7fa0880cf210 2023-10-16T08:51:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f0847fff640 1 -- 172.21.15.94:0/4044781391 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840031990 con 0x7f08480e78b0 2023-10-16T08:51:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 --> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50ac076fc0 con 0x7f50ac0744b0 2023-10-16T08:51:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f0847fff640 1 -- 172.21.15.94:0/4044781391 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840031d60 con 0x7f08480e78b0 2023-10-16T08:51:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.361+0000 7f5eecd01640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80b2410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800ebc0 tx=0x7f5ed800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b808b520 con 0x7f50c80c1d20 2023-10-16T08:51:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800cd40 con 0x7f5ee80b83b0 2023-10-16T08:51:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f50ce877640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] conn(0x7f50ac0744b0 0x7f50ac0768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80c7470 con 0x7f5ee80b83b0 2023-10-16T08:51:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80c7800 con 0x7f5ee80b83b0 2023-10-16T08:51:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800f040 con 0x7f5ee80b83b0 2023-10-16T08:51:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.362+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800cea0 con 0x7f5ee80b83b0 2023-10-16T08:51:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7fa086ffd640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0880cf210 0x7fa0880b5460 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00e850 tx=0x7fa07c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7f08567e9640 1 -- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480e78b0 msgr2=0x7f084804f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7f08567e9640 1 --2- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480e78b0 0x7f084804f260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f084800bd70 tx=0x7f084002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7f50ce877640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] conn(0x7f50ac0744b0 0x7f50ac0768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0095b0 con 0x7fa0880cf210 2023-10-16T08:51:50.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00c940 con 0x7fa0880cf210 2023-10-16T08:51:50.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.363+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00ccd0 con 0x7fa0880cf210 2023-10-16T08:51:50.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.364+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0880cb9c0 con 0x7fa0880cf210 2023-10-16T08:51:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.365+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0881561c0 con 0x7fa0880cf210 2023-10-16T08:51:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.365+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ed8014680 con 0x7f5ee80b83b0 2023-10-16T08:51:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.365+0000 7f50ce076640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50ac06ae70 0x7f50ac06d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50c4036000 tx=0x7f50c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.365+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== osd.5 v2:172.21.15.130:6801/3871839705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f50ac076fc0 con 0x7f50ac0744b0 2023-10-16T08:51:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.365+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0880d0a90 con 0x7fa0880cf210 2023-10-16T08:51:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.366+0000 7f5ee5ffb640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ec806ae70 0x7f5ec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.366+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ed808a4c0 con 0x7f5ee80b83b0 2023-10-16T08:51:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.367+0000 7f5edffff640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ec806ae70 0x7f5ec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.367+0000 7f08567e9640 1 -- 172.21.15.94:0/4044781391 shutdown_connections 2023-10-16T08:51:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.367+0000 7f08567e9640 1 --2- 172.21.15.94:0/4044781391 >> v2:172.21.15.94:3300/0 conn(0x7f0848052fe0 0x7f0848053470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.367+0000 7f08567e9640 1 --2- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480eb2c0 0x7f08480eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.367+0000 7f08567e9640 1 --2- 172.21.15.94:0/4044781391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480e78b0 0x7f084804f260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.367+0000 7f08567e9640 1 -- 172.21.15.94:0/4044781391 >> 172.21.15.94:0/4044781391 conn(0x7f0848054c10 msgr2=0x7f0848054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.368+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa07c013470 con 0x7fa0880cf210 2023-10-16T08:51:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7f5eeef65640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] conn(0x7f5ecc0015e0 0x7f5ecc003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 --> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ecc006b40 con 0x7f5ecc0015e0 2023-10-16T08:51:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7f5edffff640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ec806ae70 0x7f5ec806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81511d0 tx=0x7f5ed003e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7fa06ffff640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa07406aec0 0x7fa07406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa07c089c80 con 0x7fa0880cf210 2023-10-16T08:51:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7fa06ffff640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] conn(0x7fa074074500 0x7fa074076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa074077010 con 0x7fa074074500 2023-10-16T08:51:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa07c08a120 con 0x7fa0880cf210 2023-10-16T08:51:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.368+0000 7f08567e9640 1 -- 172.21.15.94:0/4044781391 shutdown_connections 2023-10-16T08:51:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.368+0000 7f08567e9640 1 -- 172.21.15.94:0/4044781391 wait complete. 2023-10-16T08:51:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7f5eed502640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] conn(0x7f5ecc0015e0 0x7f5ecc003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7f08567e9640 1 Processor -- start 2023-10-16T08:51:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.370+0000 7f08567e9640 1 -- start start 2023-10-16T08:51:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7f08567e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0848052fe0 0x7f08480beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7fa0877fe640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa07406aec0 0x7fa07406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7f08567e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480e78b0 0x7f08480d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7f08567e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480eb2c0 0x7f084817bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7f08567e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084817c840 con 0x7f0848052fe0 2023-10-16T08:51:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7f08567e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08480e36c0 con 0x7f08480eb2c0 2023-10-16T08:51:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.371+0000 7f08567e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480d2a00 con 0x7f08480e78b0 2023-10-16T08:51:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.372+0000 7f0854fe6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480e78b0 0x7f08480d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.372+0000 7f5eed502640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] conn(0x7f5ecc0015e0 0x7f5ecc003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.372+0000 7f0855fe8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480eb2c0 0x7f084817bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.372+0000 7f0855fe8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480eb2c0 0x7f084817bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58158/0 (socket says 172.21.15.94:58158) 2023-10-16T08:51:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.372+0000 7f0855fe8640 1 -- 172.21.15.94:0/483901689 learned_addr learned my addr 172.21.15.94:0/483901689 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7fa0877fe640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa07406aec0 0x7fa07406d380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa078004980 tx=0x7fa078007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f08557e7640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0848052fe0 0x7f08480beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f0855fe8640 1 -- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480e78b0 msgr2=0x7f08480d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f0855fe8640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08480e78b0 0x7f08480d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f0855fe8640 1 -- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0848052fe0 msgr2=0x7f08480beab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7fa087fff640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] conn(0x7fa074074500 0x7fa074076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f0855fe8640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0848052fe0 0x7f08480beab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f0855fe8640 1 -- 172.21.15.94:0/483901689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850073860 con 0x7f08480eb2c0 2023-10-16T08:51:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.373+0000 7f08557e7640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0848052fe0 0x7f08480beab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7f0855fe8640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480eb2c0 0x7f084817bd30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0850063ab0 tx=0x7f0850072520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7fa087fff640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] conn(0x7fa074074500 0x7fa074076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085008e070 con 0x7f08480eb2c0 2023-10-16T08:51:50.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850072980 con 0x7f08480eb2c0 2023-10-16T08:51:50.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850072cf0 con 0x7f08480eb2c0 2023-10-16T08:51:50.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08400094d0 con 0x7f08480eb2c0 2023-10-16T08:51:50.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.374+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08480e54b0 con 0x7f08480eb2c0 2023-10-16T08:51:50.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.375+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== osd.6 v2:172.21.15.130:6800/973414917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5ecc006b40 con 0x7f5ecc0015e0 2023-10-16T08:51:50.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.376+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0848006110 con 0x7f08480eb2c0 2023-10-16T08:51:50.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.376+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 --> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92b80c9050 con 0x7f929c074500 2023-10-16T08:51:50.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.377+0000 7f92ae7fc640 1 -- 172.21.15.94:0/351199640 <== osd.0 v2:172.21.15.94:6800/838690499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92b402ca10 con 0x7f929c074500 2023-10-16T08:51:50.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.377+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== osd.4 v2:172.21.15.130:6824/4232198053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa074077010 con 0x7fa074074500 2023-10-16T08:51:50.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.378+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0850072e50 con 0x7f08480eb2c0 2023-10-16T08:51:50.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.379+0000 7f0845ffb640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f083406ae40 0x7f083406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.380+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0850102ee0 con 0x7f08480eb2c0 2023-10-16T08:51:50.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.380+0000 7f0845ffb640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] conn(0x7f0834074400 0x7f0834076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.380+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 --> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0834076f10 con 0x7f0834074400 2023-10-16T08:51:50.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.380+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0850103250 con 0x7f08480eb2c0 2023-10-16T08:51:50.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.380+0000 7f08557e7640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f083406ae40 0x7f083406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.381+0000 7f0854fe6640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] conn(0x7f0834074400 0x7f0834076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.381+0000 7f08557e7640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f083406ae40 0x7f083406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0840036000 tx=0x7f084003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] conn(0x7f929c074500 msgr2=0x7f929c076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6800/838690499,v1:172.21.15.94:6801/838690499] conn(0x7f929c074500 0x7f929c076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f929c06aec0 msgr2=0x7f929c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f929c06aec0 0x7f929c06d380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007fd0 tx=0x7f92a8009040 comp rx=0 tx=0).stop 2023-10-16T08:51:50.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92b8160f40 msgr2=0x7f92b80b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 --2- 172.21.15.94:0/351199640 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92b8160f40 0x7f92b80b0f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e7d0 tx=0x7f92b000ec90 comp rx=0 tx=0).stop 2023-10-16T08:51:50.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92be48f640 1 -- 172.21.15.94:0/351199640 reap_dead start 2023-10-16T08:51:50.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 shutdown_connections 2023-10-16T08:51:50.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 >> 172.21.15.94:0/351199640 conn(0x7f92b8071400 msgr2=0x7f92b80ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 shutdown_connections 2023-10-16T08:51:50.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f92bfef2640 1 -- 172.21.15.94:0/351199640 wait complete. 2023-10-16T08:51:50.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.382+0000 7f0854fe6640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] conn(0x7f0834074400 0x7f0834076840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.385+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 --> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8900002cb0 con 0x7f8904074510 2023-10-16T08:51:50.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.385+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== osd.7 v2:172.21.15.130:6816/3792799510 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0834076f10 con 0x7f0834074400 2023-10-16T08:51:50.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.386+0000 7f8915ffb640 1 -- 172.21.15.94:0/235668175 <== osd.1 v2:172.21.15.94:6808/3630710263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8900002cb0 con 0x7f8904074510 2023-10-16T08:51:50.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.386+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] conn(0x7f8904074510 msgr2=0x7f8904076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.386+0000 7f89279f5640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6808/3630710263,v1:172.21.15.94:6809/3630710263] conn(0x7f8904074510 0x7f8904076950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.387+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f890406aed0 msgr2=0x7f890406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.387+0000 7f89279f5640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f890406aed0 0x7f890406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8910006fd0 tx=0x7f8910008040 comp rx=0 tx=0).stop 2023-10-16T08:51:50.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.387+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89180382c0 msgr2=0x7f89180e1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.387+0000 7f89279f5640 1 --2- 172.21.15.94:0/235668175 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89180382c0 0x7f89180e1380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f892004ef10 tx=0x7f8920072520 comp rx=0 tx=0).stop 2023-10-16T08:51:50.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.387+0000 7f8925f92640 1 -- 172.21.15.94:0/235668175 reap_dead start 2023-10-16T08:51:50.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.388+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 shutdown_connections 2023-10-16T08:51:50.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.388+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 >> 172.21.15.94:0/235668175 conn(0x7f8918055a30 msgr2=0x7f891804ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.390+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 --> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8aa4002cb0 con 0x7f8aa8074580 2023-10-16T08:51:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.390+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 shutdown_connections 2023-10-16T08:51:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.390+0000 7f89279f5640 1 -- 172.21.15.94:0/235668175 wait complete. 2023-10-16T08:51:50.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.391+0000 7f8ab9ffb640 1 -- 172.21.15.94:0/1328235523 <== osd.2 v2:172.21.15.94:6816/2790169838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8aa4002cb0 con 0x7f8aa8074580 2023-10-16T08:51:50.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.391+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] conn(0x7f8aa8074580 msgr2=0x7f8aa80769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6816/2790169838,v1:172.21.15.94:6817/2790169838] conn(0x7f8aa8074580 0x7f8aa80769c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8aa806af40 msgr2=0x7f8aa806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8aa806af40 0x7f8aa806d400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007680 tx=0x7f8ac0000fb0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 --> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa04015cb20 con 0x7fa024074430 2023-10-16T08:51:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 msgr2=0x7f8abc04f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 --2- 172.21.15.94:0/1328235523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc054360 0x7f8abc04f420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c4a0 tx=0x7f8ab400c960 comp rx=0 tx=0).stop 2023-10-16T08:51:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8ac99d6640 1 -- 172.21.15.94:0/1328235523 reap_dead start 2023-10-16T08:51:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 shutdown_connections 2023-10-16T08:51:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.392+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 >> 172.21.15.94:0/1328235523 conn(0x7f8abc055a90 msgr2=0x7f8abc0380e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.393+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 shutdown_connections 2023-10-16T08:51:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.393+0000 7f8acb439640 1 -- 172.21.15.94:0/1328235523 wait complete. 2023-10-16T08:51:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.393+0000 7fa03dffb640 1 -- 172.21.15.94:0/1372433774 <== osd.3 v2:172.21.15.94:6822/1791163836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa024076f40 con 0x7fa024074430 2023-10-16T08:51:50.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] conn(0x7fa024074430 msgr2=0x7fa024076870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6822/1791163836,v1:172.21.15.94:6824/1791163836] conn(0x7fa024074430 0x7fa024076870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa02406ae70 msgr2=0x7fa02406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa02406ae70 0x7fa02406d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa034005520 tx=0x7fa034009040 comp rx=0 tx=0).stop 2023-10-16T08:51:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0401564d0 msgr2=0x7fa0400c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 --2- 172.21.15.94:0/1372433774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0401564d0 0x7fa0400c7800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00c7d0 tx=0x7fa02c0046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa045858640 1 -- 172.21.15.94:0/1372433774 reap_dead start 2023-10-16T08:51:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 shutdown_connections 2023-10-16T08:51:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.395+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 >> 172.21.15.94:0/1372433774 conn(0x7fa04006a470 msgr2=0x7fa0400c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.396+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 --> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50c8164b90 con 0x7f50ac0744b0 2023-10-16T08:51:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.397+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 shutdown_connections 2023-10-16T08:51:50.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.398+0000 7f50beffd640 1 -- 172.21.15.94:0/1622276678 <== osd.5 v2:172.21.15.130:6801/3871839705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50c0001f20 con 0x7f50ac0744b0 2023-10-16T08:51:50.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.398+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] conn(0x7f50ac0744b0 msgr2=0x7f50ac0768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.398+0000 7f50d02da640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.130:6801/3871839705,v1:172.21.15.130:6803/3871839705] conn(0x7f50ac0744b0 0x7f50ac0768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50ac06ae70 msgr2=0x7f50ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50d02da640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50ac06ae70 0x7f50ac06d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50c4036000 tx=0x7f50c4008030 comp rx=0 tx=0).stop 2023-10-16T08:51:50.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 msgr2=0x7f50c814bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50d02da640 1 --2- 172.21.15.94:0/1622276678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50c80c1d20 0x7f50c814bca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c3e0 tx=0x7f50b800c8a0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50ce877640 1 -- 172.21.15.94:0/1622276678 reap_dead start 2023-10-16T08:51:50.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 shutdown_connections 2023-10-16T08:51:50.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.399+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 >> 172.21.15.94:0/1622276678 conn(0x7f50c806a440 msgr2=0x7f50c8151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.400+0000 7fa046059640 1 -- 172.21.15.94:0/1372433774 wait complete. 2023-10-16T08:51:50.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.401+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 shutdown_connections 2023-10-16T08:51:50.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.401+0000 7f50d02da640 1 -- 172.21.15.94:0/1622276678 wait complete. 2023-10-16T08:51:50.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.404+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 --> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0880d07b0 con 0x7fa074074500 2023-10-16T08:51:50.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.405+0000 7fa06ffff640 1 -- 172.21.15.94:0/2229555681 <== osd.4 v2:172.21.15.130:6824/4232198053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa080034440 con 0x7fa074074500 2023-10-16T08:51:50.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.406+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] conn(0x7fa074074500 msgr2=0x7fa074076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.406+0000 7fa08cfd0640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.130:6824/4232198053,v1:172.21.15.130:6825/4232198053] conn(0x7fa074074500 0x7fa074076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.407+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa07406aec0 msgr2=0x7fa07406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.407+0000 7fa08cfd0640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa07406aec0 0x7fa07406d380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa078004980 tx=0x7fa078007ec0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.407+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0880cf210 msgr2=0x7fa0880b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.407+0000 7fa08cfd0640 1 --2- 172.21.15.94:0/2229555681 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa0880cf210 0x7fa0880b5460 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00e850 tx=0x7fa07c00ed10 comp rx=0 tx=0).stop 2023-10-16T08:51:50.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.407+0000 7fa087fff640 1 -- 172.21.15.94:0/2229555681 reap_dead start 2023-10-16T08:51:50.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.408+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 shutdown_connections 2023-10-16T08:51:50.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.408+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 >> 172.21.15.94:0/2229555681 conn(0x7fa088089f70 msgr2=0x7fa0880af750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.408+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 shutdown_connections 2023-10-16T08:51:50.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.408+0000 7fa08cfd0640 1 -- 172.21.15.94:0/2229555681 wait complete. 2023-10-16T08:51:50.514 INFO:teuthology.orchestra.run.smithi094.stdout:60129542155 2023-10-16T08:51:50.515 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T08:51:50.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.412+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 --> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0848050060 con 0x7f0834074400 2023-10-16T08:51:50.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.412+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 --> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ecc005c20 con 0x7f5ecc0015e0 2023-10-16T08:51:50.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.413+0000 7f5ee5ffb640 1 -- 172.21.15.94:0/510280931 <== osd.6 v2:172.21.15.130:6800/973414917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ecc005c20 con 0x7f5ecc0015e0 2023-10-16T08:51:50.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.413+0000 7f0845ffb640 1 -- 172.21.15.94:0/483901689 <== osd.7 v2:172.21.15.130:6816/3792799510 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0834076f10 con 0x7f0834074400 2023-10-16T08:51:50.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] conn(0x7f0834074400 msgr2=0x7f0834076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] conn(0x7f5ecc0015e0 msgr2=0x7f5ecc003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f5eeef65640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.130:6800/973414917,v1:172.21.15.130:6802/973414917] conn(0x7f5ecc0015e0 0x7f5ecc003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f08567e9640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:6816/3792799510,v1:172.21.15.130:6817/3792799510] conn(0x7f0834074400 0x7f0834076840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.519 INFO:teuthology.orchestra.run.smithi094.stdout:60129542155 2023-10-16T08:51:50.519 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T08:51:50.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ec806ae70 msgr2=0x7f5ec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f5eeef65640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ec806ae70 0x7f5ec806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81511d0 tx=0x7f5ed003e040 comp rx=0 tx=0).stop 2023-10-16T08:51:50.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f083406ae40 msgr2=0x7f083406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f08567e9640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f083406ae40 0x7f083406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0840036000 tx=0x7f084003c040 comp rx=0 tx=0).stop 2023-10-16T08:51:50.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480eb2c0 msgr2=0x7f084817bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.414+0000 7f08567e9640 1 --2- 172.21.15.94:0/483901689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08480eb2c0 0x7f084817bd30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0850063ab0 tx=0x7f0850072520 comp rx=0 tx=0).stop 2023-10-16T08:51:50.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 msgr2=0x7f5ee80b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f5eeef65640 1 --2- 172.21.15.94:0/510280931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ee80b83b0 0x7f5ee80b2410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800ebc0 tx=0x7f5ed800c490 comp rx=0 tx=0).stop 2023-10-16T08:51:50.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f0855fe8640 1 -- 172.21.15.94:0/483901689 reap_dead start 2023-10-16T08:51:50.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 shutdown_connections 2023-10-16T08:51:50.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 >> 172.21.15.94:0/483901689 conn(0x7f0848054c10 msgr2=0x7f0848037c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f5eed502640 1 -- 172.21.15.94:0/510280931 reap_dead start 2023-10-16T08:51:50.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 shutdown_connections 2023-10-16T08:51:50.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.415+0000 7f08567e9640 1 -- 172.21.15.94:0/483901689 wait complete. 2023-10-16T08:51:50.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.416+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 shutdown_connections 2023-10-16T08:51:50.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.416+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 >> 172.21.15.94:0/510280931 conn(0x7f5ee8071510 msgr2=0x7f5ee80d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.416+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 shutdown_connections 2023-10-16T08:51:50.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.416+0000 7f5eeef65640 1 -- 172.21.15.94:0/510280931 wait complete. 2023-10-16T08:51:50.525 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:50.526 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T08:51:50.527 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:50.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T08:51:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:60129542155 2023-10-16T08:51:50.528 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T08:51:50.529 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:50.529 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T08:51:50.530 INFO:teuthology.orchestra.run.smithi094.stdout:64424509451 2023-10-16T08:51:50.531 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T08:51:50.532 INFO:teuthology.orchestra.run.smithi094.stdout:64424509452 2023-10-16T08:51:50.532 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T08:51:50.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.873+0000 7f519f240640 1 Processor -- start 2023-10-16T08:51:50.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.873+0000 7f519f240640 1 -- start start 2023-10-16T08:51:50.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.873+0000 7fc82759e640 1 Processor -- start 2023-10-16T08:51:50.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.874+0000 7fc82759e640 1 -- start start 2023-10-16T08:51:50.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.876+0000 7f519f240640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f5190053d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.876+0000 7f519f240640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51900542d0 0x7f51900573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.876+0000 7fc82759e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8200543f0 0x7fc820056cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc82759e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc820057230 0x7fc82003c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc82759e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc820054880 con 0x7fc8200e34a0 2023-10-16T08:51:50.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc82759e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc820058dd0 con 0x7fc820057230 2023-10-16T08:51:50.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc82759e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc820057b90 con 0x7fc8200543f0 2023-10-16T08:51:50.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.876+0000 7f519f240640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5190006e80 con 0x7f51900e3190 2023-10-16T08:51:50.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7f519f240640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519003f100 con 0x7f51900542d0 2023-10-16T08:51:50.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7f519f240640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5190007c40 con 0x7f5190038180 2023-10-16T08:51:50.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7f519da3d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f5190053d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7f519da3d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f5190053d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47014/0 (socket says 172.21.15.94:47014) 2023-10-16T08:51:50.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7f519da3d640 1 -- 172.21.15.94:0/1592253752 learned_addr learned my addr 172.21.15.94:0/1592253752 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc825d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc8200543f0 0x7fc820056cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7f519ea3f640 1 --2- 172.21.15.94:0/1592253752 >> v2:172.21.15.130:3300/0 conn(0x7f51900542d0 0x7f51900573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc82659c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc8200e34a0 0x7fc8200582c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50902/0 (socket says 172.21.15.94:50902) 2023-10-16T08:51:50.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc82659c640 1 -- 172.21.15.94:0/2960854685 learned_addr learned my addr 172.21.15.94:0/2960854685 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.877+0000 7fc826d9d640 1 --2- 172.21.15.94:0/2960854685 >> v2:172.21.15.94:3300/0 conn(0x7fc820057230 0x7fc82003c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.879+0000 7f519da3d640 1 -- 172.21.15.94:0/1592253752 >> v2:172.21.15.130:3300/0 conn(0x7f51900542d0 msgr2=0x7f51900573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.878+0000 7fc825d9b640 1 -- 172.21.15.94:0/2960854685 >> v2:172.21.15.94:3300/0 conn(0x7fc820057230 msgr2=0x7fc82003c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.878+0000 7fc825d9b640 1 --2- 172.21.15.94:0/2960854685 >> v2:172.21.15.94:3300/0 conn(0x7fc820057230 0x7fc82003c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.878+0000 7fc825d9b640 1 -- 172.21.15.94:0/2960854685 >> v1:172.21.15.94:6789/0 conn(0x7fc8200e34a0 legacy=0x7fc8200582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.878+0000 7fc825d9b640 1 -- 172.21.15.94:0/2960854685 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820057e70 con 0x7fc8200543f0 2023-10-16T08:51:50.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.879+0000 7f519da3d640 1 --2- 172.21.15.94:0/1592253752 >> v2:172.21.15.130:3300/0 conn(0x7f51900542d0 0x7f51900573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.879+0000 7f519da3d640 1 -- 172.21.15.94:0/1592253752 >> v1:172.21.15.94:6789/0 conn(0x7f51900e3190 legacy=0x7f519003e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.879+0000 7f519da3d640 1 -- 172.21.15.94:0/1592253752 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190007160 con 0x7f5190038180 2023-10-16T08:51:50.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.880+0000 7fc825d9b640 1 --2- 172.21.15.94:0/2960854685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820056cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc828063e40 tx=0x7fc8280a5490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17295680d9375db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.880+0000 7f213b22b640 1 Processor -- start 2023-10-16T08:51:50.886 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.880+0000 7f213b22b640 1 -- start start 2023-10-16T08:51:50.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.881+0000 7fc82559a640 1 -- 172.21.15.94:0/2960854685 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280ac600 con 0x7fc8200543f0 2023-10-16T08:51:50.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.881+0000 7f519da3d640 1 --2- 172.21.15.94:0/1592253752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f5190053d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5188009870 tx=0x7f518802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1f3ae6982b31a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7fc82559a640 1 -- 172.21.15.94:0/2960854685 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280a8050 con 0x7fc8200543f0 2023-10-16T08:51:50.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f519d23c640 1 -- 172.21.15.94:0/1592253752 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188030860 con 0x7f5190038180 2023-10-16T08:51:50.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f519d23c640 1 -- 172.21.15.94:0/1592253752 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51880309c0 con 0x7f5190038180 2023-10-16T08:51:50.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f519d23c640 1 -- 172.21.15.94:0/1592253752 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188030d30 con 0x7f5190038180 2023-10-16T08:51:50.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f213b22b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f21340c46b0 0x7f21340c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f213b22b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340ce7f0 con 0x7f213406a430 2023-10-16T08:51:50.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7fc82559a640 1 -- 172.21.15.94:0/2960854685 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280aca20 con 0x7fc8200543f0 2023-10-16T08:51:50.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7fc82759e640 1 -- 172.21.15.94:0/2960854685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 msgr2=0x7fc820056cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7fc82759e640 1 --2- 172.21.15.94:0/2960854685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820056cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc828063e40 tx=0x7fc8280a5490 comp rx=0 tx=0).stop 2023-10-16T08:51:50.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7fc82759e640 1 -- 172.21.15.94:0/2960854685 shutdown_connections 2023-10-16T08:51:50.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7fc82759e640 1 --2- 172.21.15.94:0/2960854685 >> v2:172.21.15.94:3300/0 conn(0x7fc820057230 0x7fc82003c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7fc82759e640 1 --2- 172.21.15.94:0/2960854685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820056cf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7f519f240640 1 -- 172.21.15.94:0/1592253752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 msgr2=0x7f5190053d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7f519f240640 1 --2- 172.21.15.94:0/1592253752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f5190053d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5188009870 tx=0x7f518802b9a0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7fc82759e640 1 -- 172.21.15.94:0/2960854685 >> 172.21.15.94:0/2960854685 conn(0x7fc820059120 msgr2=0x7fc820059530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7fc82759e640 1 -- 172.21.15.94:0/2960854685 shutdown_connections 2023-10-16T08:51:50.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f213b22b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2134069fa0 con 0x7f21341569c0 2023-10-16T08:51:50.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.882+0000 7f213b22b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340c50a0 con 0x7f21340c46b0 2023-10-16T08:51:50.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7f2133fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f21340c46b0 0x7f21340c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7f2133fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f21340c46b0 0x7f21340c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58180/0 (socket says 172.21.15.94:58180) 2023-10-16T08:51:50.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.883+0000 7f2133fff640 1 -- 172.21.15.94:0/3759342827 learned_addr learned my addr 172.21.15.94:0/3759342827 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7fc82759e640 1 -- 172.21.15.94:0/2960854685 wait complete. 2023-10-16T08:51:50.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7f2133fff640 1 -- 172.21.15.94:0/3759342827 >> v1:172.21.15.130:6789/0 conn(0x7f21341569c0 legacy=0x7f21340cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7f2133fff640 1 -- 172.21.15.94:0/3759342827 >> v1:172.21.15.94:6789/0 conn(0x7f213406a430 legacy=0x7f213406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7f519f240640 1 -- 172.21.15.94:0/1592253752 shutdown_connections 2023-10-16T08:51:50.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7f519f240640 1 --2- 172.21.15.94:0/1592253752 >> v2:172.21.15.130:3300/0 conn(0x7f51900542d0 0x7f51900573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7f519f240640 1 --2- 172.21.15.94:0/1592253752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f5190053d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.884+0000 7f519f240640 1 -- 172.21.15.94:0/1592253752 >> 172.21.15.94:0/1592253752 conn(0x7f51900590c0 msgr2=0x7f51900594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.885+0000 7f519f240640 1 -- 172.21.15.94:0/1592253752 shutdown_connections 2023-10-16T08:51:50.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.885+0000 7f2133fff640 1 -- 172.21.15.94:0/3759342827 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340cdf50 con 0x7f21340c46b0 2023-10-16T08:51:50.896 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.885+0000 7f519f240640 1 -- 172.21.15.94:0/1592253752 wait complete. 2023-10-16T08:51:50.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.886+0000 7fc82759e640 1 Processor -- start 2023-10-16T08:51:50.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.887+0000 7fc82759e640 1 -- start start 2023-10-16T08:51:50.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.887+0000 7f2133fff640 1 --2- 172.21.15.94:0/3759342827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21340c46b0 0x7f21340c4b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2124009870 tx=0x7f212402cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aef68fb8beed18b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.888+0000 7f519f240640 1 Processor -- start 2023-10-16T08:51:50.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.888+0000 7f21337fe640 1 -- 172.21.15.94:0/3759342827 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212402e870 con 0x7f21340c46b0 2023-10-16T08:51:50.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.888+0000 7f21337fe640 1 -- 172.21.15.94:0/3759342827 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212402e9d0 con 0x7f21340c46b0 2023-10-16T08:51:50.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.888+0000 7f21337fe640 1 -- 172.21.15.94:0/3759342827 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212402ed60 con 0x7f21340c46b0 2023-10-16T08:51:50.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.889+0000 7f519f240640 1 -- start start 2023-10-16T08:51:50.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.889+0000 7fc82759e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820050c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.889+0000 7f213b22b640 1 -- 172.21.15.94:0/3759342827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21340c46b0 msgr2=0x7f21340c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.889+0000 7fc82759e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc820057230 0x7fc820180640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.889+0000 7f213b22b640 1 --2- 172.21.15.94:0/3759342827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21340c46b0 0x7f21340c4b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2124009870 tx=0x7f212402cab0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.890+0000 7f213b22b640 1 -- 172.21.15.94:0/3759342827 shutdown_connections 2023-10-16T08:51:50.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.890+0000 7f213b22b640 1 --2- 172.21.15.94:0/3759342827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21340c46b0 0x7f21340c4b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.890+0000 7f213b22b640 1 -- 172.21.15.94:0/3759342827 >> 172.21.15.94:0/3759342827 conn(0x7f21340cb830 msgr2=0x7f21340cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.890+0000 7fc82759e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 0x7fc820180b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.890+0000 7fc82659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820050c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f519f240640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f51900def20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.890+0000 7fc826d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 0x7fc820180b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7fc826d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 0x7fc820180b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57012/0 (socket says 172.21.15.94:57012) 2023-10-16T08:51:50.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f213b22b640 1 -- 172.21.15.94:0/3759342827 shutdown_connections 2023-10-16T08:51:50.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7fc826d9d640 1 -- 172.21.15.94:0/1964560900 learned_addr learned my addr 172.21.15.94:0/1964560900 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f519f240640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51900542d0 0x7f519003d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f213b22b640 1 -- 172.21.15.94:0/3759342827 wait complete. 2023-10-16T08:51:50.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc820009f70 con 0x7fc8200e34a0 2023-10-16T08:51:50.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f519f240640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900e3190 0x7f519003d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f519e23e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f51900def20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7f519e23e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f51900def20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47024/0 (socket says 172.21.15.94:47024) 2023-10-16T08:51:50.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7f519e23e640 1 -- 172.21.15.94:0/2162458658 learned_addr learned my addr 172.21.15.94:0/2162458658 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519000d8e0 con 0x7f51900542d0 2023-10-16T08:51:50.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519000dd00 con 0x7f51900e3190 2023-10-16T08:51:50.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7f519ea3f640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900e3190 0x7f519003d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc820051140 con 0x7fc8200543f0 2023-10-16T08:51:50.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900df460 con 0x7f5190038180 2023-10-16T08:51:50.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519da3d640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51900542d0 0x7f519003d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200513c0 con 0x7fc820057230 2023-10-16T08:51:50.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7fc826d9d640 1 -- 172.21.15.94:0/1964560900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc820057230 msgr2=0x7fc820180640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T08:51:50.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7fc826d9d640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc820057230 0x7fc820180640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7fc826d9d640 1 -- 172.21.15.94:0/1964560900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 msgr2=0x7fc820050c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7fc826d9d640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820050c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7fc826d9d640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828073860 con 0x7fc8200e34a0 2023-10-16T08:51:50.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.892+0000 7fc826d9d640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 0x7fc820180b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00d5d0 tx=0x7fc81c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519da3d640 1 -- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 msgr2=0x7f51900def20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519da3d640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f51900def20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519da3d640 1 -- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900e3190 msgr2=0x7f519003d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519da3d640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900e3190 0x7f519003d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f519da3d640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880094d0 con 0x7f51900542d0 2023-10-16T08:51:50.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f213b22b640 1 Processor -- start 2023-10-16T08:51:50.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f66e4e1a640 1 Processor -- start 2023-10-16T08:51:50.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.891+0000 7f66e4e1a640 1 -- start start 2023-10-16T08:51:50.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f66e4e1a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cfba0 0x7f66e01614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f66e4e1a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f66e00b1e30 0x7f66e01652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f66e4e1a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66e00cd000 0x7f66e00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f66e4e1a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0164ed0 con 0x7f66e00cd000 2023-10-16T08:51:50.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f66e4e1a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e00cd970 con 0x7f66e00b1e30 2023-10-16T08:51:50.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.893+0000 7f66e4e1a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e0164b60 con 0x7f66e00cfba0 2023-10-16T08:51:50.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f66ded9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66e00cd000 0x7f66e00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f66de59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cfba0 0x7f66e01614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f66ddd9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f66e00b1e30 0x7f66e01652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f66de59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cfba0 0x7f66e01614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47034/0 (socket says 172.21.15.94:47034) 2023-10-16T08:51:50.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f66de59c640 1 -- 172.21.15.94:0/3388405469 learned_addr learned my addr 172.21.15.94:0/3388405469 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f66ded9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66e00cd000 0x7f66e00cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57028/0 (socket says 172.21.15.94:57028) 2023-10-16T08:51:50.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f519da3d640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51900542d0 0x7f519003d1f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5188033000 tx=0x7f51880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7f213b22b640 1 -- start start 2023-10-16T08:51:50.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.894+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0125f0 con 0x7fc8200e34a0 2023-10-16T08:51:50.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f519e23e640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f51900def20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:50.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c012750 con 0x7fc8200e34a0 2023-10-16T08:51:50.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc820051700 con 0x7fc8200e34a0 2023-10-16T08:51:50.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0125f0 con 0x7fc8200e34a0 2023-10-16T08:51:50.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc820051f40 con 0x7fc8200e34a0 2023-10-16T08:51:50.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f66ded9d640 1 -- 172.21.15.94:0/3388405469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cfba0 msgr2=0x7f66e01614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f66ded9d640 1 --2- 172.21.15.94:0/3388405469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cfba0 0x7f66e01614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f66ded9d640 1 -- 172.21.15.94:0/3388405469 >> v2:172.21.15.130:3300/0 conn(0x7f66e00b1e30 msgr2=0x7f66e01652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f66ded9d640 1 --2- 172.21.15.94:0/3388405469 >> v2:172.21.15.130:3300/0 conn(0x7f66e00b1e30 0x7f66e01652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f66ded9d640 1 -- 172.21.15.94:0/3388405469 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e015b9b0 con 0x7f66e00cd000 2023-10-16T08:51:50.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518803e070 con 0x7f51900542d0 2023-10-16T08:51:50.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.895+0000 7f519ea3f640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900e3190 0x7f519003d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:50.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519000cc60 con 0x7f51900542d0 2023-10-16T08:51:50.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519000d220 con 0x7f51900542d0 2023-10-16T08:51:50.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188003610 con 0x7f51900542d0 2023-10-16T08:51:50.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518803e070 con 0x7f51900542d0 2023-10-16T08:51:50.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7f213b22b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 0x7f2134154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7f213b22b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21340c46b0 0x7f2134155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7f213b22b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21341569c0 0x7f21341f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f2138fc7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 0x7f2134154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f213b22b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340c92b0 con 0x7f21340c46b0 2023-10-16T08:51:50.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f213b22b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134155c70 con 0x7f21341569c0 2023-10-16T08:51:50.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f213b22b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21340c8630 con 0x7f213406a430 2023-10-16T08:51:50.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f2138fc7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 0x7f2134154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47046/0 (socket says 172.21.15.94:47046) 2023-10-16T08:51:50.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f2133fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21340c46b0 0x7f2134155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f2138fc7640 1 -- 172.21.15.94:0/31140166 learned_addr learned my addr 172.21.15.94:0/31140166 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.896+0000 7fe08996e640 1 Processor -- start 2023-10-16T08:51:50.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.897+0000 7f21397c8640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21341569c0 0x7f21341f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7fe08996e640 1 -- start start 2023-10-16T08:51:50.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82003f130 con 0x7fc8200e34a0 2023-10-16T08:51:50.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5180005250 con 0x7f51900542d0 2023-10-16T08:51:50.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7f21397c8640 1 -- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 msgr2=0x7f2134154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7f21397c8640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 0x7f2134154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7f21397c8640 1 -- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21340c46b0 msgr2=0x7f2134155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.898+0000 7f66ded9d640 1 --2- 172.21.15.94:0/3388405469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00cd000 0x7f66e00cd430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f66e00d3a40 tx=0x7f66c802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b98a27e355750f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.899+0000 7f21397c8640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21340c46b0 0x7f2134155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.899+0000 7f21397c8640 1 -- 172.21.15.94:0/31140166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240094d0 con 0x7f21341569c0 2023-10-16T08:51:50.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc81c0128c0 con 0x7fc8200e34a0 2023-10-16T08:51:50.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7f2138fc7640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 0x7f2134154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:50.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5188042070 con 0x7f51900542d0 2023-10-16T08:51:50.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fe08996e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe084158b40 0x7fe0840ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fe08996e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe08406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fe08996e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe0840b01b0 0x7fe0840b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fe08996e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08406d6e0 con 0x7fe0840b01b0 2023-10-16T08:51:50.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fe08996e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08406cc40 con 0x7fe084158b40 2023-10-16T08:51:50.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.900+0000 7fe08996e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840b0b80 con 0x7fe08406c2a0 2023-10-16T08:51:50.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.901+0000 7fe0827fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe08406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.901+0000 7f21397c8640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21341569c0 0x7f21341f30c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f212c00c730 tx=0x7f212c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.901+0000 7fe0827fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe08406c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47060/0 (socket says 172.21.15.94:47060) 2023-10-16T08:51:50.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.901+0000 7fe0827fc640 1 -- 172.21.15.94:0/3841929515 learned_addr learned my addr 172.21.15.94:0/3841929515 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.901+0000 7fe0837fe640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.94:3300/0 conn(0x7fe0840b01b0 0x7fe0840b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.901+0000 7f7512105640 1 Processor -- start 2023-10-16T08:51:50.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c003b70 con 0x7f21341569c0 2023-10-16T08:51:50.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7f7512105640 1 -- start start 2023-10-16T08:51:50.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7fe082ffd640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.130:3300/0 conn(0x7fe084158b40 0x7fe0840ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7fe0827fc640 1 -- 172.21.15.94:0/3841929515 >> v2:172.21.15.130:3300/0 conn(0x7fe084158b40 msgr2=0x7fe0840ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7fe0827fc640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.130:3300/0 conn(0x7fe084158b40 0x7fe0840ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7fe0827fc640 1 -- 172.21.15.94:0/3841929515 >> v2:172.21.15.94:3300/0 conn(0x7fe0840b01b0 msgr2=0x7fe0840b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7fe0827fc640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.94:3300/0 conn(0x7fe0840b01b0 0x7fe0840b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7fe0827fc640 1 -- 172.21.15.94:0/3841929515 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840c8fb0 con 0x7fe08406c2a0 2023-10-16T08:51:50.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7fc816ffd640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc80806aed0 0x7fc80806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c003cf0 con 0x7f21341569c0 2023-10-16T08:51:50.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c003ea0 con 0x7f21341569c0 2023-10-16T08:51:50.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7fe0837fe640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.94:3300/0 conn(0x7fe0840b01b0 0x7fe0840b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:50.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7fe082ffd640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.130:3300/0 conn(0x7fe084158b40 0x7fe0840ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:50.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7f213b22b640 1 -- 172.21.15.94:0/31140166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21340c8910 con 0x7f21341569c0 2023-10-16T08:51:50.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.903+0000 7f213b22b640 1 -- 172.21.15.94:0/31140166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21340c8ed0 con 0x7f21341569c0 2023-10-16T08:51:50.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f7512105640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f750c15d700 0x7f750c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f7512105640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f7512105640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c15a2c0 con 0x7f750c06d440 2023-10-16T08:51:50.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f7512105640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c15a5a0 con 0x7f750c15d700 2023-10-16T08:51:50.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f7512105640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c15a880 con 0x7f750c15dae0 2023-10-16T08:51:50.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f750b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f750c15d700 0x7f750c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7f518effd640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f517c06ae90 0x7f517c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.902+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51880abb50 con 0x7f51900542d0 2023-10-16T08:51:50.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f750b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f750c15d700 0x7f750c159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57044/0 (socket says 172.21.15.94:57044) 2023-10-16T08:51:50.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f750b7fe640 1 -- 172.21.15.94:0/2712870511 learned_addr learned my addr 172.21.15.94:0/2712870511 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7f750affd640 1 --2- 172.21.15.94:0/2712870511 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.904+0000 7fc82659c640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc80806aed0 0x7fc80806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc81c08e080 con 0x7fc8200e34a0 2023-10-16T08:51:50.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7f519e23e640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f517c06ae90 0x7f517c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7fe0827fc640 1 --2- 172.21.15.94:0/3841929515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe08406c700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0840cc420 tx=0x7fe07c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834a8e069a3cb398 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7f750b7fe640 1 -- 172.21.15.94:0/2712870511 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 msgr2=0x7f750c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7f750b7fe640 1 --2- 172.21.15.94:0/2712870511 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7f750b7fe640 1 -- 172.21.15.94:0/2712870511 >> v1:172.21.15.94:6789/0 conn(0x7f750c06d440 legacy=0x7f750c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7f750b7fe640 1 -- 172.21.15.94:0/2712870511 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c15ab60 con 0x7f750c15d700 2023-10-16T08:51:50.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.905+0000 7f213b22b640 1 -- 172.21.15.94:0/31140166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21340c93f0 con 0x7f21341569c0 2023-10-16T08:51:50.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.906+0000 7fe081ffb640 1 -- 172.21.15.94:0/3841929515 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c02ca80 con 0x7fe08406c2a0 2023-10-16T08:51:50.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.906+0000 7f519e23e640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f517c06ae90 0x7f517c06d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5198068e70 tx=0x7f519806e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.906+0000 7fc82659c640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc80806aed0 0x7fc80806d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc818007fd0 tx=0x7fc818007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.906+0000 7fe081ffb640 1 -- 172.21.15.94:0/3841929515 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c02cbe0 con 0x7fe08406c2a0 2023-10-16T08:51:50.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.906+0000 7fe081ffb640 1 -- 172.21.15.94:0/3841929515 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0343f0 con 0x7fe08406c2a0 2023-10-16T08:51:50.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 -- 172.21.15.94:0/3841929515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 msgr2=0x7fe08406c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 --2- 172.21.15.94:0/3841929515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe08406c700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0840cc420 tx=0x7fe07c02bee0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7f750b7fe640 1 --2- 172.21.15.94:0/2712870511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c159c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7504009870 tx=0x7f750402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18472cf070926993 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 -- 172.21.15.94:0/3841929515 shutdown_connections 2023-10-16T08:51:50.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.94:3300/0 conn(0x7fe0840b01b0 0x7fe0840b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 --2- 172.21.15.94:0/3841929515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe08406c700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 --2- 172.21.15.94:0/3841929515 >> v2:172.21.15.130:3300/0 conn(0x7fe084158b40 0x7fe0840ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 -- 172.21.15.94:0/3841929515 >> 172.21.15.94:0/3841929515 conn(0x7fe08406a440 msgr2=0x7fe0840cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 -- 172.21.15.94:0/3841929515 shutdown_connections 2023-10-16T08:51:50.948 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fe08996e640 1 -- 172.21.15.94:0/3841929515 wait complete. 2023-10-16T08:51:50.948 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.907+0000 7fc045339640 1 Processor -- start 2023-10-16T08:51:50.948 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.908+0000 7fc045339640 1 -- start start 2023-10-16T08:51:50.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.908+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f212c005310 con 0x7f21341569c0 2023-10-16T08:51:50.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.908+0000 7f66dd59a640 1 -- 172.21.15.94:0/3388405469 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8031710 con 0x7f66e00cd000 2023-10-16T08:51:50.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.908+0000 7f750a7fc640 1 -- 172.21.15.94:0/2712870511 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504031870 con 0x7f750c15d700 2023-10-16T08:51:50.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.909+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51880769b0 con 0x7f51900542d0 2023-10-16T08:51:50.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.909+0000 7f21317fa640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f212006aec0 0x7f212006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.909+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f212c089730 con 0x7f21341569c0 2023-10-16T08:51:50.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.909+0000 7fe08996e640 1 Processor -- start 2023-10-16T08:51:50.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc045339640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc0400aebb0 0x7fc04006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc045339640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400cec00 0x7fc0400cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc045339640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400cd400 con 0x7fc0401607b0 2023-10-16T08:51:50.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7f2138fc7640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f212006aec0 0x7f212006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc045339640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400cf540 con 0x7fc0400aebb0 2023-10-16T08:51:50.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc045339640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cd6a0 con 0x7fc0400cec00 2023-10-16T08:51:50.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fe08996e640 1 -- start start 2023-10-16T08:51:50.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc03effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc0400aebb0 0x7fc04006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.910+0000 7fc03e7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400cec00 0x7fc0400cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fc03effd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc0400aebb0 0x7fc04006ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58236/0 (socket says 172.21.15.94:58236) 2023-10-16T08:51:50.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fc03effd640 1 -- 172.21.15.94:0/2347622037 learned_addr learned my addr 172.21.15.94:0/2347622037 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7f2138fc7640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f212006aec0 0x7f212006d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2134202040 tx=0x7f2128009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fc03effd640 1 -- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400cec00 msgr2=0x7fc0400cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fc03effd640 1 --2- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400cec00 0x7fc0400cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fc03effd640 1 -- 172.21.15.94:0/2347622037 >> v1:172.21.15.130:6789/0 conn(0x7fc0401607b0 legacy=0x7fc040160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fc03effd640 1 -- 172.21.15.94:0/2347622037 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400cd980 con 0x7fc0400aebb0 2023-10-16T08:51:50.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fe08996e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe0841f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fe08996e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0840b01b0 0x7fe0841f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fe08996e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe084158b40 0x7fe0841f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fe08996e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840af700 con 0x7fe084158b40 2023-10-16T08:51:50.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fe08996e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840aeef0 con 0x7fe0840b01b0 2023-10-16T08:51:50.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.911+0000 7fe08996e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841f97d0 con 0x7fe08406c2a0 2023-10-16T08:51:50.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.912+0000 7fe0837fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe084158b40 0x7fe0841f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.912+0000 7fe082ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe0841f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.912+0000 7fe0837fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe084158b40 0x7fe0841f9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57046/0 (socket says 172.21.15.94:57046) 2023-10-16T08:51:50.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.912+0000 7fe0837fe640 1 -- 172.21.15.94:0/1499164595 learned_addr learned my addr 172.21.15.94:0/1499164595 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.912+0000 7fe0827fc640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0840b01b0 0x7fe0841f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe082ffd640 1 -- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0840b01b0 msgr2=0x7fe0841f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe082ffd640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0840b01b0 0x7fe0841f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe082ffd640 1 -- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe084158b40 msgr2=0x7fe0841f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe082ffd640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe084158b40 0x7fe0841f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe082ffd640 1 -- 172.21.15.94:0/1499164595 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074008480 con 0x7fe08406c2a0 2023-10-16T08:51:50.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fc03effd640 1 --2- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400aebb0 0x7fc04006ea60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc030009850 tx=0x7fc03002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=345640d8441e4111 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe082ffd640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe0841f6e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe07800d5c0 tx=0x7fe07800da80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fee58d00640 1 Processor -- start 2023-10-16T08:51:50.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fee58d00640 1 -- start start 2023-10-16T08:51:50.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.913+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078004030 con 0x7fe08406c2a0 2023-10-16T08:51:50.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.914+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe078004190 con 0x7fe08406c2a0 2023-10-16T08:51:50.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.914+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078014620 con 0x7fe08406c2a0 2023-10-16T08:51:50.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.914+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c009b30 con 0x7fe08406c2a0 2023-10-16T08:51:50.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.914+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0840c3470 con 0x7fe08406c2a0 2023-10-16T08:51:50.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee58d00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee540aebb0 0x7fee5406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee58d00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee5406cf60 0x7fee5406d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee58d00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540cd400 con 0x7fee540cec00 2023-10-16T08:51:50.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee58d00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540cd6a0 con 0x7fee5406cf60 2023-10-16T08:51:50.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee58d00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540cd980 con 0x7fee540aebb0 2023-10-16T08:51:50.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe084073ef0 con 0x7fe08406c2a0 2023-10-16T08:51:50.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee4bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fee540cec00 0x7fee540cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50940/0 (socket says 172.21.15.94:50940) 2023-10-16T08:51:50.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee4bfff640 1 -- 172.21.15.94:0/1112674972 learned_addr learned my addr 172.21.15.94:0/1112674972 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:50.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee52d9d640 1 --2- 172.21.15.94:0/1112674972 >> v2:172.21.15.130:3300/0 conn(0x7fee5406cf60 0x7fee5406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.915+0000 7fee5259c640 1 --2- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee540aebb0 0x7fee5406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.916+0000 7fee52d9d640 1 -- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee540aebb0 msgr2=0x7fee5406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:50.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.916+0000 7fee52d9d640 1 --2- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee540aebb0 0x7fee5406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.916+0000 7fee52d9d640 1 -- 172.21.15.94:0/1112674972 >> v1:172.21.15.94:6789/0 conn(0x7fee540cec00 legacy=0x7fee540cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.916+0000 7fee52d9d640 1 -- 172.21.15.94:0/1112674972 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540cdc60 con 0x7fee5406cf60 2023-10-16T08:51:50.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.917+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe078014780 con 0x7fe08406c2a0 2023-10-16T08:51:50.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.917+0000 7fee52d9d640 1 --2- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee5406cf60 0x7fee5406d410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009d90 tx=0x7fee4c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cff5097480c9ac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.917+0000 7fe06bfff640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe07006ae70 0x7fe07006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe078089f90 con 0x7fe08406c2a0 2023-10-16T08:51:50.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7fe0827fc640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe07006ae70 0x7fe07006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7f750a7fc640 1 -- 172.21.15.94:0/2712870511 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040319d0 con 0x7f750c15d700 2023-10-16T08:51:50.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7f750a7fc640 1 -- 172.21.15.94:0/2712870511 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504031da0 con 0x7f750c15d700 2023-10-16T08:51:50.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7fe0827fc640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe07006ae70 0x7fe07006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe07c035000 tx=0x7fe07c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc81c0546a0 con 0x7fc8200e34a0 2023-10-16T08:51:50.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.918+0000 7f66dd59a640 1 -- 172.21.15.94:0/3388405469 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c802f050 con 0x7f66e00cd000 2023-10-16T08:51:50.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66dd59a640 1 -- 172.21.15.94:0/3388405469 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8031a90 con 0x7f66e00cd000 2023-10-16T08:51:50.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 -- 172.21.15.94:0/3388405469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00cd000 msgr2=0x7f66e00cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/3388405469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00cd000 0x7f66e00cd430 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f66e00d3a40 tx=0x7f66c802b7b0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f7512105640 1 -- 172.21.15.94:0/2712870511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 msgr2=0x7f750c159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 -- 172.21.15.94:0/3388405469 shutdown_connections 2023-10-16T08:51:50.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/3388405469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00cd000 0x7f66e00cd430 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/3388405469 >> v2:172.21.15.130:3300/0 conn(0x7f66e00b1e30 0x7f66e01652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/3388405469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cfba0 0x7f66e01614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f66e4e1a640 1 -- 172.21.15.94:0/3388405469 >> 172.21.15.94:0/3388405469 conn(0x7f66e0071510 msgr2=0x7f66e0071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f7512105640 1 --2- 172.21.15.94:0/2712870511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c159c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7504009870 tx=0x7f750402b910 comp rx=0 tx=0).stop 2023-10-16T08:51:50.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f7512105640 1 -- 172.21.15.94:0/2712870511 shutdown_connections 2023-10-16T08:51:50.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.919+0000 7f7512105640 1 --2- 172.21.15.94:0/2712870511 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.920+0000 7f7512105640 1 --2- 172.21.15.94:0/2712870511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c159c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.920+0000 7f7512105640 1 -- 172.21.15.94:0/2712870511 >> 172.21.15.94:0/2712870511 conn(0x7f750c0cb1b0 msgr2=0x7f750c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.920+0000 7f66e4e1a640 1 -- 172.21.15.94:0/3388405469 shutdown_connections 2023-10-16T08:51:50.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.920+0000 7f7512105640 1 -- 172.21.15.94:0/2712870511 shutdown_connections 2023-10-16T08:51:50.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.920+0000 7f7512105640 1 -- 172.21.15.94:0/2712870511 wait complete. 2023-10-16T08:51:50.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.920+0000 7f66e4e1a640 1 -- 172.21.15.94:0/3388405469 wait complete. 2023-10-16T08:51:50.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.922+0000 7f7512105640 1 Processor -- start 2023-10-16T08:51:50.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.923+0000 7f66e4e1a640 1 Processor -- start 2023-10-16T08:51:50.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.923+0000 7f7512105640 1 -- start start 2023-10-16T08:51:50.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.923+0000 7f66e4e1a640 1 -- start start 2023-10-16T08:51:50.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7fc03dffb640 1 -- 172.21.15.94:0/2347622037 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030004230 con 0x7fc0400aebb0 2023-10-16T08:51:50.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7fee51d9b640 1 -- 172.21.15.94:0/1112674972 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c02cc60 con 0x7fee5406cf60 2023-10-16T08:51:50.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7fc03dffb640 1 -- 172.21.15.94:0/2347622037 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030004390 con 0x7fc0400aebb0 2023-10-16T08:51:50.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7fee51d9b640 1 -- 172.21.15.94:0/1112674972 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c02cdc0 con 0x7fee5406cf60 2023-10-16T08:51:50.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7fc03dffb640 1 -- 172.21.15.94:0/2347622037 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030003810 con 0x7fc0400aebb0 2023-10-16T08:51:50.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7f7512105640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f750c06d440 0x7f750c151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7f7512105640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7f7512105640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7f7512105640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0c5800 con 0x7f750c15d700 2023-10-16T08:51:50.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7f7512105640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c1543f0 con 0x7f750c06d440 2023-10-16T08:51:50.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.924+0000 7f7512105640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0c9240 con 0x7f750c15dae0 2023-10-16T08:51:50.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f750affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f750affd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c0c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57060/0 (socket says 172.21.15.94:57060) 2023-10-16T08:51:50.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f750affd640 1 -- 172.21.15.94:0/4207102845 learned_addr learned my addr 172.21.15.94:0/4207102845 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f750b7fe640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f750c06d440 0x7f750c151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f750bfff640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fc045339640 1 -- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400aebb0 msgr2=0x7fc04006ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fc045339640 1 --2- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400aebb0 0x7fc04006ea60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc030009850 tx=0x7fc03002b960 comp rx=0 tx=0).stop 2023-10-16T08:51:50.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f66e4e1a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00b1e30 0x7f66e00b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f66e4e1a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cd000 0x7f66e00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f66e4e1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 0x7f66e00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:50.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f66e4e1a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00b5330 con 0x7f66e00b1e30 2023-10-16T08:51:50.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f66e4e1a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c9c20 con 0x7f66e00cfba0 2023-10-16T08:51:50.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7f66e4e1a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00b5090 con 0x7f66e00cd000 2023-10-16T08:51:50.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee51d9b640 1 -- 172.21.15.94:0/1112674972 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c034660 con 0x7fee5406cf60 2023-10-16T08:51:50.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee58d00640 1 -- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee5406cf60 msgr2=0x7fee5406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee58d00640 1 --2- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee5406cf60 0x7fee5406d410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009d90 tx=0x7fee4c02beb0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee58d00640 1 -- 172.21.15.94:0/1112674972 shutdown_connections 2023-10-16T08:51:50.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee58d00640 1 --2- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee5406cf60 0x7fee5406d410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee58d00640 1 --2- 172.21.15.94:0/1112674972 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee540aebb0 0x7fee5406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f750affd640 1 -- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 msgr2=0x7f750c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f750affd640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f750affd640 1 -- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f750c06d440 msgr2=0x7f750c151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f750affd640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f750c06d440 0x7f750c151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f750affd640 1 -- 172.21.15.94:0/4207102845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040094d0 con 0x7f750c15d700 2023-10-16T08:51:50.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.925+0000 7fee58d00640 1 -- 172.21.15.94:0/1112674972 >> 172.21.15.94:0/1112674972 conn(0x7fee540989e0 msgr2=0x7fee540cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fc045339640 1 -- 172.21.15.94:0/2347622037 shutdown_connections 2023-10-16T08:51:50.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fc045339640 1 --2- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400cec00 0x7fc0400cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fc045339640 1 --2- 172.21.15.94:0/2347622037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400aebb0 0x7fc04006ea60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fc045339640 1 -- 172.21.15.94:0/2347622037 >> 172.21.15.94:0/2347622037 conn(0x7fc0400989e0 msgr2=0x7fc0400cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:50.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fee58d00640 1 -- 172.21.15.94:0/1112674972 shutdown_connections 2023-10-16T08:51:50.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fc045339640 1 -- 172.21.15.94:0/2347622037 shutdown_connections 2023-10-16T08:51:50.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fee58d00640 1 -- 172.21.15.94:0/1112674972 wait complete. 2023-10-16T08:51:50.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7fc045339640 1 -- 172.21.15.94:0/2347622037 wait complete. 2023-10-16T08:51:50.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f66ded9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 0x7f66e00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f66ddd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cd000 0x7f66e00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f66ded9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 0x7f66e00b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58288/0 (socket says 172.21.15.94:58288) 2023-10-16T08:51:50.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f66ded9d640 1 -- 172.21.15.94:0/1808010332 learned_addr learned my addr 172.21.15.94:0/1808010332 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:50.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.926+0000 7f66de59c640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00b1e30 0x7f66e00b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:50.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f750affd640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c0c86a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f750000e870 tx=0x7f750000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f66ded9d640 1 -- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cd000 msgr2=0x7f66e00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f66ded9d640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cd000 0x7f66e00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f66ded9d640 1 -- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00b1e30 msgr2=0x7f66e00b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:50.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f66ded9d640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00b1e30 0x7f66e00b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f66ded9d640 1 -- 172.21.15.94:0/1808010332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8009400 con 0x7f66e00cfba0 2023-10-16T08:51:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75000094f0 con 0x7f750c15d700 2023-10-16T08:51:50.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f212c0545d0 con 0x7f21341569c0 2023-10-16T08:51:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000c940 con 0x7f750c15d700 2023-10-16T08:51:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.927+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000ccf0 con 0x7f750c15d700 2023-10-16T08:51:50.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c0c9520 con 0x7f750c15d700 2023-10-16T08:51:50.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7fee58d00640 1 Processor -- start 2023-10-16T08:51:50.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7f66de59c640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00b1e30 0x7f66e00b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:50.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7fee58d00640 1 -- start start 2023-10-16T08:51:50.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7f66ded9d640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 0x7f66e00b4b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66c802bdc0 tx=0x7f66c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:50.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.928+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c0c9ae0 con 0x7f750c15d700 2023-10-16T08:51:50.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7fc045339640 1 Processor -- start 2023-10-16T08:51:50.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8031a90 con 0x7f66e00cfba0 2023-10-16T08:51:50.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8006e10 con 0x7f66e00cfba0 2023-10-16T08:51:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8003830 con 0x7f66e00cfba0 2023-10-16T08:51:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7fc045339640 1 -- start start 2023-10-16T08:51:50.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e00c9ec0 con 0x7f66e00cfba0 2023-10-16T08:51:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00ca480 con 0x7f66e00cfba0 2023-10-16T08:51:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee58d00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5406cf60 0x7fee540c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.929+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c073ef0 con 0x7f750c15d700 2023-10-16T08:51:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee58d00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee540aebb0 0x7fee541f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee58d00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee540cec00 0x7fee540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee58d00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541f6760 con 0x7fee540aebb0 2023-10-16T08:51:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee58d00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee541f3850 con 0x7fee540cec00 2023-10-16T08:51:51.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee58d00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee541f61a0 con 0x7fee5406cf60 2023-10-16T08:51:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.930+0000 7fee5259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5406cf60 0x7fee540c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fee52d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee540cec00 0x7fee540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fee5259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5406cf60 0x7fee540c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47118/0 (socket says 172.21.15.94:47118) 2023-10-16T08:51:51.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fee5259c640 1 -- 172.21.15.94:0/440661356 learned_addr learned my addr 172.21.15.94:0/440661356 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:51.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e00ca6a0 con 0x7f66e00cfba0 2023-10-16T08:51:51.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fc045339640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 0x7fc0401f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fc045339640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400cec00 0x7fc04015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fc045339640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0401607b0 0x7fc0400c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fc045339640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401f5ff0 con 0x7fc0401607b0 2023-10-16T08:51:51.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fc045339640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400c9d50 con 0x7fc0400cec00 2023-10-16T08:51:51.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fc045339640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401f6290 con 0x7fc0400aebb0 2023-10-16T08:51:51.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.931+0000 7fee4bfff640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee540aebb0 0x7fee541f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fee52d9d640 1 -- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5406cf60 msgr2=0x7fee540c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fee52d9d640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5406cf60 0x7fee540c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fc03effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 0x7fc0401f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fc03e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400cec00 0x7fc04015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fc03effd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 0x7fc0401f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47120/0 (socket says 172.21.15.94:47120) 2023-10-16T08:51:51.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fc03effd640 1 -- 172.21.15.94:0/2942713940 learned_addr learned my addr 172.21.15.94:0/2942713940 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:51.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fee52d9d640 1 -- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee540aebb0 msgr2=0x7fee541f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fc03f7fe640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0401607b0 0x7fc0400c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fee52d9d640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee540aebb0 0x7fee541f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.932+0000 7fee52d9d640 1 -- 172.21.15.94:0/440661356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009a70 con 0x7fee540cec00 2023-10-16T08:51:51.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fee52d9d640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee540cec00 0x7fee540cb6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee4c033000 tx=0x7fee4c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:51.010 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03effd640 1 -- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400cec00 msgr2=0x7fc04015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.010 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03effd640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400cec00 0x7fc04015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.010 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03effd640 1 -- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0401607b0 msgr2=0x7fc0400c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.010 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03effd640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0401607b0 0x7fc0400c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.011 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03effd640 1 -- 172.21.15.94:0/2942713940 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030009460 con 0x7fc0400aebb0 2023-10-16T08:51:51.011 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7500013470 con 0x7f750c15d700 2023-10-16T08:51:51.011 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03f7fe640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0401607b0 0x7fc0400c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:51.012 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.933+0000 7fc03e7fc640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400cec00 0x7fc04015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:51.012 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.934+0000 7fc03effd640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 0x7fc0401f6a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc03002b9a0 tx=0x7fc0300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:51.012 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.934+0000 7f74f3fff640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74f806af40 0x7f74f806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.012 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.934+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f750008a070 con 0x7f750c15d700 2023-10-16T08:51:51.013 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.935+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66c8003990 con 0x7f66e00cfba0 2023-10-16T08:51:51.013 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.935+0000 7f750b7fe640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74f806af40 0x7f74f806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.935+0000 7f66d6ffd640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f66c006ae70 0x7f66c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.936+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66c80ab6c0 con 0x7f66e00cfba0 2023-10-16T08:51:51.014 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.936+0000 7f66de59c640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f66c006ae70 0x7f66c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.936+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03003e070 con 0x7fc0400aebb0 2023-10-16T08:51:51.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.936+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030004500 con 0x7fc0400aebb0 2023-10-16T08:51:51.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.936+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030003e10 con 0x7fc0400aebb0 2023-10-16T08:51:51.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.936+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0401f6570 con 0x7fc0400aebb0 2023-10-16T08:51:51.016 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.937+0000 7f66de59c640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f66c006ae70 0x7f66c006d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009fc0 tx=0x7f66d8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:51.016 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.937+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe078054ec0 con 0x7fe08406c2a0 2023-10-16T08:51:51.016 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.937+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04015e510 con 0x7fc0400aebb0 2023-10-16T08:51:51.017 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.938+0000 7f750b7fe640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74f806af40 0x7f74f806d400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7504036000 tx=0x7f750403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:51.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.938+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0401f67b0 con 0x7fc0400aebb0 2023-10-16T08:51:51.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.940+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc030006040 con 0x7fc0400aebb0 2023-10-16T08:51:51.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.940+0000 7fc0277fe640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc02c06ae70 0x7fc02c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.940+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0300ab620 con 0x7fc0400aebb0 2023-10-16T08:51:51.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.942+0000 7fc03e7fc640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc02c06ae70 0x7fc02c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.942+0000 7fc03e7fc640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc02c06ae70 0x7fc02c06d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc034009f30 tx=0x7fc034009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:51.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.943+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7500054f50 con 0x7f750c15d700 2023-10-16T08:51:51.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.946+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c03e610 con 0x7fee540cec00 2023-10-16T08:51:51.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.947+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee541f6480 con 0x7fee540cec00 2023-10-16T08:51:51.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.947+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66c8076630 con 0x7f66e00cfba0 2023-10-16T08:51:51.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.947+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540c9490 con 0x7fee540cec00 2023-10-16T08:51:51.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.947+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c03e770 con 0x7fee540cec00 2023-10-16T08:51:51.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.947+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c03e610 con 0x7fee540cec00 2023-10-16T08:51:51.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.949+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee38005250 con 0x7fee540cec00 2023-10-16T08:51:51.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.951+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fee4c03b050 con 0x7fee540cec00 2023-10-16T08:51:51.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.952+0000 7fee4affd640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee3406aed0 0x7fee3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:51.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.953+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee4c0ac230 con 0x7fee540cec00 2023-10-16T08:51:51.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.953+0000 7fee5259c640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee3406aed0 0x7fee3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:51.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.954+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc030076720 con 0x7fc0400aebb0 2023-10-16T08:51:51.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.954+0000 7fee5259c640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee3406aed0 0x7fee3406d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fee44009bd0 tx=0x7fee44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:51.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:50.966+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fee4c077100 con 0x7fee540cec00 2023-10-16T08:51:51.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.306+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8200518e0 con 0x7fc8200e34a0 2023-10-16T08:51:51.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.307+0000 7fc816ffd640 1 -- 172.21.15.94:0/1964560900 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc81c057cc0 con 0x7fc8200e34a0 2023-10-16T08:51:51.310 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:51.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.311+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc80806aed0 msgr2=0x7fc80806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.311+0000 7fc82759e640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc80806aed0 0x7fc80806d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc818007fd0 tx=0x7fc818007c20 comp rx=0 tx=0).stop 2023-10-16T08:51:51.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.312+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 msgr2=0x7fc820180b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.312+0000 7fc82759e640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 0x7fc820180b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00d5d0 tx=0x7fc81c00da90 comp rx=0 tx=0).stop 2023-10-16T08:51:51.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 shutdown_connections 2023-10-16T08:51:51.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8200e34a0 0x7fc820180b80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc820057230 0x7fc820180640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc80806aed0 0x7fc80806d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 --2- 172.21.15.94:0/1964560900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8200543f0 0x7fc820050c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 >> 172.21.15.94:0/1964560900 conn(0x7fc820059120 msgr2=0x7fc820038b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 shutdown_connections 2023-10-16T08:51:51.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.313+0000 7fc82759e640 1 -- 172.21.15.94:0/1964560900 wait complete. 2023-10-16T08:51:51.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.324+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51800057d0 con 0x7f51900542d0 2023-10-16T08:51:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:51.330 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.326+0000 7f518effd640 1 -- 172.21.15.94:0/2162458658 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5188079fd0 con 0x7f51900542d0 2023-10-16T08:51:51.331 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.329+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f517c06ae90 msgr2=0x7f517c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.329+0000 7f519f240640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f517c06ae90 0x7f517c06d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5198068e70 tx=0x7f519806e040 comp rx=0 tx=0).stop 2023-10-16T08:51:51.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.329+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51900542d0 msgr2=0x7f519003d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.329+0000 7f519f240640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51900542d0 0x7f519003d1f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5188033000 tx=0x7f51880046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 shutdown_connections 2023-10-16T08:51:51.332 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f517c06ae90 0x7f517c06d350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900e3190 0x7f519003d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51900542d0 0x7f519003d1f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 --2- 172.21.15.94:0/2162458658 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5190038180 0x7f51900def20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 >> 172.21.15.94:0/2162458658 conn(0x7f51900590c0 msgr2=0x7f519003c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 shutdown_connections 2023-10-16T08:51:51.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.330+0000 7f519f240640 1 -- 172.21.15.94:0/2162458658 wait complete. 2023-10-16T08:51:51.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.335+0000 7f213b22b640 1 -- 172.21.15.94:0/31140166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f213415bc80 con 0x7f21341569c0 2023-10-16T08:51:51.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.338+0000 7f21317fa640 1 -- 172.21.15.94:0/31140166 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f212c057bf0 con 0x7f21341569c0 2023-10-16T08:51:51.344 INFO:teuthology.orchestra.run.smithi094.stdout:60129542153 2023-10-16T08:51:51.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.1 2023-10-16T08:51:51.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.342+0000 7f211affd640 1 -- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f212006aec0 msgr2=0x7f212006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f212006aec0 0x7f212006d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2134202040 tx=0x7f2128009040 comp rx=0 tx=0).stop 2023-10-16T08:51:51.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 -- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21341569c0 msgr2=0x7f21341f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21341569c0 0x7f21341f30c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f212c00c730 tx=0x7f212c00cbf0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 -- 172.21.15.94:0/31140166 shutdown_connections 2023-10-16T08:51:51.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f212006aec0 0x7f212006d380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21341569c0 0x7f21341f30c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21340c46b0 0x7f2134155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 --2- 172.21.15.94:0/31140166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f213406a430 0x7f2134154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.343+0000 7f211affd640 1 -- 172.21.15.94:0/31140166 >> 172.21.15.94:0/31140166 conn(0x7f21340cb830 msgr2=0x7f213415c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.344+0000 7f211affd640 1 -- 172.21.15.94:0/31140166 shutdown_connections 2023-10-16T08:51:51.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.344+0000 7f211affd640 1 -- 172.21.15.94:0/31140166 wait complete. 2023-10-16T08:51:51.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.350+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc040073ef0 con 0x7fc0400aebb0 2023-10-16T08:51:51.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.351+0000 7fc0277fe640 1 -- 172.21.15.94:0/2942713940 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc030079d40 con 0x7fc0400aebb0 2023-10-16T08:51:51.353 INFO:teuthology.orchestra.run.smithi094.stdout:60129542153 2023-10-16T08:51:51.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.352+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe08406d3d0 con 0x7fe08406c2a0 2023-10-16T08:51:51.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.353+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f750c0cd020 con 0x7f750c15d700 2023-10-16T08:51:51.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.353+0000 7fe06bfff640 1 -- 172.21.15.94:0/1499164595 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0780584e0 con 0x7fe08406c2a0 2023-10-16T08:51:51.356 INFO:teuthology.orchestra.run.smithi094.stdout:64424509450 2023-10-16T08:51:51.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.354+0000 7f74f3fff640 1 -- 172.21.15.94:0/4207102845 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7500021020 con 0x7f750c15d700 2023-10-16T08:51:51.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.354+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc02c06ae70 msgr2=0x7fc02c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.354+0000 7fc045339640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc02c06ae70 0x7fc02c06d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc034009f30 tx=0x7fc034009190 comp rx=0 tx=0).stop 2023-10-16T08:51:51.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.354+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 msgr2=0x7fc0401f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.354+0000 7fc045339640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 0x7fc0401f6a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc03002b9a0 tx=0x7fc0300046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.357 INFO:teuthology.orchestra.run.smithi094.stdout:60129542153 2023-10-16T08:51:51.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 shutdown_connections 2023-10-16T08:51:51.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0401607b0 0x7fc0400c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc02c06ae70 0x7fc02c06d330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0400cec00 0x7fc04015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 --2- 172.21.15.94:0/2942713940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0400aebb0 0x7fc0401f6a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 >> 172.21.15.94:0/2942713940 conn(0x7fc0400989e0 msgr2=0x7fc0400ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 shutdown_connections 2023-10-16T08:51:51.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.355+0000 7fc045339640 1 -- 172.21.15.94:0/2942713940 wait complete. 2023-10-16T08:51:51.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe07006ae70 msgr2=0x7fe07006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe07006ae70 0x7fe07006d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe07c035000 tx=0x7fe07c030000 comp rx=0 tx=0).stop 2023-10-16T08:51:51.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 msgr2=0x7fe0841f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe0841f6e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe07800d5c0 tx=0x7fe07800da80 comp rx=0 tx=0).stop 2023-10-16T08:51:51.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 shutdown_connections 2023-10-16T08:51:51.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe084158b40 0x7fe0841f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe07006ae70 0x7fe07006d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0840b01b0 0x7fe0841f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 --2- 172.21.15.94:0/1499164595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe08406c2a0 0x7fe0841f6e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.357+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 >> 172.21.15.94:0/1499164595 conn(0x7fe08406a440 msgr2=0x7fe084156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.0 2023-10-16T08:51:51.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74f806af40 msgr2=0x7f74f806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 shutdown_connections 2023-10-16T08:51:51.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7fe08996e640 1 -- 172.21.15.94:0/1499164595 wait complete. 2023-10-16T08:51:51.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74f806af40 0x7f74f806d400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7504036000 tx=0x7f750403c040 comp rx=0 tx=0).stop 2023-10-16T08:51:51.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 msgr2=0x7f750c0c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c0c86a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f750000e870 tx=0x7f750000ed30 comp rx=0 tx=0).stop 2023-10-16T08:51:51.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 shutdown_connections 2023-10-16T08:51:51.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f750c15dae0 0x7f750c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f750c15d700 0x7f750c0c86a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f74f806af40 0x7f74f806d400 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 --2- 172.21.15.94:0/4207102845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f750c06d440 0x7f750c151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 >> 172.21.15.94:0/4207102845 conn(0x7f750c0cb1b0 msgr2=0x7f750c157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.358+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 shutdown_connections 2023-10-16T08:51:51.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.359+0000 7f7512105640 1 -- 172.21.15.94:0/4207102845 wait complete. 2023-10-16T08:51:51.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.360+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f66e0073ef0 con 0x7f66e00cfba0 2023-10-16T08:51:51.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.361+0000 7f66d6ffd640 1 -- 172.21.15.94:0/1808010332 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66c8079c50 con 0x7f66e00cfba0 2023-10-16T08:51:51.368 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:51.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f66c006ae70 msgr2=0x7f66c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f66c006ae70 0x7f66c006d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009fc0 tx=0x7f66d8009240 comp rx=0 tx=0).stop 2023-10-16T08:51:51.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 msgr2=0x7f66e00b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 0x7f66e00b4b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66c802bdc0 tx=0x7f66c80046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 shutdown_connections 2023-10-16T08:51:51.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f66c006ae70 0x7f66c006d330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66e00cfba0 0x7f66e00b4b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66e00cd000 0x7f66e00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 --2- 172.21.15.94:0/1808010332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66e00b1e30 0x7f66e00b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.364+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 >> 172.21.15.94:0/1808010332 conn(0x7f66e0071510 msgr2=0x7f66e00c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.365+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 shutdown_connections 2023-10-16T08:51:51.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.365+0000 7f66e4e1a640 1 -- 172.21.15.94:0/1808010332 wait complete. 2023-10-16T08:51:51.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2023-10-16T08:51:51.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.381+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fee38005500 con 0x7fee540cec00 2023-10-16T08:51:51.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.382+0000 7fee4affd640 1 -- 172.21.15.94:0/440661356 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee4c009450 con 0x7fee540cec00 2023-10-16T08:51:51.384 INFO:teuthology.orchestra.run.smithi094.stdout:64424509451 2023-10-16T08:51:51.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2023-10-16T08:51:51.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.4 2023-10-16T08:51:51.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee3406aed0 msgr2=0x7fee3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee3406aed0 0x7fee3406d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fee44009bd0 tx=0x7fee44008040 comp rx=0 tx=0).stop 2023-10-16T08:51:51.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee540cec00 msgr2=0x7fee540cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:51.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee540cec00 0x7fee540cb6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee4c033000 tx=0x7fee4c004a40 comp rx=0 tx=0).stop 2023-10-16T08:51:51.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 shutdown_connections 2023-10-16T08:51:51.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee3406aed0 0x7fee3406d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee540cec00 0x7fee540cb6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fee540aebb0 0x7fee541f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 --2- 172.21.15.94:0/440661356 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee5406cf60 0x7fee540c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:51.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 >> 172.21.15.94:0/440661356 conn(0x7fee540989e0 msgr2=0x7fee54069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:51.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 shutdown_connections 2023-10-16T08:51:51.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:51.385+0000 7fee58d00640 1 -- 172.21.15.94:0/440661356 wait complete. 2023-10-16T08:51:51.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-10-16T08:51:51.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.5 2023-10-16T08:51:51.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2023-10-16T08:51:52.345 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T08:51:52.364 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T08:51:52.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T08:51:52.387 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T08:51:52.388 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T08:51:52.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T08:51:52.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T08:51:52.403 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T08:51:52.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.637+0000 7f773064f640 1 Processor -- start 2023-10-16T08:51:52.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.637+0000 7f773064f640 1 -- start start 2023-10-16T08:51:52.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.639+0000 7f773064f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7728160f40 0x7f77280c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.639+0000 7f773064f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77280ce2e0 0x7f77280c1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.639+0000 7f773064f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77280c9980 con 0x7f77280c18c0 2023-10-16T08:51:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.639+0000 7f773064f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280ca350 con 0x7f7728160f40 2023-10-16T08:51:52.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.639+0000 7f773064f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280c1cf0 con 0x7f77280ce2e0 2023-10-16T08:51:52.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.640+0000 7f772ebec640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f77280c18c0 0x7f77280b1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50944/0 (socket says 172.21.15.94:50944) 2023-10-16T08:51:52.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.640+0000 7f772ebec640 1 -- 172.21.15.94:0/2302858862 learned_addr learned my addr 172.21.15.94:0/2302858862 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:52.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.641+0000 7f772e3eb640 1 --2- 172.21.15.94:0/2302858862 >> v2:172.21.15.94:3300/0 conn(0x7f7728160f40 0x7f77280c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.641+0000 7f772dbea640 1 --2- 172.21.15.94:0/2302858862 >> v2:172.21.15.130:3300/0 conn(0x7f77280ce2e0 0x7f77280c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.642+0000 7f772dbea640 1 -- 172.21.15.94:0/2302858862 >> v2:172.21.15.94:3300/0 conn(0x7f7728160f40 msgr2=0x7f77280c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.642+0000 7f772dbea640 1 --2- 172.21.15.94:0/2302858862 >> v2:172.21.15.94:3300/0 conn(0x7f7728160f40 0x7f77280c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.642+0000 7f772dbea640 1 -- 172.21.15.94:0/2302858862 >> v1:172.21.15.94:6789/0 conn(0x7f77280c18c0 legacy=0x7f77280b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.642+0000 7f772dbea640 1 -- 172.21.15.94:0/2302858862 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280c8d70 con 0x7f77280ce2e0 2023-10-16T08:51:52.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.645+0000 7f772dbea640 1 --2- 172.21.15.94:0/2302858862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f77280c1380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7728164860 tx=0x7f771802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a59ebcd89a881728 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.646+0000 7f772d3e9640 1 -- 172.21.15.94:0/2302858862 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718031870 con 0x7f77280ce2e0 2023-10-16T08:51:52.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.646+0000 7f772d3e9640 1 -- 172.21.15.94:0/2302858862 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180319d0 con 0x7f77280ce2e0 2023-10-16T08:51:52.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.646+0000 7f772d3e9640 1 -- 172.21.15.94:0/2302858862 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718031da0 con 0x7f77280ce2e0 2023-10-16T08:51:52.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.647+0000 7f773064f640 1 -- 172.21.15.94:0/2302858862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 msgr2=0x7f77280c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.647+0000 7f773064f640 1 --2- 172.21.15.94:0/2302858862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f77280c1380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7728164860 tx=0x7f771802b910 comp rx=0 tx=0).stop 2023-10-16T08:51:52.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.648+0000 7f773064f640 1 -- 172.21.15.94:0/2302858862 shutdown_connections 2023-10-16T08:51:52.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.648+0000 7f773064f640 1 --2- 172.21.15.94:0/2302858862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f77280c1380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.648+0000 7f773064f640 1 --2- 172.21.15.94:0/2302858862 >> v2:172.21.15.94:3300/0 conn(0x7f7728160f40 0x7f77280c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.648+0000 7f773064f640 1 -- 172.21.15.94:0/2302858862 >> 172.21.15.94:0/2302858862 conn(0x7f7728071400 msgr2=0x7f7728071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.654+0000 7f773064f640 1 -- 172.21.15.94:0/2302858862 shutdown_connections 2023-10-16T08:51:52.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.654+0000 7f773064f640 1 -- 172.21.15.94:0/2302858862 wait complete. 2023-10-16T08:51:52.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.657+0000 7f773064f640 1 Processor -- start 2023-10-16T08:51:52.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.658+0000 7f773064f640 1 -- start start 2023-10-16T08:51:52.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.659+0000 7f773064f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 0x7f772815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.660+0000 7f773064f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f7728098d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.660+0000 7f773064f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 0x7f7728099250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.660+0000 7f772e3eb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 0x7f772815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.660+0000 7f772e3eb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 0x7f772815ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47134/0 (socket says 172.21.15.94:47134) 2023-10-16T08:51:52.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.661+0000 7f772ebec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 0x7f7728099250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.661+0000 7f772ebec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 0x7f7728099250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57092/0 (socket says 172.21.15.94:57092) 2023-10-16T08:51:52.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.661+0000 7f772dbea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f7728098d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.661+0000 7f772dbea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f7728098d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58322/0 (socket says 172.21.15.94:58322) 2023-10-16T08:51:52.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.662+0000 7f772e3eb640 1 -- 172.21.15.94:0/1745309467 learned_addr learned my addr 172.21.15.94:0/1745309467 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.662+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c77e0 con 0x7f7728160f40 2023-10-16T08:51:52.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.662+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7728144980 con 0x7f77280ce2e0 2023-10-16T08:51:52.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.662+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c7a30 con 0x7f77280c18c0 2023-10-16T08:51:52.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.663+0000 7f772ebec640 1 -- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 msgr2=0x7f772815ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.663+0000 7f772ebec640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 0x7f772815ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.664+0000 7f772ebec640 1 -- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 msgr2=0x7f7728098d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.664+0000 7f772ebec640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f7728098d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.664+0000 7f772ebec640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009400 con 0x7f7728160f40 2023-10-16T08:51:52.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.664+0000 7f772ebec640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 0x7f7728099250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f772000ce50 tx=0x7f772000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.665+0000 7f772e3eb640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 0x7f772815ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:52.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.665+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000ac20 con 0x7f7728160f40 2023-10-16T08:51:52.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.665+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000ad80 con 0x7f7728160f40 2023-10-16T08:51:52.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.665+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720012600 con 0x7f7728160f40 2023-10-16T08:51:52.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.666+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77280c7d10 con 0x7f7728160f40 2023-10-16T08:51:52.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.666+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280c82d0 con 0x7f7728160f40 2023-10-16T08:51:52.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.670+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7720007070 con 0x7f7728160f40 2023-10-16T08:51:52.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.671+0000 7f771effd640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f770c06af40 0x7f770c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.671+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7720089680 con 0x7f7728160f40 2023-10-16T08:51:52.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.673+0000 7f772e3eb640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f770c06af40 0x7f770c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.674+0000 7f772e3eb640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f770c06af40 0x7f770c06d400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7724006fd0 tx=0x7f7724008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.674+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772804e9b0 con 0x7f7728160f40 2023-10-16T08:51:52.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.685+0000 7fe5cb1bb640 1 Processor -- start 2023-10-16T08:51:52.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.685+0000 7fe5cb1bb640 1 -- start start 2023-10-16T08:51:52.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.687+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7720054560 con 0x7f7728160f40 2023-10-16T08:51:52.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.687+0000 7fe5cb1bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0de3d0 0x7fe5bc006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.687+0000 7fe5cb1bb640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc057020 con 0x7fe5bc0eb050 2023-10-16T08:51:52.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.687+0000 7fe5cb1bb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc056cf0 con 0x7fe5bc0066a0 2023-10-16T08:51:52.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.687+0000 7fe5cb1bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc058e90 con 0x7fe5bc0de3d0 2023-10-16T08:51:52.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.688+0000 7fe5c9758640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe5bc0eb050 0x7fe5bc0eb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50948/0 (socket says 172.21.15.94:50948) 2023-10-16T08:51:52.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.688+0000 7fe5c9758640 1 -- 172.21.15.94:0/3737743948 learned_addr learned my addr 172.21.15.94:0/3737743948 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:52.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.688+0000 7fe5c8f57640 1 --2- 172.21.15.94:0/3737743948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0de3d0 0x7fe5bc006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.689+0000 7fe5c37fe640 1 -- 172.21.15.94:0/3737743948 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056279126 0 0) 0x7fe5bc057020 con 0x7fe5bc0eb050 2023-10-16T08:51:52.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.689+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3737743948 >> v1:172.21.15.130:6789/0 conn(0x7fe5bc0066a0 legacy=0x7fe5bc0380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.689+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3737743948 >> v1:172.21.15.94:6789/0 conn(0x7fe5bc0eb050 legacy=0x7fe5bc0eb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.689+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3737743948 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0588d0 con 0x7fe5bc0de3d0 2023-10-16T08:51:52.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.690+0000 7f7f1f59e640 1 Processor -- start 2023-10-16T08:51:52.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.691+0000 7fe5c8f57640 1 --2- 172.21.15.94:0/3737743948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0de3d0 0x7fe5bc006160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5c404f940 tx=0x7fe5c40a57a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da3a5b18f19c493 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.690+0000 7f7f1f59e640 1 -- start start 2023-10-16T08:51:52.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.693+0000 7f7f1f59e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7f180e78b0 0x7f7f1804f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7f7f1f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7f180eb2c0 0x7f7f180eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7f7f1f59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f18053470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7f7f1f59e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f18050340 con 0x7f7f180e78b0 2023-10-16T08:51:52.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7f7f1f59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f18006480 con 0x7f7f180eb2c0 2023-10-16T08:51:52.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7f7f1e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7f180e78b0 0x7f7f1804f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7ff27abc9640 1 Processor -- start 2023-10-16T08:51:52.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.694+0000 7f7f1f59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180ebc40 con 0x7f7f18052fe0 2023-10-16T08:51:52.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.695+0000 7ff27abc9640 1 -- start start 2023-10-16T08:51:52.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.695+0000 7f7f1ed9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f18053470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.695+0000 7f7f1e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7f180e78b0 0x7f7f1804f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57096/0 (socket says 172.21.15.94:57096) 2023-10-16T08:51:52.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.695+0000 7f7f1e59c640 1 -- 172.21.15.94:0/2535924556 learned_addr learned my addr 172.21.15.94:0/2535924556 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7fe5c37fe640 1 -- 172.21.15.94:0/3737743948 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40a9050 con 0x7fe5bc0de3d0 2023-10-16T08:51:52.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7fe5c37fe640 1 -- 172.21.15.94:0/3737743948 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c40ad5f0 con 0x7fe5bc0de3d0 2023-10-16T08:51:52.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7fe5c37fe640 1 -- 172.21.15.94:0/3737743948 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40ad9a0 con 0x7fe5bc0de3d0 2023-10-16T08:51:52.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3737743948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0de3d0 msgr2=0x7fe5bc006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3737743948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0de3d0 0x7fe5bc006160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5c404f940 tx=0x7fe5c40a57a0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7ff27abc9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7ff27abc9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff2740cdbc0 0x7ff2740d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7ff27abc9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff274161520 con 0x7ff27415c9f0 2023-10-16T08:51:52.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7ff27abc9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2740ce050 con 0x7ff2740cdbc0 2023-10-16T08:51:52.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7ff27abc9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff274160f60 con 0x7ff2740b83b0 2023-10-16T08:51:52.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3737743948 shutdown_connections 2023-10-16T08:51:52.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3737743948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0de3d0 0x7fe5bc006160 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.697+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3737743948 >> 172.21.15.94:0/3737743948 conn(0x7fe5bc055a90 msgr2=0x7fe5bc055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7f7f1e59c640 1 -- 172.21.15.94:0/2535924556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 msgr2=0x7f7f18053470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7f7f1e59c640 1 --2- 172.21.15.94:0/2535924556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f18053470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7f7f1e59c640 1 -- 172.21.15.94:0/2535924556 >> v2:172.21.15.130:3300/0 conn(0x7f7f180eb2c0 msgr2=0x7f7f180eb700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T08:51:52.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7f7f1e59c640 1 --2- 172.21.15.94:0/2535924556 >> v2:172.21.15.130:3300/0 conn(0x7f7f180eb2c0 0x7f7f180eb700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.696+0000 7f7f1e59c640 1 -- 172.21.15.94:0/2535924556 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1804fd80 con 0x7f7f180e78b0 2023-10-16T08:51:52.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.698+0000 7ff26bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.698+0000 7f7f1e59c640 1 --2- 172.21.15.94:0/2535924556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180e78b0 0x7f7f1804f260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f18055c50 tx=0x7f7f1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553fcbbbc9b37663 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.698+0000 7ff26bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47158/0 (socket says 172.21.15.94:47158) 2023-10-16T08:51:52.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.698+0000 7ff26bfff640 1 -- 172.21.15.94:0/2666054907 learned_addr learned my addr 172.21.15.94:0/2666054907 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.698+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3737743948 shutdown_connections 2023-10-16T08:51:52.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.699+0000 7ff279166640 1 --2- 172.21.15.94:0/2666054907 >> v2:172.21.15.94:3300/0 conn(0x7ff2740cdbc0 0x7ff2740d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.699+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3737743948 wait complete. 2023-10-16T08:51:52.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.700+0000 7ff26bfff640 1 -- 172.21.15.94:0/2666054907 >> v2:172.21.15.94:3300/0 conn(0x7ff2740cdbc0 msgr2=0x7ff2740d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.700+0000 7ff26bfff640 1 --2- 172.21.15.94:0/2666054907 >> v2:172.21.15.94:3300/0 conn(0x7ff2740cdbc0 0x7ff2740d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.700+0000 7ff26bfff640 1 -- 172.21.15.94:0/2666054907 >> v1:172.21.15.94:6789/0 conn(0x7ff27415c9f0 legacy=0x7ff274160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.700+0000 7ff26bfff640 1 -- 172.21.15.94:0/2666054907 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274161240 con 0x7ff2740b83b0 2023-10-16T08:51:52.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.700+0000 7ff279166640 1 --2- 172.21.15.94:0/2666054907 >> v2:172.21.15.94:3300/0 conn(0x7ff2740cdbc0 0x7ff2740d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:52.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.702+0000 7fe5cb1bb640 1 Processor -- start 2023-10-16T08:51:52.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.701+0000 7ff26bfff640 1 --2- 172.21.15.94:0/2666054907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740cd680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e333fa614630aac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.702+0000 7fe5cb1bb640 1 -- start start 2023-10-16T08:51:52.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.703+0000 7f7f1d59a640 1 -- 172.21.15.94:0/2535924556 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10031830 con 0x7f7f180e78b0 2023-10-16T08:51:52.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.703+0000 7fe5cb1bb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 0x7fe5bc180320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.703+0000 7f7f1d59a640 1 -- 172.21.15.94:0/2535924556 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10031990 con 0x7f7f180e78b0 2023-10-16T08:51:52.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.703+0000 7f7f1d59a640 1 -- 172.21.15.94:0/2535924556 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10031d60 con 0x7f7f180e78b0 2023-10-16T08:51:52.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.703+0000 7fe5cb1bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc0de3d0 0x7fe5bc04f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5cb1bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0eb050 0x7fe5bc04ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5cb1bb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc051cc0 con 0x7fe5bc0066a0 2023-10-16T08:51:52.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5cb1bb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc180f30 con 0x7fe5bc0de3d0 2023-10-16T08:51:52.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5c8f57640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 0x7fe5bc180320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7f7f1f59e640 1 -- 172.21.15.94:0/2535924556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180e78b0 msgr2=0x7f7f1804f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/2535924556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180e78b0 0x7f7f1804f260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f18055c50 tx=0x7f7f1002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5cb1bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0510d0 con 0x7fe5bc0eb050 2023-10-16T08:51:52.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5c8f57640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 0x7fe5bc180320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57122/0 (socket says 172.21.15.94:57122) 2023-10-16T08:51:52.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.704+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3816069184 learned_addr learned my addr 172.21.15.94:0/3816069184 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7f7f1f59e640 1 -- 172.21.15.94:0/2535924556 shutdown_connections 2023-10-16T08:51:52.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/2535924556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f18053470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/2535924556 >> v2:172.21.15.130:3300/0 conn(0x7f7f180eb2c0 0x7f7f180eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/2535924556 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180e78b0 0x7f7f1804f260 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7f7f1f59e640 1 -- 172.21.15.94:0/2535924556 >> 172.21.15.94:0/2535924556 conn(0x7f7f18054c10 msgr2=0x7f7f18054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0eb050 msgr2=0x7fe5bc04ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7fe5c9758640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0eb050 0x7fe5bc04ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7fe5c3fff640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc0de3d0 0x7fe5bc04f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7fe5c8f57640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0eb050 0x7fe5bc04ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc0de3d0 msgr2=0x7fe5bc04f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.705+0000 7fe5c8f57640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc0de3d0 0x7fe5bc04f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5c8f57640 1 -- 172.21.15.94:0/3816069184 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc051390 con 0x7fe5bc0066a0 2023-10-16T08:51:52.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5c3fff640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc0de3d0 0x7fe5bc04f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:52.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5c8f57640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 0x7fe5bc180320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4067c70 tx=0x7fe5c4067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40acb10 con 0x7fe5bc0066a0 2023-10-16T08:51:52.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c40acc70 con 0x7fe5bc0066a0 2023-10-16T08:51:52.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40b9450 con 0x7fe5bc0066a0 2023-10-16T08:51:52.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc051670 con 0x7fe5bc0066a0 2023-10-16T08:51:52.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7ff26b7fe640 1 -- 172.21.15.94:0/2666054907 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264030860 con 0x7ff2740b83b0 2023-10-16T08:51:52.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7ff26b7fe640 1 -- 172.21.15.94:0/2666054907 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2640309c0 con 0x7ff2740b83b0 2023-10-16T08:51:52.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.706+0000 7ff26b7fe640 1 -- 172.21.15.94:0/2666054907 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264030d90 con 0x7ff2740b83b0 2023-10-16T08:51:52.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.707+0000 7f7f1f59e640 1 -- 172.21.15.94:0/2535924556 shutdown_connections 2023-10-16T08:51:52.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.707+0000 7f7f1f59e640 1 -- 172.21.15.94:0/2535924556 wait complete. 2023-10-16T08:51:52.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.708+0000 7f5ea05ce640 1 Processor -- start 2023-10-16T08:51:52.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.708+0000 7ff27abc9640 1 -- 172.21.15.94:0/2666054907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 msgr2=0x7ff2740cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.708+0000 7ff27abc9640 1 --2- 172.21.15.94:0/2666054907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740cd680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402b9a0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.708+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc180860 con 0x7fe5bc0066a0 2023-10-16T08:51:52.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.708+0000 7f5ea05ce640 1 -- start start 2023-10-16T08:51:52.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.709+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5c40b95b0 con 0x7fe5bc0066a0 2023-10-16T08:51:52.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.709+0000 7ff27abc9640 1 -- 172.21.15.94:0/2666054907 shutdown_connections 2023-10-16T08:51:52.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7ff27abc9640 1 --2- 172.21.15.94:0/2666054907 >> v2:172.21.15.94:3300/0 conn(0x7ff2740cdbc0 0x7ff2740d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7ff27abc9640 1 --2- 172.21.15.94:0/2666054907 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740cd680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7ff27abc9640 1 -- 172.21.15.94:0/2666054907 >> 172.21.15.94:0/2666054907 conn(0x7ff274071510 msgr2=0x7ff274071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7ff27abc9640 1 -- 172.21.15.94:0/2666054907 shutdown_connections 2023-10-16T08:51:52.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7f7f1f59e640 1 Processor -- start 2023-10-16T08:51:52.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7f7f1f59e640 1 -- start start 2023-10-16T08:51:52.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7f10aef47640 1 Processor -- start 2023-10-16T08:51:52.726 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc1809f0 con 0x7fe5bc0066a0 2023-10-16T08:51:52.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7fe5c17fa640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe5a806aef0 0x7fe5a806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5c4129170 con 0x7fe5bc0066a0 2023-10-16T08:51:52.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7fe5c3fff640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe5a806aef0 0x7fe5a806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7f7f1f59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f180e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7f7f1f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180e78b0 0x7f7f18170e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7f7f1f59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180eb2c0 0x7f7f181728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7f5ea05ce640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5e980b08c0 0x7f5e980cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7f5ea05ce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e980ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7f5ea05ce640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980c8f20 con 0x7f5e98160e80 2023-10-16T08:51:52.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7f5ea05ce640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e98165c10 con 0x7f5e980b08c0 2023-10-16T08:51:52.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7f5ea05ce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980c9200 con 0x7f5e981656a0 2023-10-16T08:51:52.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7f7f1f59e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180e2ae0 con 0x7f7f180eb2c0 2023-10-16T08:51:52.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7f7f1f59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1804b540 con 0x7f7f180e78b0 2023-10-16T08:51:52.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.712+0000 7f7f1f59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1804b260 con 0x7f7f18052fe0 2023-10-16T08:51:52.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f5e9eb6b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e980ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.710+0000 7ff27abc9640 1 -- 172.21.15.94:0/2666054907 wait complete. 2023-10-16T08:51:52.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f5e9eb6b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e980ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47164/0 (socket says 172.21.15.94:47164) 2023-10-16T08:51:52.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/3551708447 learned_addr learned my addr 172.21.15.94:0/3551708447 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7fe5c3fff640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe5a806aef0 0x7fe5a806d3b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0eab10 tx=0x7fe5b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.711+0000 7f10aef47640 1 -- start start 2023-10-16T08:51:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f7f1e59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f180e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f7f1e59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f180e25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47166/0 (socket says 172.21.15.94:47166) 2023-10-16T08:51:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f7f1e59c640 1 -- 172.21.15.94:0/4052340386 learned_addr learned my addr 172.21.15.94:0/4052340386 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f7f1ed9d640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180eb2c0 0x7f7f181728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f7f1dd9b640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180e78b0 0x7f7f18170e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f3f49d83640 1 Processor -- start 2023-10-16T08:51:52.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f10aef47640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a80cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f10aef47640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10a80d3340 0x7f10a80d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f10aef47640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80ce710 con 0x7f10a80d13e0 2023-10-16T08:51:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f10aef47640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80d0a60 con 0x7f10a80d3340 2023-10-16T08:51:52.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.713+0000 7f10aef47640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80d1870 con 0x7f10a815cbd0 2023-10-16T08:51:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f7f1dd9b640 1 -- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 msgr2=0x7f7f180e25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f7f1dd9b640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f180e25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f7f1dd9b640 1 -- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180eb2c0 msgr2=0x7f7f181728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f7f1dd9b640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180eb2c0 0x7f7f181728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f7f1dd9b640 1 -- 172.21.15.94:0/4052340386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100094d0 con 0x7f7f180e78b0 2023-10-16T08:51:52.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f3f49d83640 1 -- start start 2023-10-16T08:51:52.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f10adf45640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a80cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7ff27abc9640 1 Processor -- start 2023-10-16T08:51:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f5e9db69640 1 --2- 172.21.15.94:0/3551708447 >> v2:172.21.15.130:3300/0 conn(0x7f5e980b08c0 0x7f5e980cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/3551708447 >> v2:172.21.15.130:3300/0 conn(0x7f5e980b08c0 msgr2=0x7f5e980cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f5e9eb6b640 1 --2- 172.21.15.94:0/3551708447 >> v2:172.21.15.130:3300/0 conn(0x7f5e980b08c0 0x7f5e980cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/3551708447 >> v1:172.21.15.94:6789/0 conn(0x7f5e98160e80 legacy=0x7f5e980b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f10ad744640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10a80d3340 0x7f10a80d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f10adf45640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a80cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47168/0 (socket says 172.21.15.94:47168) 2023-10-16T08:51:52.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7f10adf45640 1 -- 172.21.15.94:0/840291044 learned_addr learned my addr 172.21.15.94:0/840291044 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.714+0000 7ff27abc9640 1 -- start start 2023-10-16T08:51:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.715+0000 7f10ad744640 1 -- 172.21.15.94:0/840291044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 msgr2=0x7f10a80cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.715+0000 7f10ad744640 1 --2- 172.21.15.94:0/840291044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a80cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.715+0000 7f10ad744640 1 -- 172.21.15.94:0/840291044 >> v1:172.21.15.130:6789/0 conn(0x7f10a80d13e0 legacy=0x7f10a80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.715+0000 7f10ad744640 1 -- 172.21.15.94:0/840291044 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80d37c0 con 0x7f10a80d3340 2023-10-16T08:51:52.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7f3f49d83640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f4415cb60 0x7f3f440cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7f3f49d83640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4415cf40 con 0x7f3f4406dd90 2023-10-16T08:51:52.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7f3f49d83640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440c8d80 con 0x7f3f440b08c0 2023-10-16T08:51:52.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7f3f49d83640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440c8fd0 con 0x7f3f4415cb60 2023-10-16T08:51:52.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7ff27abc9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f10ad744640 1 --2- 172.21.15.94:0/840291044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80d0ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009d90 tx=0x7f10a002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8810c7b06b0b61a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7ff27abc9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2740cdbc0 0x7ff2740c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f3f437fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f4415cb60 0x7f3f440cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f3f43fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3f440b08c0 0x7f3f440cc8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:59404/0 (socket says 172.21.15.94:59404) 2023-10-16T08:51:52.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f3f43fff640 1 -- 172.21.15.94:0/1342912197 learned_addr learned my addr 172.21.15.94:0/1342912197 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:52.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7ff27abc9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff27415c9f0 0x7ff27415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7ff27abc9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27414f9e0 con 0x7ff27415c9f0 2023-10-16T08:51:52.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7ff27abc9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740c6f60 con 0x7ff2740cdbc0 2023-10-16T08:51:52.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7ff27abc9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740c7240 con 0x7ff2740b83b0 2023-10-16T08:51:52.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/3551708447 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980c94e0 con 0x7f5e981656a0 2023-10-16T08:51:52.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.716+0000 7f5e9db69640 1 --2- 172.21.15.94:0/3551708447 >> v2:172.21.15.130:3300/0 conn(0x7f5e980b08c0 0x7f5e980cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:52.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f3f437fe640 1 -- 172.21.15.94:0/1342912197 >> v1:172.21.15.130:6789/0 conn(0x7f3f440b08c0 legacy=0x7f3f440cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f3f437fe640 1 -- 172.21.15.94:0/1342912197 >> v1:172.21.15.94:6789/0 conn(0x7f3f4406dd90 legacy=0x7f3f440b01b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T08:51:52.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.717+0000 7f3f437fe640 1 -- 172.21.15.94:0/1342912197 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440c92b0 con 0x7f3f4415cb60 2023-10-16T08:51:52.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7ff278965640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7ff278965640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47184/0 (socket says 172.21.15.94:47184) 2023-10-16T08:51:52.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7ff278965640 1 -- 172.21.15.94:0/1512144365 learned_addr learned my addr 172.21.15.94:0/1512144365 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7f7f1dd9b640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180e78b0 0x7f7f18170e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00b3e0 tx=0x7f7f0c00b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7ff26bfff640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2740cdbc0 0x7ff2740c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7ff279166640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff27415c9f0 0x7ff27415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.718+0000 7f5e9eb6b640 1 --2- 172.21.15.94:0/3551708447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e980ccc00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009870 tx=0x7f5e8c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e468551969c42e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7ff279166640 1 -- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 msgr2=0x7ff2740c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7ff279166640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7ff279166640 1 -- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2740cdbc0 msgr2=0x7ff2740c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7ff279166640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2740cdbc0 0x7ff2740c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f5e9d368640 1 -- 172.21.15.94:0/3551708447 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c02f830 con 0x7f5e981656a0 2023-10-16T08:51:52.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7ff279166640 1 -- 172.21.15.94:0/1512144365 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c009a70 con 0x7ff27415c9f0 2023-10-16T08:51:52.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f5e9d368640 1 -- 172.21.15.94:0/3551708447 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c02f990 con 0x7f5e981656a0 2023-10-16T08:51:52.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011830 con 0x7f7f180e78b0 2023-10-16T08:51:52.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c011990 con 0x7f7f180e78b0 2023-10-16T08:51:52.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011d40 con 0x7f7f180e78b0 2023-10-16T08:51:52.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f5e9d368640 1 -- 172.21.15.94:0/3551708447 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c02fd20 con 0x7f5e981656a0 2023-10-16T08:51:52.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f3f437fe640 1 --2- 172.21.15.94:0/1342912197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4415cb60 0x7f3f440cde90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0097a0 tx=0x7f3f3c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cedb9fa9ae33482b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f181735b0 con 0x7f7f180e78b0 2023-10-16T08:51:52.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f18173b70 con 0x7f7f180e78b0 2023-10-16T08:51:52.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.719+0000 7ff279166640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff27415c9f0 0x7ff27415a6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00efc0 tx=0x7ff26c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 -- 172.21.15.94:0/3551708447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 msgr2=0x7f5e980ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/3551708447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e980ccc00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009870 tx=0x7f5e8c02ba10 comp rx=0 tx=0).stop 2023-10-16T08:51:52.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f3f427fc640 1 -- 172.21.15.94:0/1342912197 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c031830 con 0x7f3f4415cb60 2023-10-16T08:51:52.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f3f427fc640 1 -- 172.21.15.94:0/1342912197 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c031990 con 0x7f3f4415cb60 2023-10-16T08:51:52.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 -- 172.21.15.94:0/3551708447 shutdown_connections 2023-10-16T08:51:52.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/3551708447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e980ccc00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/3551708447 >> v2:172.21.15.130:3300/0 conn(0x7f5e980b08c0 0x7f5e980cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 -- 172.21.15.94:0/3551708447 >> 172.21.15.94:0/3551708447 conn(0x7f5e980cb1b0 msgr2=0x7f5e980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 -- 172.21.15.94:0/3551708447 shutdown_connections 2023-10-16T08:51:52.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f5ea05ce640 1 -- 172.21.15.94:0/3551708447 wait complete. 2023-10-16T08:51:52.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.721+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f18173d90 con 0x7f7f180e78b0 2023-10-16T08:51:52.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.720+0000 7f3f427fc640 1 -- 172.21.15.94:0/1342912197 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c031830 con 0x7f3f4415cb60 2023-10-16T08:51:52.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.721+0000 7f3f49d83640 1 -- 172.21.15.94:0/1342912197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4415cb60 msgr2=0x7f3f440cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.721+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1342912197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4415cb60 0x7f3f440cde90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0097a0 tx=0x7f3f3c02b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.721+0000 7f3f49d83640 1 -- 172.21.15.94:0/1342912197 shutdown_connections 2023-10-16T08:51:52.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.721+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1342912197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4415cb60 0x7f3f440cde90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.721+0000 7f3f49d83640 1 -- 172.21.15.94:0/1342912197 >> 172.21.15.94:0/1342912197 conn(0x7f3f4406a440 msgr2=0x7f3f440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.722+0000 7f3f49d83640 1 -- 172.21.15.94:0/1342912197 shutdown_connections 2023-10-16T08:51:52.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.722+0000 7f3f49d83640 1 -- 172.21.15.94:0/1342912197 wait complete. 2023-10-16T08:51:52.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.723+0000 7f5ea05ce640 1 Processor -- start 2023-10-16T08:51:52.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.723+0000 7f5ea05ce640 1 -- start start 2023-10-16T08:51:52.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.724+0000 7f3f49d83640 1 Processor -- start 2023-10-16T08:51:52.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.723+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c00cd30 con 0x7ff27415c9f0 2023-10-16T08:51:52.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.724+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c00f040 con 0x7ff27415c9f0 2023-10-16T08:51:52.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.724+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c003bd0 con 0x7ff27415c9f0 2023-10-16T08:51:52.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.724+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5c412a060 con 0x7fe5bc0066a0 2023-10-16T08:51:52.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.724+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2640094d0 con 0x7ff27415c9f0 2023-10-16T08:51:52.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.724+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27414fc80 con 0x7ff27415c9f0 2023-10-16T08:51:52.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f3f49d83640 1 -- start start 2023-10-16T08:51:52.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f5ea05ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e980b08c0 0x7f5e98164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f5ea05ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98160e80 0x7f5e98161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f5ea05ce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e9815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f5ea05ce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98161bc0 con 0x7f5e98160e80 2023-10-16T08:51:52.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f5ea05ce640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980b1330 con 0x7f5e980b08c0 2023-10-16T08:51:52.766 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f5ea05ce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9815f380 con 0x7f5e981656a0 2023-10-16T08:51:52.767 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f10acf43640 1 -- 172.21.15.94:0/840291044 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a002cc60 con 0x7f10a80d3340 2023-10-16T08:51:52.767 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f10acf43640 1 -- 172.21.15.94:0/840291044 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a002cdc0 con 0x7f10a80d3340 2023-10-16T08:51:52.767 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f10acf43640 1 -- 172.21.15.94:0/840291044 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0034660 con 0x7f10a80d3340 2023-10-16T08:51:52.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f3f49d83640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 0x7f3f4415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f3f49d83640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f440b08c0 0x7f3f440b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f3f49d83640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f4415cb60 0x7f3f440c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f3f49d83640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441516f0 con 0x7f3f4415cb60 2023-10-16T08:51:52.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f3f49d83640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440b21f0 con 0x7f3f4406dd90 2023-10-16T08:51:52.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f3f49d83640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440b24d0 con 0x7f3f440b08c0 2023-10-16T08:51:52.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f5e9db69640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98160e80 0x7f5e98161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f5e9db69640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98160e80 0x7f5e98161680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57150/0 (socket says 172.21.15.94:57150) 2023-10-16T08:51:52.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f5e9db69640 1 -- 172.21.15.94:0/892998455 learned_addr learned my addr 172.21.15.94:0/892998455 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f5e9e36a640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e980b08c0 0x7f5e98164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f3f437fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 0x7f3f4415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f3f437fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 0x7f3f4415bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58374/0 (socket says 172.21.15.94:58374) 2023-10-16T08:51:52.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f3f437fe640 1 -- 172.21.15.94:0/1059519123 learned_addr learned my addr 172.21.15.94:0/1059519123 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f3f42ffd640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f440b08c0 0x7f3f440b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2740cef70 con 0x7ff27415c9f0 2023-10-16T08:51:52.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.725+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7f0c01a400 con 0x7f7f180e78b0 2023-10-16T08:51:52.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f5e9eb6b640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e9815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f10aef47640 1 -- 172.21.15.94:0/840291044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 msgr2=0x7f10a80d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.726+0000 7f10aef47640 1 --2- 172.21.15.94:0/840291044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80d0ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009d90 tx=0x7f10a002beb0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f7f16ffd640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7f0806af40 0x7f7f0806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.727+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f0c089e80 con 0x7f7f180e78b0 2023-10-16T08:51:52.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f7f1e59c640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7f0806af40 0x7f7f0806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f10aef47640 1 -- 172.21.15.94:0/840291044 shutdown_connections 2023-10-16T08:51:52.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f10aef47640 1 --2- 172.21.15.94:0/840291044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80d0ea0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f10aef47640 1 --2- 172.21.15.94:0/840291044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a80cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f10aef47640 1 -- 172.21.15.94:0/840291044 >> 172.21.15.94:0/840291044 conn(0x7f10a809bbf0 msgr2=0x7f10a80d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f10aef47640 1 -- 172.21.15.94:0/840291044 shutdown_connections 2023-10-16T08:51:52.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f3f437fe640 1 -- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f440b08c0 msgr2=0x7f3f440b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f3f437fe640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f440b08c0 0x7f3f440b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f3f437fe640 1 -- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f4415cb60 msgr2=0x7f3f440c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f10aef47640 1 -- 172.21.15.94:0/840291044 wait complete. 2023-10-16T08:51:52.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.729+0000 7f7f1e59c640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7f0806af40 0x7f7f0806d400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7f1002b910 tx=0x7f7f1003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e980b08c0 msgr2=0x7f5e98164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f5e9eb6b640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e980b08c0 0x7f5e98164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98160e80 msgr2=0x7f5e98161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f5e9eb6b640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98160e80 0x7f5e98161680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f5e9eb6b640 1 -- 172.21.15.94:0/892998455 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0094d0 con 0x7f5e981656a0 2023-10-16T08:51:52.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f5e9e36a640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e980b08c0 0x7f5e98164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:52.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.729+0000 7f5e9eb6b640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e9815ee40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c033000 tx=0x7f5e8c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c03b040 con 0x7f5e981656a0 2023-10-16T08:51:52.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c037df0 con 0x7f5e981656a0 2023-10-16T08:51:52.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9815f800 con 0x7f5e981656a0 2023-10-16T08:51:52.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0426c0 con 0x7f5e981656a0 2023-10-16T08:51:52.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.731+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e980b1580 con 0x7f5e981656a0 2023-10-16T08:51:52.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.728+0000 7f3f43fff640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f4415cb60 0x7f3f440c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f3f437fe640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f4415cb60 0x7f3f440c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f3f437fe640 1 -- 172.21.15.94:0/1059519123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009400 con 0x7f3f4406dd90 2023-10-16T08:51:52.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f3f43fff640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f4415cb60 0x7f3f440c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:52.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.730+0000 7f3f437fe640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 0x7f3f4415bd80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c000c00 tx=0x7f3f3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.733+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98073ef0 con 0x7f5e981656a0 2023-10-16T08:51:52.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.733+0000 7f10aef47640 1 Processor -- start 2023-10-16T08:51:52.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.731+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff26c014480 con 0x7ff27415c9f0 2023-10-16T08:51:52.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.732+0000 7ff2697fa640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff26006af40 0x7ff26006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.732+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff26c08a3a0 con 0x7ff27415c9f0 2023-10-16T08:51:52.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.734+0000 7f10aef47640 1 -- start start 2023-10-16T08:51:52.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.734+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e8c042820 con 0x7f5e981656a0 2023-10-16T08:51:52.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.735+0000 7ff278965640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff26006af40 0x7ff26006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.735+0000 7ff278965640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff26006af40 0x7ff26006d400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff270007fd0 tx=0x7ff270009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f10aef47640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10a80d13e0 0x7f10a80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f5e8affd640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5e7c06aec0 0x7f5e7c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e8c0acad0 con 0x7f5e981656a0 2023-10-16T08:51:52.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f10aef47640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f10ad744640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f10ad744640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57168/0 (socket says 172.21.15.94:57168) 2023-10-16T08:51:52.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.736+0000 7f10adf45640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10a80d13e0 0x7f10a80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10adf45640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10a80d13e0 0x7f10a80b7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:58382/0 (socket says 172.21.15.94:58382) 2023-10-16T08:51:52.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10aef47640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a8158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10aef47640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81f82d0 con 0x7f10a80d3340 2023-10-16T08:51:52.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10aef47640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80b8140 con 0x7f10a80d13e0 2023-10-16T08:51:52.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10aef47640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81f75d0 con 0x7f10a815cbd0 2023-10-16T08:51:52.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10ad744640 1 -- 172.21.15.94:0/1037594572 learned_addr learned my addr 172.21.15.94:0/1037594572 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10ad744640 1 -- 172.21.15.94:0/1037594572 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 msgr2=0x7f10a8158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10ad744640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a8158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10ad744640 1 -- 172.21.15.94:0/1037594572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10a80d13e0 msgr2=0x7f10a80b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10ad744640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10a80d13e0 0x7f10a80b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.737+0000 7f10ad744640 1 -- 172.21.15.94:0/1037594572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009a70 con 0x7f10a80d3340 2023-10-16T08:51:52.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.738+0000 7f5e9e36a640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5e7c06aec0 0x7f5e7c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.738+0000 7f5e9e36a640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5e7c06aec0 0x7f5e7c06d380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e900012e0 tx=0x7f5e90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.738+0000 7f10ad744640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80b35f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009d90 tx=0x7f10a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.739+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a003e610 con 0x7f10a80d3340 2023-10-16T08:51:52.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.740+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a003e790 con 0x7f10a80d3340 2023-10-16T08:51:52.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.740+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a003eb40 con 0x7f10a80d3340 2023-10-16T08:51:52.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.740+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a81f7870 con 0x7f10a80d3340 2023-10-16T08:51:52.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.740+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a8159470 con 0x7f10a80d3340 2023-10-16T08:51:52.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.740+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff26c0551f0 con 0x7ff27415c9f0 2023-10-16T08:51:52.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.740+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003610 con 0x7f3f4406dd90 2023-10-16T08:51:52.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.741+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440b27b0 con 0x7f3f4406dd90 2023-10-16T08:51:52.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.741+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c03f070 con 0x7f3f4406dd90 2023-10-16T08:51:52.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.741+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003610 con 0x7f3f4406dd90 2023-10-16T08:51:52.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.741+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f0c054c20 con 0x7f7f180e78b0 2023-10-16T08:51:52.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.741+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440b2d70 con 0x7f3f4406dd90 2023-10-16T08:51:52.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.742+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a81f7a60 con 0x7f10a80d3340 2023-10-16T08:51:52.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.744+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f10a003b050 con 0x7f10a80d3340 2023-10-16T08:51:52.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.746+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f3c003770 con 0x7f3f4406dd90 2023-10-16T08:51:52.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.746+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f440b2f60 con 0x7f3f4406dd90 2023-10-16T08:51:52.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.747+0000 7f3f3bfff640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f2406aed0 0x7f3f2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.747+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f3c041070 con 0x7f3f4406dd90 2023-10-16T08:51:52.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.748+0000 7f3f42ffd640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f2406aed0 0x7f3f2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.746+0000 7f109e7fc640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f108c06ae70 0x7f108c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.747+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10a00ac0e0 con 0x7f10a80d3340 2023-10-16T08:51:52.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.747+0000 7f10adf45640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f108c06ae70 0x7f108c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.748+0000 7f10adf45640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f108c06ae70 0x7f108c06d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f10a80b8360 tx=0x7f1098009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.749+0000 7f3f42ffd640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f2406aed0 0x7f3f2406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f440b1bf0 tx=0x7f3f3400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.750+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e8c077a50 con 0x7f5e981656a0 2023-10-16T08:51:52.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.755+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10a0076f40 con 0x7f10a80d3340 2023-10-16T08:51:52.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.760+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f3c0766e0 con 0x7f3f4406dd90 2023-10-16T08:51:52.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.769+0000 7f9e0c92e640 1 Processor -- start 2023-10-16T08:51:52.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.769+0000 7f9e0c92e640 1 -- start start 2023-10-16T08:51:52.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.772+0000 7f9e0c92e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e080ad7e0 0x7f9e0815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.772+0000 7f9e0c92e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080aafd0 con 0x7f9e080cc200 2023-10-16T08:51:52.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.773+0000 7f9e0c92e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080ab590 con 0x7f9e0815c340 2023-10-16T08:51:52.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.773+0000 7f9e07fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9e0815c340 0x7f9e080aba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:59410/0 (socket says 172.21.15.94:59410) 2023-10-16T08:51:52.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.773+0000 7f9e07fff640 1 -- 172.21.15.94:0/3546747517 learned_addr learned my addr 172.21.15.94:0/3546747517 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:52.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.773+0000 7f9e0c92e640 1 -- 172.21.15.94:0/3546747517 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e080c1d70 con 0x7f9e080ad7e0 2023-10-16T08:51:52.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.773+0000 7f9dfeffd640 1 --2- 172.21.15.94:0/3546747517 >> v2:172.21.15.94:3300/0 conn(0x7f9e080ad7e0 0x7f9e0815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.775+0000 7f9dfeffd640 1 -- 172.21.15.94:0/3546747517 >> v1:172.21.15.130:6789/0 conn(0x7f9e0815c340 legacy=0x7f9e080aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:52.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.775+0000 7f9dfeffd640 1 -- 172.21.15.94:0/3546747517 >> v1:172.21.15.94:6789/0 conn(0x7f9e080cc200 legacy=0x7f9e080cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.776+0000 7f9dfeffd640 1 -- 172.21.15.94:0/3546747517 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080cccf0 con 0x7f9e080ad7e0 2023-10-16T08:51:52.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.778+0000 7f9dfeffd640 1 --2- 172.21.15.94:0/3546747517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080ad7e0 0x7f9e0815be00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9df00097a0 tx=0x7f9df002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc96777602dd724 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.778+0000 7f9e06ffd640 1 -- 172.21.15.94:0/3546747517 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df002f050 con 0x7f9e080ad7e0 2023-10-16T08:51:52.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.779+0000 7f9e06ffd640 1 -- 172.21.15.94:0/3546747517 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0031700 con 0x7f9e080ad7e0 2023-10-16T08:51:52.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.780+0000 7f9e0c92e640 1 -- 172.21.15.94:0/3546747517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080ad7e0 msgr2=0x7f9e0815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.780+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/3546747517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080ad7e0 0x7f9e0815be00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9df00097a0 tx=0x7f9df002b7a0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.780+0000 7f9e0c92e640 1 -- 172.21.15.94:0/3546747517 shutdown_connections 2023-10-16T08:51:52.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.780+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/3546747517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080ad7e0 0x7f9e0815be00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.781+0000 7f9e0c92e640 1 -- 172.21.15.94:0/3546747517 >> 172.21.15.94:0/3546747517 conn(0x7f9e080ce3c0 msgr2=0x7f9e080ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:52.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.781+0000 7f9e0c92e640 1 -- 172.21.15.94:0/3546747517 shutdown_connections 2023-10-16T08:51:52.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.781+0000 7f9e0c92e640 1 -- 172.21.15.94:0/3546747517 wait complete. 2023-10-16T08:51:52.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.784+0000 7f9e0c92e640 1 Processor -- start 2023-10-16T08:51:52.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.785+0000 7f9e0c92e640 1 -- start start 2023-10-16T08:51:52.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.787+0000 7f9e0c92e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 0x7f9e08157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.787+0000 7f9e0c92e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 0x7f9e080c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.788+0000 7f9e077fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 0x7f9e08157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.788+0000 7f9e077fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 0x7f9e08157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:47220/0 (socket says 172.21.15.94:47220) 2023-10-16T08:51:52.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.788+0000 7f9dfeffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 0x7f9e080c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.789+0000 7f9dfeffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 0x7f9e080c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57182/0 (socket says 172.21.15.94:57182) 2023-10-16T08:51:52.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.789+0000 7f9e0c92e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0815c340 0x7f9e0815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.789+0000 7f9e0c92e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080c6d60 con 0x7f9e080cc200 2023-10-16T08:51:52.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.789+0000 7f9e0c92e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080b23a0 con 0x7f9e0815c340 2023-10-16T08:51:52.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.789+0000 7f9e0c92e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080b2680 con 0x7f9e080ad7e0 2023-10-16T08:51:52.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.789+0000 7f9e077fe640 1 -- 172.21.15.94:0/510100239 learned_addr learned my addr 172.21.15.94:0/510100239 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:52.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.790+0000 7f9e07fff640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0815c340 0x7f9e0815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.790+0000 7f9e07fff640 1 -- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 msgr2=0x7f9e08157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.790+0000 7f9e07fff640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 0x7f9e08157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.790+0000 7f9e07fff640 1 -- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 msgr2=0x7f9e080c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:52.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.790+0000 7f9e07fff640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 0x7f9e080c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.790+0000 7f9e07fff640 1 -- 172.21.15.94:0/510100239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0009400 con 0x7f9e0815c340 2023-10-16T08:51:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.791+0000 7f9dfeffd640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 0x7f9e080c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.791+0000 7f9e077fe640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 0x7f9e08157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-16T08:51:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.792+0000 7f9e07fff640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0815c340 0x7f9e0815ae50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000b3e0 tx=0x7f9e0000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.792+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011830 con 0x7f9e0815c340 2023-10-16T08:51:52.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.792+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e080b2960 con 0x7f9e0815c340 2023-10-16T08:51:52.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.792+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e080b2f20 con 0x7f9e0815c340 2023-10-16T08:51:52.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.793+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00011990 con 0x7f9e0815c340 2023-10-16T08:51:52.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.793+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011830 con 0x7f9e0815c340 2023-10-16T08:51:52.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.794+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec005250 con 0x7f9e0815c340 2023-10-16T08:51:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.797+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e00011b40 con 0x7f9e0815c340 2023-10-16T08:51:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.798+0000 7f9e04ff9640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9de806aed0 0x7f9de806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.799+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e000894a0 con 0x7f9e0815c340 2023-10-16T08:51:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.800+0000 7f9e077fe640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9de806aed0 0x7f9de806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.802+0000 7f9e077fe640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9de806aed0 0x7f9de806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e080b2330 tx=0x7f9df8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:52.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:52.809+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e00054240 con 0x7f9e0815c340 2023-10-16T08:51:53.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.088+0000 7f773064f640 1 -- 172.21.15.94:0/1745309467 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7728144ac0 con 0x7f7728160f40 2023-10-16T08:51:53.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.089+0000 7f771effd640 1 -- 172.21.15.94:0/1745309467 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7720057b80 con 0x7f7728160f40 2023-10-16T08:51:53.094 INFO:teuthology.orchestra.run.smithi094.stdout:60129542155 2023-10-16T08:51:53.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.092+0000 7f771cff9640 1 -- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f770c06af40 msgr2=0x7f770c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.092+0000 7f771cff9640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f770c06af40 0x7f770c06d400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7724006fd0 tx=0x7f7724008040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.092+0000 7f771cff9640 1 -- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 msgr2=0x7f7728099250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.095 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.092+0000 7f771cff9640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 0x7f7728099250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f772000ce50 tx=0x7f772000a430 comp rx=0 tx=0).stop 2023-10-16T08:51:53.096 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 -- 172.21.15.94:0/1745309467 shutdown_connections 2023-10-16T08:51:53.096 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7728160f40 0x7f7728099250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f770c06af40 0x7f770c06d400 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77280ce2e0 0x7f7728098d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 --2- 172.21.15.94:0/1745309467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77280c18c0 0x7f772815ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 -- 172.21.15.94:0/1745309467 >> 172.21.15.94:0/1745309467 conn(0x7f7728071400 msgr2=0x7f77280b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.094+0000 7f771cff9640 1 -- 172.21.15.94:0/1745309467 shutdown_connections 2023-10-16T08:51:53.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.095+0000 7f771cff9640 1 -- 172.21.15.94:0/1745309467 wait complete. 2023-10-16T08:51:53.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2023-10-16T08:51:53.123 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.127 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.126+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe5bc038770 con 0x7fe5bc0066a0 2023-10-16T08:51:53.128 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.126+0000 7fe5c17fa640 1 -- 172.21.15.94:0/3816069184 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5c40b2020 con 0x7fe5bc0066a0 2023-10-16T08:51:53.128 INFO:teuthology.orchestra.run.smithi094.stdout:60129542155 2023-10-16T08:51:53.132 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe5a806aef0 msgr2=0x7fe5a806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.133 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe5a806aef0 0x7fe5a806d3b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0eab10 tx=0x7fe5b8009040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.133 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 msgr2=0x7fe5bc180320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.133 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 0x7fe5bc180320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4067c70 tx=0x7fe5c4067ab0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.133 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 shutdown_connections 2023-10-16T08:51:53.133 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5bc0eb050 0x7fe5bc04ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe5a806aef0 0x7fe5a806d3b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc0de3d0 0x7fe5bc04f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 --2- 172.21.15.94:0/3816069184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5bc0066a0 0x7fe5bc180320 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.130+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 >> 172.21.15.94:0/3816069184 conn(0x7fe5bc055a90 msgr2=0x7fe5bc0e07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.131+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 shutdown_connections 2023-10-16T08:51:53.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.131+0000 7fe5cb1bb640 1 -- 172.21.15.94:0/3816069184 wait complete. 2023-10-16T08:51:53.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2023-10-16T08:51:53.149 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.163+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff27414fe70 con 0x7ff27415c9f0 2023-10-16T08:51:53.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.164+0000 7ff2697fa640 1 -- 172.21.15.94:0/1512144365 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff26c058810 con 0x7ff27415c9f0 2023-10-16T08:51:53.166 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:53.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.164+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f18005490 con 0x7f7f180e78b0 2023-10-16T08:51:53.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.165+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3f44073ef0 con 0x7f3f4406dd90 2023-10-16T08:51:53.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.165+0000 7f7f16ffd640 1 -- 172.21.15.94:0/4052340386 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f0c015090 con 0x7f7f180e78b0 2023-10-16T08:51:53.168 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:53.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.166+0000 7f3f3bfff640 1 -- 172.21.15.94:0/1059519123 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f3c079d00 con 0x7f3f4406dd90 2023-10-16T08:51:53.169 INFO:teuthology.orchestra.run.smithi094.stdout:60129542154 2023-10-16T08:51:53.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff26006af40 msgr2=0x7ff26006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff26006af40 0x7ff26006d400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff270007fd0 tx=0x7ff270009040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff27415c9f0 msgr2=0x7ff27415a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff27415c9f0 0x7ff27415a6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00efc0 tx=0x7ff26c00c490 comp rx=0 tx=0).stop 2023-10-16T08:51:53.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 shutdown_connections 2023-10-16T08:51:53.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff27415c9f0 0x7ff27415a6a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff26006af40 0x7ff26006d400 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2740cdbc0 0x7ff2740c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 --2- 172.21.15.94:0/1512144365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2740b83b0 0x7ff2740c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 >> 172.21.15.94:0/1512144365 conn(0x7ff274071510 msgr2=0x7ff2740cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 shutdown_connections 2023-10-16T08:51:53.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.167+0000 7ff27abc9640 1 -- 172.21.15.94:0/1512144365 wait complete. 2023-10-16T08:51:53.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.168+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5e980b4690 con 0x7f5e981656a0 2023-10-16T08:51:53.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.168+0000 7f5e8affd640 1 -- 172.21.15.94:0/892998455 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e8c07b070 con 0x7f5e981656a0 2023-10-16T08:51:53.173 INFO:teuthology.orchestra.run.smithi094.stdout:64424509451 2023-10-16T08:51:53.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.168+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7f0806af40 msgr2=0x7f7f0806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.168+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7f0806af40 0x7f7f0806d400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7f1002b910 tx=0x7f7f1003c040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.168+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180e78b0 msgr2=0x7f7f18170e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.168+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180e78b0 0x7f7f18170e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00b3e0 tx=0x7f7f0c00b7e0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 shutdown_connections 2023-10-16T08:51:53.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7f180eb2c0 0x7f7f181728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7f0806af40 0x7f7f0806d400 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180e78b0 0x7f7f18170e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 --2- 172.21.15.94:0/4052340386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f18052fe0 0x7f7f180e25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 >> 172.21.15.94:0/4052340386 conn(0x7f7f18054c10 msgr2=0x7f7f18053450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 shutdown_connections 2023-10-16T08:51:53.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f7f1f59e640 1 -- 172.21.15.94:0/4052340386 wait complete. 2023-10-16T08:51:53.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f2406aed0 msgr2=0x7f3f2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f2406aed0 0x7f3f2406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f440b1bf0 tx=0x7f3f3400d040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 msgr2=0x7f3f4415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.169+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 0x7f3f4415bd80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c000c00 tx=0x7f3f3c0046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 shutdown_connections 2023-10-16T08:51:53.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f4415cb60 0x7f3f440c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f440b08c0 0x7f3f440b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f2406aed0 0x7f3f2406d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 --2- 172.21.15.94:0/1059519123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f4406dd90 0x7f3f4415bd80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 >> 172.21.15.94:0/1059519123 conn(0x7f3f4406a440 msgr2=0x7f3f440cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 shutdown_connections 2023-10-16T08:51:53.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.170+0000 7f3f49d83640 1 -- 172.21.15.94:0/1059519123 wait complete. 2023-10-16T08:51:53.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5e7c06aec0 msgr2=0x7f5e7c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5e7c06aec0 0x7f5e7c06d380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e900012e0 tx=0x7f5e90009040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 msgr2=0x7f5e9815ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e9815ee40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c033000 tx=0x7f5e8c0046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 shutdown_connections 2023-10-16T08:51:53.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e981656a0 0x7f5e9815ee40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5e98160e80 0x7f5e98161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5e7c06aec0 0x7f5e7c06d380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 --2- 172.21.15.94:0/892998455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e980b08c0 0x7f5e98164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 >> 172.21.15.94:0/892998455 conn(0x7f5e980cb1b0 msgr2=0x7f5e980ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 shutdown_connections 2023-10-16T08:51:53.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.172+0000 7f5ea05ce640 1 -- 172.21.15.94:0/892998455 wait complete. 2023-10-16T08:51:53.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.175+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f10a804e9b0 con 0x7f10a80d3340 2023-10-16T08:51:53.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.175+0000 7f109e7fc640 1 -- 172.21.15.94:0/1037594572 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10a007a560 con 0x7f10a80d3340 2023-10-16T08:51:53.182 INFO:teuthology.orchestra.run.smithi094.stdout:60129542155 2023-10-16T08:51:53.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f108c06ae70 msgr2=0x7f108c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f108c06ae70 0x7f108c06d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f10a80b8360 tx=0x7f1098009210 comp rx=0 tx=0).stop 2023-10-16T08:51:53.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 msgr2=0x7f10a80b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80b35f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009d90 tx=0x7f10a0004a40 comp rx=0 tx=0).stop 2023-10-16T08:51:53.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 shutdown_connections 2023-10-16T08:51:53.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10a815cbd0 0x7f10a8158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10a80d3340 0x7f10a80b35f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f108c06ae70 0x7f108c06d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 --2- 172.21.15.94:0/1037594572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10a80d13e0 0x7f10a80b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 >> 172.21.15.94:0/1037594572 conn(0x7f10a809bbf0 msgr2=0x7f10a80d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 shutdown_connections 2023-10-16T08:51:53.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.179+0000 7f10aef47640 1 -- 172.21.15.94:0/1037594572 wait complete. 2023-10-16T08:51:53.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2023-10-16T08:51:53.197 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2023-10-16T08:51:53.199 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2023-10-16T08:51:53.199 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-10-16T08:51:53.202 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2023-10-16T08:51:53.203 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.206+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9dec0057d0 con 0x7f9e0815c340 2023-10-16T08:51:53.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.207+0000 7f9e04ff9640 1 -- 172.21.15.94:0/510100239 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e00057860 con 0x7f9e0815c340 2023-10-16T08:51:53.209 INFO:teuthology.orchestra.run.smithi094.stdout:64424509452 2023-10-16T08:51:53.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9de806aed0 msgr2=0x7f9de806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9de806aed0 0x7f9de806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e080b2330 tx=0x7f9df8009040 comp rx=0 tx=0).stop 2023-10-16T08:51:53.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0815c340 msgr2=0x7f9e0815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0815c340 0x7f9e0815ae50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000b3e0 tx=0x7f9e0000b8a0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 shutdown_connections 2023-10-16T08:51:53.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9de806aed0 0x7f9de806d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e0815c340 0x7f9e0815ae50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e080cc200 0x7f9e080c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 --2- 172.21.15.94:0/510100239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e080ad7e0 0x7f9e08157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 >> 172.21.15.94:0/510100239 conn(0x7f9e080ce3c0 msgr2=0x7f9e0806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.209+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 shutdown_connections 2023-10-16T08:51:53.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.210+0000 7f9e0c92e640 1 -- 172.21.15.94:0/510100239 wait complete. 2023-10-16T08:51:53.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.7 2023-10-16T08:51:53.228 DEBUG:teuthology.parallel:result is None 2023-10-16T08:51:53.228 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T08:51:53.228 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T08:51:53.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.468+0000 7fe866de9640 1 Processor -- start 2023-10-16T08:51:53.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.468+0000 7fe866de9640 1 -- start start 2023-10-16T08:51:53.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe866de9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe86015ad00 0x7fe8600701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe866de9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe86015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe866de9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8600707f0 con 0x7fe8600b0010 2023-10-16T08:51:53.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe866de9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe860070ad0 con 0x7fe86015ad00 2023-10-16T08:51:53.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe866de9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86015b1d0 con 0x7fe86015f040 2023-10-16T08:51:53.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe864b85640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe8600b0010 0x7fe8600b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50994/0 (socket says 172.21.15.94:50994) 2023-10-16T08:51:53.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.469+0000 7fe864b85640 1 -- 172.21.15.94:0/658737838 learned_addr learned my addr 172.21.15.94:0/658737838 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:53.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe865386640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe86015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948794883 0 0) 0x7fe8600707f0 con 0x7fe8600b0010 2023-10-16T08:51:53.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85ffff640 1 --2- 172.21.15.94:0/658737838 >> v2:172.21.15.130:3300/0 conn(0x7fe86015ad00 0x7fe8600701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe850003520 con 0x7fe8600b0010 2023-10-16T08:51:53.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1814118257 0 0) 0x7fe850003520 con 0x7fe8600b0010 2023-10-16T08:51:53.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 msgr2=0x7fe86015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe86015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 >> v2:172.21.15.130:3300/0 conn(0x7fe86015ad00 msgr2=0x7fe8600701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 --2- 172.21.15.94:0/658737838 >> v2:172.21.15.130:3300/0 conn(0x7fe86015ad00 0x7fe8600701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86015b4b0 con 0x7fe8600b0010 2023-10-16T08:51:53.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fe854001670 con 0x7fe8600b0010 2023-10-16T08:51:53.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe865386640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe86015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:53.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 >> v1:172.21.15.94:6789/0 conn(0x7fe8600b0010 legacy=0x7fe8600b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe850003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8500047c0 0x7fe850004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe850005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860070ad0 con 0x7fe8500039e0 2023-10-16T08:51:53.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86015b1d0 con 0x7fe8500047c0 2023-10-16T08:51:53.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.470+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85000ba60 con 0x7fe86015f040 2023-10-16T08:51:53.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe864b85640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe850003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe865386640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe850005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe85ffff640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8500047c0 0x7fe850004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe864b85640 1 -- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 msgr2=0x7fe850005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe864b85640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe850005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe864b85640 1 -- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8500047c0 msgr2=0x7fe850004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe864b85640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8500047c0 0x7fe850004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe864b85640 1 -- 172.21.15.94:0/658737838 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850003520 con 0x7fe8500039e0 2023-10-16T08:51:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.471+0000 7fe865386640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe86015f040 0x7fe850005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.472+0000 7fe864b85640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe850003e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c210 tx=0x7fe8500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8491b3bee11ac417 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.472+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854005ad0 con 0x7fe8500039e0 2023-10-16T08:51:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.472+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854005c30 con 0x7fe8500039e0 2023-10-16T08:51:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.472+0000 7fe85f7fe640 1 -- 172.21.15.94:0/658737838 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85402c8a0 con 0x7fe8500039e0 2023-10-16T08:51:53.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe866de9640 1 -- 172.21.15.94:0/658737838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 msgr2=0x7fe850003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe866de9640 1 --2- 172.21.15.94:0/658737838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe850003e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c210 tx=0x7fe8500057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe865386640 1 -- 172.21.15.94:0/658737838 reap_dead start 2023-10-16T08:51:53.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe866de9640 1 -- 172.21.15.94:0/658737838 shutdown_connections 2023-10-16T08:51:53.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe866de9640 1 -- 172.21.15.94:0/658737838 >> 172.21.15.94:0/658737838 conn(0x7fe86006c1c0 msgr2=0x7fe86006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe866de9640 1 -- 172.21.15.94:0/658737838 shutdown_connections 2023-10-16T08:51:53.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.473+0000 7fe866de9640 1 -- 172.21.15.94:0/658737838 wait complete. 2023-10-16T08:51:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.475+0000 7fe866de9640 1 Processor -- start 2023-10-16T08:51:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.475+0000 7fe866de9640 1 -- start start 2023-10-16T08:51:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe866de9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe860150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe866de9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8600c5660 0x7fe8600aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe866de9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8600c5ae0 0x7fe8600af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe866de9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c6cc0 con 0x7fe8500039e0 2023-10-16T08:51:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe866de9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c6040 con 0x7fe8600c5ae0 2023-10-16T08:51:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe866de9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c6320 con 0x7fe8600c5660 2023-10-16T08:51:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe860150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe860150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57204/0 (socket says 172.21.15.94:57204) 2023-10-16T08:51:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 -- 172.21.15.94:0/1282816180 learned_addr learned my addr 172.21.15.94:0/1282816180 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 -- 172.21.15.94:0/1282816180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8600c5660 msgr2=0x7fe8600aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8600c5660 0x7fe8600aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 -- 172.21.15.94:0/1282816180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8600c5ae0 msgr2=0x7fe8600af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8600c5ae0 0x7fe8600af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.476+0000 7fe864b85640 1 -- 172.21.15.94:0/1282816180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600c6600 con 0x7fe8500039e0 2023-10-16T08:51:53.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.477+0000 7fe864b85640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe860150f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe85402c440 tx=0x7fe854001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:53.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.477+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854039070 con 0x7fe8500039e0 2023-10-16T08:51:53.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.477+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85402ccb0 con 0x7fe8500039e0 2023-10-16T08:51:53.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.477+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85403c040 con 0x7fe8500039e0 2023-10-16T08:51:53.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.477+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8600c68e0 con 0x7fe8500039e0 2023-10-16T08:51:53.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.477+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8600b3c80 con 0x7fe8500039e0 2023-10-16T08:51:53.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.478+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860073ef0 con 0x7fe8500039e0 2023-10-16T08:51:53.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.479+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe854032070 con 0x7fe8500039e0 2023-10-16T08:51:53.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.480+0000 7fe85d7fa640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe84406aea0 0x7fe84406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.480+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8540aabf0 con 0x7fe8500039e0 2023-10-16T08:51:53.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.480+0000 7fe85ffff640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe84406aea0 0x7fe84406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.481+0000 7fe85ffff640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe84406aea0 0x7fe84406d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe84c006a90 tx=0x7fe84c006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:53.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.484+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe854075a40 con 0x7fe8500039e0 2023-10-16T08:51:53.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.657+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 --> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8600c6490 con 0x7fe84406aea0 2023-10-16T08:51:53.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.684+0000 7fe85d7fa640 1 -- 172.21.15.94:0/1282816180 <== mgr.4107 v2:172.21.15.94:6832/2208206022 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345033 (secure 0 0 0) 0x7fe8600c6490 con 0x7fe84406aea0 2023-10-16T08:51:53.688 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:53.693 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2023-10-16T08:51:53.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe84406aea0 msgr2=0x7fe84406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe84406aea0 0x7fe84406d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe84c006a90 tx=0x7fe84c006a20 comp rx=0 tx=0).stop 2023-10-16T08:51:53.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 msgr2=0x7fe860150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe860150f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe85402c440 tx=0x7fe854001a00 comp rx=0 tx=0).stop 2023-10-16T08:51:53.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 shutdown_connections 2023-10-16T08:51:53.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe84406aea0 0x7fe84406d360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8600c5ae0 0x7fe8600af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8600c5660 0x7fe8600aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 --2- 172.21.15.94:0/1282816180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe8500039e0 0x7fe860150f80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 >> 172.21.15.94:0/1282816180 conn(0x7fe86006c1c0 msgr2=0x7fe8600cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.692+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 shutdown_connections 2023-10-16T08:51:53.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.693+0000 7fe866de9640 1 -- 172.21.15.94:0/1282816180 wait complete. 2023-10-16T08:51:53.715 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-10-16T08:51:51.823974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236140,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":3416064,"data_stored":2045726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004621"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664629+0000","last_change":"2023-10-16T08:51:18.472763+0000","last_active":"2023-10-16T08:51:23.664629+0000","last_peered":"2023-10-16T08:51:23.664629+0000","last_clean":"2023-10-16T08:51:23.664629+0000","last_became_active":"2023-10-16T08:51:18.472447+0000","last_became_peered":"2023-10-16T08:51:18.472447+0000","last_unstale":"2023-10-16T08:51:23.664629+0000","last_undegraded":"2023-10-16T08:51:23.664629+0000","last_fullsized":"2023-10-16T08:51:23.664629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:21.069905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656591+0000","last_change":"2023-10-16T08:51:19.478851+0000","last_active":"2023-10-16T08:51:23.656591+0000","last_peered":"2023-10-16T08:51:23.656591+0000","last_clean":"2023-10-16T08:51:23.656591+0000","last_became_active":"2023-10-16T08:51:19.478587+0000","last_became_peered":"2023-10-16T08:51:19.478587+0000","last_unstale":"2023-10-16T08:51:23.656591+0000","last_undegraded":"2023-10-16T08:51:23.656591+0000","last_fullsized":"2023-10-16T08:51:23.656591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632168+0000","last_change":"2023-10-16T08:51:23.936156+0000","last_active":"2023-10-16T08:51:24.632168+0000","last_peered":"2023-10-16T08:51:24.632168+0000","last_clean":"2023-10-16T08:51:24.632168+0000","last_became_active":"2023-10-16T08:51:23.935275+0000","last_became_peered":"2023-10-16T08:51:23.935275+0000","last_unstale":"2023-10-16T08:51:24.632168+0000","last_undegraded":"2023-10-16T08:51:24.632168+0000","last_fullsized":"2023-10-16T08:51:24.632168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:23.584433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656765+0000","last_change":"2023-10-16T08:51:18.463620+0000","last_active":"2023-10-16T08:51:23.656765+0000","last_peered":"2023-10-16T08:51:23.656765+0000","last_clean":"2023-10-16T08:51:23.656765+0000","last_became_active":"2023-10-16T08:51:18.463088+0000","last_became_peered":"2023-10-16T08:51:18.463088+0000","last_unstale":"2023-10-16T08:51:23.656765+0000","last_undegraded":"2023-10-16T08:51:23.656765+0000","last_fullsized":"2023-10-16T08:51:23.656765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664153+0000","last_change":"2023-10-16T08:51:19.483778+0000","last_active":"2023-10-16T08:51:23.664153+0000","last_peered":"2023-10-16T08:51:23.664153+0000","last_clean":"2023-10-16T08:51:23.664153+0000","last_became_active":"2023-10-16T08:51:19.479538+0000","last_became_peered":"2023-10-16T08:51:19.479538+0000","last_unstale":"2023-10-16T08:51:23.664153+0000","last_undegraded":"2023-10-16T08:51:23.664153+0000","last_fullsized":"2023-10-16T08:51:23.664153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001998+0000","last_change":"2023-10-16T08:51:23.687361+0000","last_active":"2023-10-16T08:51:25.001998+0000","last_peered":"2023-10-16T08:51:25.001998+0000","last_clean":"2023-10-16T08:51:25.001998+0000","last_became_active":"2023-10-16T08:51:23.686758+0000","last_became_peered":"2023-10-16T08:51:23.686758+0000","last_unstale":"2023-10-16T08:51:25.001998+0000","last_undegraded":"2023-10-16T08:51:25.001998+0000","last_fullsized":"2023-10-16T08:51:25.001998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:04.836076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932744+0000","last_change":"2023-10-16T08:51:18.479211+0000","last_active":"2023-10-16T08:51:23.932744+0000","last_peered":"2023-10-16T08:51:23.932744+0000","last_clean":"2023-10-16T08:51:23.932744+0000","last_became_active":"2023-10-16T08:51:18.478753+0000","last_became_peered":"2023-10-16T08:51:18.478753+0000","last_unstale":"2023-10-16T08:51:23.932744+0000","last_undegraded":"2023-10-16T08:51:23.932744+0000","last_fullsized":"2023-10-16T08:51:23.932744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:13.887687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655634+0000","last_change":"2023-10-16T08:51:19.497246+0000","last_active":"2023-10-16T08:51:23.655634+0000","last_peered":"2023-10-16T08:51:23.655634+0000","last_clean":"2023-10-16T08:51:23.655634+0000","last_became_active":"2023-10-16T08:51:19.496966+0000","last_became_peered":"2023-10-16T08:51:19.496966+0000","last_unstale":"2023-10-16T08:51:23.655634+0000","last_undegraded":"2023-10-16T08:51:23.655634+0000","last_fullsized":"2023-10-16T08:51:23.655634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002504+0000","last_change":"2023-10-16T08:51:23.694314+0000","last_active":"2023-10-16T08:51:25.002504+0000","last_peered":"2023-10-16T08:51:25.002504+0000","last_clean":"2023-10-16T08:51:25.002504+0000","last_became_active":"2023-10-16T08:51:23.693789+0000","last_became_peered":"2023-10-16T08:51:23.693789+0000","last_unstale":"2023-10-16T08:51:25.002504+0000","last_undegraded":"2023-10-16T08:51:25.002504+0000","last_fullsized":"2023-10-16T08:51:25.002504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:34.725310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928781+0000","last_change":"2023-10-16T08:51:18.480432+0000","last_active":"2023-10-16T08:51:23.928781+0000","last_peered":"2023-10-16T08:51:23.928781+0000","last_clean":"2023-10-16T08:51:23.928781+0000","last_became_active":"2023-10-16T08:51:18.479649+0000","last_became_peered":"2023-10-16T08:51:18.479649+0000","last_unstale":"2023-10-16T08:51:23.928781+0000","last_undegraded":"2023-10-16T08:51:23.928781+0000","last_fullsized":"2023-10-16T08:51:23.928781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:59.612239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657088+0000","last_change":"2023-10-16T08:51:19.501369+0000","last_active":"2023-10-16T08:51:23.657088+0000","last_peered":"2023-10-16T08:51:23.657088+0000","last_clean":"2023-10-16T08:51:23.657088+0000","last_became_active":"2023-10-16T08:51:19.501077+0000","last_became_peered":"2023-10-16T08:51:19.501077+0000","last_unstale":"2023-10-16T08:51:23.657088+0000","last_undegraded":"2023-10-16T08:51:23.657088+0000","last_fullsized":"2023-10-16T08:51:23.657088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:04.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002122+0000","last_change":"2023-10-16T08:51:23.684667+0000","last_active":"2023-10-16T08:51:25.002122+0000","last_peered":"2023-10-16T08:51:25.002122+0000","last_clean":"2023-10-16T08:51:25.002122+0000","last_became_active":"2023-10-16T08:51:23.683885+0000","last_became_peered":"2023-10-16T08:51:23.683885+0000","last_unstale":"2023-10-16T08:51:25.002122+0000","last_undegraded":"2023-10-16T08:51:25.002122+0000","last_fullsized":"2023-10-16T08:51:25.002122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:31.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669202+0000","last_change":"2023-10-16T08:51:19.494151+0000","last_active":"2023-10-16T08:51:23.669202+0000","last_peered":"2023-10-16T08:51:23.669202+0000","last_clean":"2023-10-16T08:51:23.669202+0000","last_became_active":"2023-10-16T08:51:19.493825+0000","last_became_peered":"2023-10-16T08:51:19.493825+0000","last_unstale":"2023-10-16T08:51:23.669202+0000","last_undegraded":"2023-10-16T08:51:23.669202+0000","last_fullsized":"2023-10-16T08:51:23.669202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932601+0000","last_change":"2023-10-16T08:51:18.475975+0000","last_active":"2023-10-16T08:51:23.932601+0000","last_peered":"2023-10-16T08:51:23.932601+0000","last_clean":"2023-10-16T08:51:23.932601+0000","last_became_active":"2023-10-16T08:51:18.474515+0000","last_became_peered":"2023-10-16T08:51:18.474515+0000","last_unstale":"2023-10-16T08:51:23.932601+0000","last_undegraded":"2023-10-16T08:51:23.932601+0000","last_fullsized":"2023-10-16T08:51:23.932601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:19.036322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004645+0000","last_change":"2023-10-16T08:51:23.687410+0000","last_active":"2023-10-16T08:51:25.004645+0000","last_peered":"2023-10-16T08:51:25.004645+0000","last_clean":"2023-10-16T08:51:25.004645+0000","last_became_active":"2023-10-16T08:51:23.686729+0000","last_became_peered":"2023-10-16T08:51:23.686729+0000","last_unstale":"2023-10-16T08:51:25.004645+0000","last_undegraded":"2023-10-16T08:51:25.004645+0000","last_fullsized":"2023-10-16T08:51:25.004645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653922+0000","last_change":"2023-10-16T08:51:19.472792+0000","last_active":"2023-10-16T08:51:23.653922+0000","last_peered":"2023-10-16T08:51:23.653922+0000","last_clean":"2023-10-16T08:51:23.653922+0000","last_became_active":"2023-10-16T08:51:19.472538+0000","last_became_peered":"2023-10-16T08:51:19.472538+0000","last_unstale":"2023-10-16T08:51:23.653922+0000","last_undegraded":"2023-10-16T08:51:23.653922+0000","last_fullsized":"2023-10-16T08:51:23.653922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676788+0000","last_change":"2023-10-16T08:51:18.460657+0000","last_active":"2023-10-16T08:51:23.676788+0000","last_peered":"2023-10-16T08:51:23.676788+0000","last_clean":"2023-10-16T08:51:23.676788+0000","last_became_active":"2023-10-16T08:51:18.460294+0000","last_became_peered":"2023-10-16T08:51:18.460294+0000","last_unstale":"2023-10-16T08:51:23.676788+0000","last_undegraded":"2023-10-16T08:51:23.676788+0000","last_fullsized":"2023-10-16T08:51:23.676788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003182+0000","last_change":"2023-10-16T08:51:23.687710+0000","last_active":"2023-10-16T08:51:25.003182+0000","last_peered":"2023-10-16T08:51:25.003182+0000","last_clean":"2023-10-16T08:51:25.003182+0000","last_became_active":"2023-10-16T08:51:23.686904+0000","last_became_peered":"2023-10-16T08:51:23.686904+0000","last_unstale":"2023-10-16T08:51:25.003182+0000","last_undegraded":"2023-10-16T08:51:25.003182+0000","last_fullsized":"2023-10-16T08:51:25.003182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658779+0000","last_change":"2023-10-16T08:51:19.493284+0000","last_active":"2023-10-16T08:51:23.658779+0000","last_peered":"2023-10-16T08:51:23.658779+0000","last_clean":"2023-10-16T08:51:23.658779+0000","last_became_active":"2023-10-16T08:51:19.493001+0000","last_became_peered":"2023-10-16T08:51:19.493001+0000","last_unstale":"2023-10-16T08:51:23.658779+0000","last_undegraded":"2023-10-16T08:51:23.658779+0000","last_fullsized":"2023-10-16T08:51:23.658779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676274+0000","last_change":"2023-10-16T08:51:18.474813+0000","last_active":"2023-10-16T08:51:23.676274+0000","last_peered":"2023-10-16T08:51:23.676274+0000","last_clean":"2023-10-16T08:51:23.676274+0000","last_became_active":"2023-10-16T08:51:18.474551+0000","last_became_peered":"2023-10-16T08:51:18.474551+0000","last_unstale":"2023-10-16T08:51:23.676274+0000","last_undegraded":"2023-10-16T08:51:23.676274+0000","last_fullsized":"2023-10-16T08:51:23.676274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:14:07.961126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630476+0000","last_change":"2023-10-16T08:51:23.936794+0000","last_active":"2023-10-16T08:51:24.630476+0000","last_peered":"2023-10-16T08:51:24.630476+0000","last_clean":"2023-10-16T08:51:24.630476+0000","last_became_active":"2023-10-16T08:51:23.936108+0000","last_became_peered":"2023-10-16T08:51:23.936108+0000","last_unstale":"2023-10-16T08:51:24.630476+0000","last_undegraded":"2023-10-16T08:51:24.630476+0000","last_fullsized":"2023-10-16T08:51:24.630476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:54.425130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674596+0000","last_change":"2023-10-16T08:51:19.487794+0000","last_active":"2023-10-16T08:51:23.674596+0000","last_peered":"2023-10-16T08:51:23.674596+0000","last_clean":"2023-10-16T08:51:23.674596+0000","last_became_active":"2023-10-16T08:51:19.487394+0000","last_became_peered":"2023-10-16T08:51:19.487394+0000","last_unstale":"2023-10-16T08:51:23.674596+0000","last_undegraded":"2023-10-16T08:51:23.674596+0000","last_fullsized":"2023-10-16T08:51:23.674596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:55.545822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927706+0000","last_change":"2023-10-16T08:51:18.475910+0000","last_active":"2023-10-16T08:51:23.927706+0000","last_peered":"2023-10-16T08:51:23.927706+0000","last_clean":"2023-10-16T08:51:23.927706+0000","last_became_active":"2023-10-16T08:51:18.475567+0000","last_became_peered":"2023-10-16T08:51:18.475567+0000","last_unstale":"2023-10-16T08:51:23.927706+0000","last_undegraded":"2023-10-16T08:51:23.927706+0000","last_fullsized":"2023-10-16T08:51:23.927706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003131+0000","last_change":"2023-10-16T08:51:23.688779+0000","last_active":"2023-10-16T08:51:25.003131+0000","last_peered":"2023-10-16T08:51:25.003131+0000","last_clean":"2023-10-16T08:51:25.003131+0000","last_became_active":"2023-10-16T08:51:23.688065+0000","last_became_peered":"2023-10-16T08:51:23.688065+0000","last_unstale":"2023-10-16T08:51:25.003131+0000","last_undegraded":"2023-10-16T08:51:25.003131+0000","last_fullsized":"2023-10-16T08:51:25.003131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:37.434614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.668428+0000","last_change":"2023-10-16T08:51:19.483164+0000","last_active":"2023-10-16T08:51:23.668428+0000","last_peered":"2023-10-16T08:51:23.668428+0000","last_clean":"2023-10-16T08:51:23.668428+0000","last_became_active":"2023-10-16T08:51:19.482701+0000","last_became_peered":"2023-10-16T08:51:19.482701+0000","last_unstale":"2023-10-16T08:51:23.668428+0000","last_undegraded":"2023-10-16T08:51:23.668428+0000","last_fullsized":"2023-10-16T08:51:23.668428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:30:05.215149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673453+0000","last_change":"2023-10-16T08:51:18.479436+0000","last_active":"2023-10-16T08:51:23.673453+0000","last_peered":"2023-10-16T08:51:23.673453+0000","last_clean":"2023-10-16T08:51:23.673453+0000","last_became_active":"2023-10-16T08:51:18.479112+0000","last_became_peered":"2023-10-16T08:51:18.479112+0000","last_unstale":"2023-10-16T08:51:23.673453+0000","last_undegraded":"2023-10-16T08:51:23.673453+0000","last_fullsized":"2023-10-16T08:51:23.673453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:18.761013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002204+0000","last_change":"2023-10-16T08:51:23.941023+0000","last_active":"2023-10-16T08:51:25.002204+0000","last_peered":"2023-10-16T08:51:25.002204+0000","last_clean":"2023-10-16T08:51:25.002204+0000","last_became_active":"2023-10-16T08:51:23.939686+0000","last_became_peered":"2023-10-16T08:51:23.939686+0000","last_unstale":"2023-10-16T08:51:25.002204+0000","last_undegraded":"2023-10-16T08:51:25.002204+0000","last_fullsized":"2023-10-16T08:51:25.002204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:13.170275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657614+0000","last_change":"2023-10-16T08:51:19.480568+0000","last_active":"2023-10-16T08:51:23.657614+0000","last_peered":"2023-10-16T08:51:23.657614+0000","last_clean":"2023-10-16T08:51:23.657614+0000","last_became_active":"2023-10-16T08:51:19.480223+0000","last_became_peered":"2023-10-16T08:51:19.480223+0000","last_unstale":"2023-10-16T08:51:23.657614+0000","last_undegraded":"2023-10-16T08:51:23.657614+0000","last_fullsized":"2023-10-16T08:51:23.657614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.426065+0000","last_change":"2023-10-16T08:51:18.478908+0000","last_active":"2023-10-16T08:51:24.426065+0000","last_peered":"2023-10-16T08:51:24.426065+0000","last_clean":"2023-10-16T08:51:24.426065+0000","last_became_active":"2023-10-16T08:51:18.478555+0000","last_became_peered":"2023-10-16T08:51:18.478555+0000","last_unstale":"2023-10-16T08:51:24.426065+0000","last_undegraded":"2023-10-16T08:51:24.426065+0000","last_fullsized":"2023-10-16T08:51:24.426065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:08.306658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631947+0000","last_change":"2023-10-16T08:51:23.932191+0000","last_active":"2023-10-16T08:51:24.631947+0000","last_peered":"2023-10-16T08:51:24.631947+0000","last_clean":"2023-10-16T08:51:24.631947+0000","last_became_active":"2023-10-16T08:51:23.930143+0000","last_became_peered":"2023-10-16T08:51:23.930143+0000","last_unstale":"2023-10-16T08:51:24.631947+0000","last_undegraded":"2023-10-16T08:51:24.631947+0000","last_fullsized":"2023-10-16T08:51:24.631947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:39:17.871021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676364+0000","last_change":"2023-10-16T08:51:19.485482+0000","last_active":"2023-10-16T08:51:23.676364+0000","last_peered":"2023-10-16T08:51:23.676364+0000","last_clean":"2023-10-16T08:51:23.676364+0000","last_became_active":"2023-10-16T08:51:19.485128+0000","last_became_peered":"2023-10-16T08:51:19.485128+0000","last_unstale":"2023-10-16T08:51:23.676364+0000","last_undegraded":"2023-10-16T08:51:23.676364+0000","last_fullsized":"2023-10-16T08:51:23.676364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:44:22.627895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933002+0000","last_change":"2023-10-16T08:51:18.478714+0000","last_active":"2023-10-16T08:51:23.933002+0000","last_peered":"2023-10-16T08:51:23.933002+0000","last_clean":"2023-10-16T08:51:23.933002+0000","last_became_active":"2023-10-16T08:51:18.478354+0000","last_became_peered":"2023-10-16T08:51:18.478354+0000","last_unstale":"2023-10-16T08:51:23.933002+0000","last_undegraded":"2023-10-16T08:51:23.933002+0000","last_fullsized":"2023-10-16T08:51:23.933002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780092+0000","last_change":"2023-10-16T08:51:23.929043+0000","last_active":"2023-10-16T08:51:24.780092+0000","last_peered":"2023-10-16T08:51:24.780092+0000","last_clean":"2023-10-16T08:51:24.780092+0000","last_became_active":"2023-10-16T08:51:23.928546+0000","last_became_peered":"2023-10-16T08:51:23.928546+0000","last_unstale":"2023-10-16T08:51:24.780092+0000","last_undegraded":"2023-10-16T08:51:24.780092+0000","last_fullsized":"2023-10-16T08:51:24.780092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656981+0000","last_change":"2023-10-16T08:51:19.489157+0000","last_active":"2023-10-16T08:51:23.656981+0000","last_peered":"2023-10-16T08:51:23.656981+0000","last_clean":"2023-10-16T08:51:23.656981+0000","last_became_active":"2023-10-16T08:51:19.488862+0000","last_became_peered":"2023-10-16T08:51:19.488862+0000","last_unstale":"2023-10-16T08:51:23.656981+0000","last_undegraded":"2023-10-16T08:51:23.656981+0000","last_fullsized":"2023-10-16T08:51:23.656981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:15.931317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676443+0000","last_change":"2023-10-16T08:51:18.453987+0000","last_active":"2023-10-16T08:51:23.676443+0000","last_peered":"2023-10-16T08:51:23.676443+0000","last_clean":"2023-10-16T08:51:23.676443+0000","last_became_active":"2023-10-16T08:51:18.453706+0000","last_became_peered":"2023-10-16T08:51:18.453706+0000","last_unstale":"2023-10-16T08:51:23.676443+0000","last_undegraded":"2023-10-16T08:51:23.676443+0000","last_fullsized":"2023-10-16T08:51:23.676443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:24.379905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629365+0000","last_change":"2023-10-16T08:51:23.690542+0000","last_active":"2023-10-16T08:51:24.629365+0000","last_peered":"2023-10-16T08:51:24.629365+0000","last_clean":"2023-10-16T08:51:24.629365+0000","last_became_active":"2023-10-16T08:51:23.690171+0000","last_became_peered":"2023-10-16T08:51:23.690171+0000","last_unstale":"2023-10-16T08:51:24.629365+0000","last_undegraded":"2023-10-16T08:51:24.629365+0000","last_fullsized":"2023-10-16T08:51:24.629365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682083+0000","last_change":"2023-10-16T08:51:19.486242+0000","last_active":"2023-10-16T08:51:23.682083+0000","last_peered":"2023-10-16T08:51:23.682083+0000","last_clean":"2023-10-16T08:51:23.682083+0000","last_became_active":"2023-10-16T08:51:19.485941+0000","last_became_peered":"2023-10-16T08:51:19.485941+0000","last_unstale":"2023-10-16T08:51:23.682083+0000","last_undegraded":"2023-10-16T08:51:23.682083+0000","last_fullsized":"2023-10-16T08:51:23.682083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:06.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656642+0000","last_change":"2023-10-16T08:51:18.457937+0000","last_active":"2023-10-16T08:51:23.656642+0000","last_peered":"2023-10-16T08:51:23.656642+0000","last_clean":"2023-10-16T08:51:23.656642+0000","last_became_active":"2023-10-16T08:51:18.457566+0000","last_became_peered":"2023-10-16T08:51:18.457566+0000","last_unstale":"2023-10-16T08:51:23.656642+0000","last_undegraded":"2023-10-16T08:51:23.656642+0000","last_fullsized":"2023-10-16T08:51:23.656642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:38.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630284+0000","last_change":"2023-10-16T08:51:23.690160+0000","last_active":"2023-10-16T08:51:24.630284+0000","last_peered":"2023-10-16T08:51:24.630284+0000","last_clean":"2023-10-16T08:51:24.630284+0000","last_became_active":"2023-10-16T08:51:23.689134+0000","last_became_peered":"2023-10-16T08:51:23.689134+0000","last_unstale":"2023-10-16T08:51:24.630284+0000","last_undegraded":"2023-10-16T08:51:24.630284+0000","last_fullsized":"2023-10-16T08:51:24.630284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:38.891384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674275+0000","last_change":"2023-10-16T08:51:19.477337+0000","last_active":"2023-10-16T08:51:23.674275+0000","last_peered":"2023-10-16T08:51:23.674275+0000","last_clean":"2023-10-16T08:51:23.674275+0000","last_became_active":"2023-10-16T08:51:19.476998+0000","last_became_peered":"2023-10-16T08:51:19.476998+0000","last_unstale":"2023-10-16T08:51:23.674275+0000","last_undegraded":"2023-10-16T08:51:23.674275+0000","last_fullsized":"2023-10-16T08:51:23.674275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:33.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654094+0000","last_change":"2023-10-16T08:51:18.463848+0000","last_active":"2023-10-16T08:51:23.654094+0000","last_peered":"2023-10-16T08:51:23.654094+0000","last_clean":"2023-10-16T08:51:23.654094+0000","last_became_active":"2023-10-16T08:51:18.463071+0000","last_became_peered":"2023-10-16T08:51:18.463071+0000","last_unstale":"2023-10-16T08:51:23.654094+0000","last_undegraded":"2023-10-16T08:51:23.654094+0000","last_fullsized":"2023-10-16T08:51:23.654094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630687+0000","last_change":"2023-10-16T08:51:23.691542+0000","last_active":"2023-10-16T08:51:24.630687+0000","last_peered":"2023-10-16T08:51:24.630687+0000","last_clean":"2023-10-16T08:51:24.630687+0000","last_became_active":"2023-10-16T08:51:23.691184+0000","last_became_peered":"2023-10-16T08:51:23.691184+0000","last_unstale":"2023-10-16T08:51:24.630687+0000","last_undegraded":"2023-10-16T08:51:24.630687+0000","last_fullsized":"2023-10-16T08:51:24.630687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:30.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663653+0000","last_change":"2023-10-16T08:51:19.489377+0000","last_active":"2023-10-16T08:51:23.663653+0000","last_peered":"2023-10-16T08:51:23.663653+0000","last_clean":"2023-10-16T08:51:23.663653+0000","last_became_active":"2023-10-16T08:51:19.488616+0000","last_became_peered":"2023-10-16T08:51:19.488616+0000","last_unstale":"2023-10-16T08:51:23.663653+0000","last_undegraded":"2023-10-16T08:51:23.663653+0000","last_fullsized":"2023-10-16T08:51:23.663653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927969+0000","last_change":"2023-10-16T08:51:18.476307+0000","last_active":"2023-10-16T08:51:23.927969+0000","last_peered":"2023-10-16T08:51:23.927969+0000","last_clean":"2023-10-16T08:51:23.927969+0000","last_became_active":"2023-10-16T08:51:18.475934+0000","last_became_peered":"2023-10-16T08:51:18.475934+0000","last_unstale":"2023-10-16T08:51:23.927969+0000","last_undegraded":"2023-10-16T08:51:23.927969+0000","last_fullsized":"2023-10-16T08:51:23.927969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780681+0000","last_change":"2023-10-16T08:51:23.940016+0000","last_active":"2023-10-16T08:51:24.780681+0000","last_peered":"2023-10-16T08:51:24.780681+0000","last_clean":"2023-10-16T08:51:24.780681+0000","last_became_active":"2023-10-16T08:51:23.939540+0000","last_became_peered":"2023-10-16T08:51:23.939540+0000","last_unstale":"2023-10-16T08:51:24.780681+0000","last_undegraded":"2023-10-16T08:51:24.780681+0000","last_fullsized":"2023-10-16T08:51:24.780681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:06.205944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655322+0000","last_change":"2023-10-16T08:51:19.488905+0000","last_active":"2023-10-16T08:51:23.655322+0000","last_peered":"2023-10-16T08:51:23.655322+0000","last_clean":"2023-10-16T08:51:23.655322+0000","last_became_active":"2023-10-16T08:51:19.488447+0000","last_became_peered":"2023-10-16T08:51:19.488447+0000","last_unstale":"2023-10-16T08:51:23.655322+0000","last_undegraded":"2023-10-16T08:51:23.655322+0000","last_fullsized":"2023-10-16T08:51:23.655322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654978+0000","last_change":"2023-10-16T08:51:18.461925+0000","last_active":"2023-10-16T08:51:23.654978+0000","last_peered":"2023-10-16T08:51:23.654978+0000","last_clean":"2023-10-16T08:51:23.654978+0000","last_became_active":"2023-10-16T08:51:18.461503+0000","last_became_peered":"2023-10-16T08:51:18.461503+0000","last_unstale":"2023-10-16T08:51:23.654978+0000","last_undegraded":"2023-10-16T08:51:23.654978+0000","last_fullsized":"2023-10-16T08:51:23.654978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:25.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928140+0000","last_change":"2023-10-16T08:51:09.503647+0000","last_active":"2023-10-16T08:51:23.928140+0000","last_peered":"2023-10-16T08:51:23.928140+0000","last_clean":"2023-10-16T08:51:23.928140+0000","last_became_active":"2023-10-16T08:51:09.501573+0000","last_became_peered":"2023-10-16T08:51:09.501573+0000","last_unstale":"2023-10-16T08:51:23.928140+0000","last_undegraded":"2023-10-16T08:51:23.928140+0000","last_fullsized":"2023-10-16T08:51:23.928140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_clean_scrub_stamp":"2023-10-16T08:51:08.277379+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:32.541738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632345+0000","last_change":"2023-10-16T08:51:23.937102+0000","last_active":"2023-10-16T08:51:24.632345+0000","last_peered":"2023-10-16T08:51:24.632345+0000","last_clean":"2023-10-16T08:51:24.632345+0000","last_became_active":"2023-10-16T08:51:23.935917+0000","last_became_peered":"2023-10-16T08:51:23.935917+0000","last_unstale":"2023-10-16T08:51:24.632345+0000","last_undegraded":"2023-10-16T08:51:24.632345+0000","last_fullsized":"2023-10-16T08:51:24.632345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932357+0000","last_change":"2023-10-16T08:51:19.482065+0000","last_active":"2023-10-16T08:51:23.932357+0000","last_peered":"2023-10-16T08:51:23.932357+0000","last_clean":"2023-10-16T08:51:23.932357+0000","last_became_active":"2023-10-16T08:51:19.481709+0000","last_became_peered":"2023-10-16T08:51:19.481709+0000","last_unstale":"2023-10-16T08:51:23.932357+0000","last_undegraded":"2023-10-16T08:51:23.932357+0000","last_fullsized":"2023-10-16T08:51:23.932357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:52.502214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656330+0000","last_change":"2023-10-16T08:51:18.461990+0000","last_active":"2023-10-16T08:51:23.656330+0000","last_peered":"2023-10-16T08:51:23.656330+0000","last_clean":"2023-10-16T08:51:23.656330+0000","last_became_active":"2023-10-16T08:51:18.461726+0000","last_became_peered":"2023-10-16T08:51:18.461726+0000","last_unstale":"2023-10-16T08:51:23.656330+0000","last_undegraded":"2023-10-16T08:51:23.656330+0000","last_fullsized":"2023-10-16T08:51:23.656330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:00.458386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631811+0000","last_change":"2023-10-16T08:51:23.931184+0000","last_active":"2023-10-16T08:51:24.631811+0000","last_peered":"2023-10-16T08:51:24.631811+0000","last_clean":"2023-10-16T08:51:24.631811+0000","last_became_active":"2023-10-16T08:51:23.929798+0000","last_became_peered":"2023-10-16T08:51:23.929798+0000","last_unstale":"2023-10-16T08:51:24.631811+0000","last_undegraded":"2023-10-16T08:51:24.631811+0000","last_fullsized":"2023-10-16T08:51:24.631811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:24.877683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655861+0000","last_change":"2023-10-16T08:51:19.498976+0000","last_active":"2023-10-16T08:51:23.655861+0000","last_peered":"2023-10-16T08:51:23.655861+0000","last_clean":"2023-10-16T08:51:23.655861+0000","last_became_active":"2023-10-16T08:51:19.498594+0000","last_became_peered":"2023-10-16T08:51:19.498594+0000","last_unstale":"2023-10-16T08:51:23.655861+0000","last_undegraded":"2023-10-16T08:51:23.655861+0000","last_fullsized":"2023-10-16T08:51:23.655861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.675885+0000","last_change":"2023-10-16T08:51:18.466809+0000","last_active":"2023-10-16T08:51:23.675885+0000","last_peered":"2023-10-16T08:51:23.675885+0000","last_clean":"2023-10-16T08:51:23.675885+0000","last_became_active":"2023-10-16T08:51:18.466510+0000","last_became_peered":"2023-10-16T08:51:18.466510+0000","last_unstale":"2023-10-16T08:51:23.675885+0000","last_undegraded":"2023-10-16T08:51:23.675885+0000","last_fullsized":"2023-10-16T08:51:23.675885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:21:49.782547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780180+0000","last_change":"2023-10-16T08:51:23.685215+0000","last_active":"2023-10-16T08:51:24.780180+0000","last_peered":"2023-10-16T08:51:24.780180+0000","last_clean":"2023-10-16T08:51:24.780180+0000","last_became_active":"2023-10-16T08:51:23.684822+0000","last_became_peered":"2023-10-16T08:51:23.684822+0000","last_unstale":"2023-10-16T08:51:24.780180+0000","last_undegraded":"2023-10-16T08:51:24.780180+0000","last_fullsized":"2023-10-16T08:51:24.780180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933980+0000","last_change":"2023-10-16T08:51:19.499775+0000","last_active":"2023-10-16T08:51:23.933980+0000","last_peered":"2023-10-16T08:51:23.933980+0000","last_clean":"2023-10-16T08:51:23.933980+0000","last_became_active":"2023-10-16T08:51:19.499561+0000","last_became_peered":"2023-10-16T08:51:19.499561+0000","last_unstale":"2023-10-16T08:51:23.933980+0000","last_undegraded":"2023-10-16T08:51:23.933980+0000","last_fullsized":"2023-10-16T08:51:23.933980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:58:34.736828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655991+0000","last_change":"2023-10-16T08:51:18.461494+0000","last_active":"2023-10-16T08:51:23.655991+0000","last_peered":"2023-10-16T08:51:23.655991+0000","last_clean":"2023-10-16T08:51:23.655991+0000","last_became_active":"2023-10-16T08:51:18.461196+0000","last_became_peered":"2023-10-16T08:51:18.461196+0000","last_unstale":"2023-10-16T08:51:23.655991+0000","last_undegraded":"2023-10-16T08:51:23.655991+0000","last_fullsized":"2023-10-16T08:51:23.655991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004761+0000","last_change":"2023-10-16T08:51:23.942518+0000","last_active":"2023-10-16T08:51:25.004761+0000","last_peered":"2023-10-16T08:51:25.004761+0000","last_clean":"2023-10-16T08:51:25.004761+0000","last_became_active":"2023-10-16T08:51:23.940495+0000","last_became_peered":"2023-10-16T08:51:23.940495+0000","last_unstale":"2023-10-16T08:51:25.004761+0000","last_undegraded":"2023-10-16T08:51:25.004761+0000","last_fullsized":"2023-10-16T08:51:25.004761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932360+0000","last_change":"2023-10-16T08:51:19.502686+0000","last_active":"2023-10-16T08:51:23.932360+0000","last_peered":"2023-10-16T08:51:23.932360+0000","last_clean":"2023-10-16T08:51:23.932360+0000","last_became_active":"2023-10-16T08:51:19.502370+0000","last_became_peered":"2023-10-16T08:51:19.502370+0000","last_unstale":"2023-10-16T08:51:23.932360+0000","last_undegraded":"2023-10-16T08:51:23.932360+0000","last_fullsized":"2023-10-16T08:51:23.932360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:33.452930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682777+0000","last_change":"2023-10-16T08:51:18.457359+0000","last_active":"2023-10-16T08:51:23.682777+0000","last_peered":"2023-10-16T08:51:23.682777+0000","last_clean":"2023-10-16T08:51:23.682777+0000","last_became_active":"2023-10-16T08:51:18.454341+0000","last_became_peered":"2023-10-16T08:51:18.454341+0000","last_unstale":"2023-10-16T08:51:23.682777+0000","last_undegraded":"2023-10-16T08:51:23.682777+0000","last_fullsized":"2023-10-16T08:51:23.682777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001723+0000","last_change":"2023-10-16T08:51:23.687589+0000","last_active":"2023-10-16T08:51:25.001723+0000","last_peered":"2023-10-16T08:51:25.001723+0000","last_clean":"2023-10-16T08:51:25.001723+0000","last_became_active":"2023-10-16T08:51:23.687045+0000","last_became_peered":"2023-10-16T08:51:23.687045+0000","last_unstale":"2023-10-16T08:51:25.001723+0000","last_undegraded":"2023-10-16T08:51:25.001723+0000","last_fullsized":"2023-10-16T08:51:25.001723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:16.195721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927678+0000","last_change":"2023-10-16T08:51:19.499551+0000","last_active":"2023-10-16T08:51:23.927678+0000","last_peered":"2023-10-16T08:51:23.927678+0000","last_clean":"2023-10-16T08:51:23.927678+0000","last_became_active":"2023-10-16T08:51:19.499250+0000","last_became_peered":"2023-10-16T08:51:19.499250+0000","last_unstale":"2023-10-16T08:51:23.927678+0000","last_undegraded":"2023-10-16T08:51:23.927678+0000","last_fullsized":"2023-10-16T08:51:23.927678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:08.959209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653215+0000","last_change":"2023-10-16T08:51:18.452602+0000","last_active":"2023-10-16T08:51:23.653215+0000","last_peered":"2023-10-16T08:51:23.653215+0000","last_clean":"2023-10-16T08:51:23.653215+0000","last_became_active":"2023-10-16T08:51:18.452286+0000","last_became_peered":"2023-10-16T08:51:18.452286+0000","last_unstale":"2023-10-16T08:51:23.653215+0000","last_undegraded":"2023-10-16T08:51:23.653215+0000","last_fullsized":"2023-10-16T08:51:23.653215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:09.991021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780619+0000","last_change":"2023-10-16T08:51:23.680434+0000","last_active":"2023-10-16T08:51:24.780619+0000","last_peered":"2023-10-16T08:51:24.780619+0000","last_clean":"2023-10-16T08:51:24.780619+0000","last_became_active":"2023-10-16T08:51:23.679325+0000","last_became_peered":"2023-10-16T08:51:23.679325+0000","last_unstale":"2023-10-16T08:51:24.780619+0000","last_undegraded":"2023-10-16T08:51:24.780619+0000","last_fullsized":"2023-10-16T08:51:24.780619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:54.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666563+0000","last_change":"2023-10-16T08:51:19.477576+0000","last_active":"2023-10-16T08:51:23.666563+0000","last_peered":"2023-10-16T08:51:23.666563+0000","last_clean":"2023-10-16T08:51:23.666563+0000","last_became_active":"2023-10-16T08:51:19.477091+0000","last_became_peered":"2023-10-16T08:51:19.477091+0000","last_unstale":"2023-10-16T08:51:23.666563+0000","last_undegraded":"2023-10-16T08:51:23.666563+0000","last_fullsized":"2023-10-16T08:51:23.666563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669994+0000","last_change":"2023-10-16T08:51:18.471810+0000","last_active":"2023-10-16T08:51:23.669994+0000","last_peered":"2023-10-16T08:51:23.669994+0000","last_clean":"2023-10-16T08:51:23.669994+0000","last_became_active":"2023-10-16T08:51:18.471510+0000","last_became_peered":"2023-10-16T08:51:18.471510+0000","last_unstale":"2023-10-16T08:51:23.669994+0000","last_undegraded":"2023-10-16T08:51:23.669994+0000","last_fullsized":"2023-10-16T08:51:23.669994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633912+0000","last_change":"2023-10-16T08:51:23.938213+0000","last_active":"2023-10-16T08:51:24.633912+0000","last_peered":"2023-10-16T08:51:24.633912+0000","last_clean":"2023-10-16T08:51:24.633912+0000","last_became_active":"2023-10-16T08:51:23.937788+0000","last_became_peered":"2023-10-16T08:51:23.937788+0000","last_unstale":"2023-10-16T08:51:24.633912+0000","last_undegraded":"2023-10-16T08:51:24.633912+0000","last_fullsized":"2023-10-16T08:51:24.633912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:49:28.604941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932586+0000","last_change":"2023-10-16T08:51:19.505378+0000","last_active":"2023-10-16T08:51:23.932586+0000","last_peered":"2023-10-16T08:51:23.932586+0000","last_clean":"2023-10-16T08:51:23.932586+0000","last_became_active":"2023-10-16T08:51:19.500129+0000","last_became_peered":"2023-10-16T08:51:19.500129+0000","last_unstale":"2023-10-16T08:51:23.932586+0000","last_undegraded":"2023-10-16T08:51:23.932586+0000","last_fullsized":"2023-10-16T08:51:23.932586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:33.223548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656405+0000","last_change":"2023-10-16T08:51:18.462956+0000","last_active":"2023-10-16T08:51:23.656405+0000","last_peered":"2023-10-16T08:51:23.656405+0000","last_clean":"2023-10-16T08:51:23.656405+0000","last_became_active":"2023-10-16T08:51:18.462673+0000","last_became_peered":"2023-10-16T08:51:18.462673+0000","last_unstale":"2023-10-16T08:51:23.656405+0000","last_undegraded":"2023-10-16T08:51:23.656405+0000","last_fullsized":"2023-10-16T08:51:23.656405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:34.739453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.634200+0000","last_change":"2023-10-16T08:51:23.938458+0000","last_active":"2023-10-16T08:51:24.634200+0000","last_peered":"2023-10-16T08:51:24.634200+0000","last_clean":"2023-10-16T08:51:24.634200+0000","last_became_active":"2023-10-16T08:51:23.938009+0000","last_became_peered":"2023-10-16T08:51:23.938009+0000","last_unstale":"2023-10-16T08:51:24.634200+0000","last_undegraded":"2023-10-16T08:51:24.634200+0000","last_fullsized":"2023-10-16T08:51:24.634200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:17:08.498890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663209+0000","last_change":"2023-10-16T08:51:19.490700+0000","last_active":"2023-10-16T08:51:23.663209+0000","last_peered":"2023-10-16T08:51:23.663209+0000","last_clean":"2023-10-16T08:51:23.663209+0000","last_became_active":"2023-10-16T08:51:19.490423+0000","last_became_peered":"2023-10-16T08:51:19.490423+0000","last_unstale":"2023-10-16T08:51:23.663209+0000","last_undegraded":"2023-10-16T08:51:23.663209+0000","last_fullsized":"2023-10-16T08:51:23.663209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:19.773784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663431+0000","last_change":"2023-10-16T08:51:18.467662+0000","last_active":"2023-10-16T08:51:23.663431+0000","last_peered":"2023-10-16T08:51:23.663431+0000","last_clean":"2023-10-16T08:51:23.663431+0000","last_became_active":"2023-10-16T08:51:18.466371+0000","last_became_peered":"2023-10-16T08:51:18.466371+0000","last_unstale":"2023-10-16T08:51:23.663431+0000","last_undegraded":"2023-10-16T08:51:23.663431+0000","last_fullsized":"2023-10-16T08:51:23.663431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:41:34.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.009698+0000","last_change":"2023-10-16T08:51:23.933148+0000","last_active":"2023-10-16T08:51:25.009698+0000","last_peered":"2023-10-16T08:51:25.009698+0000","last_clean":"2023-10-16T08:51:25.009698+0000","last_became_active":"2023-10-16T08:51:23.929507+0000","last_became_peered":"2023-10-16T08:51:23.929507+0000","last_unstale":"2023-10-16T08:51:25.009698+0000","last_undegraded":"2023-10-16T08:51:25.009698+0000","last_fullsized":"2023-10-16T08:51:25.009698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932219+0000","last_change":"2023-10-16T08:51:19.489578+0000","last_active":"2023-10-16T08:51:23.932219+0000","last_peered":"2023-10-16T08:51:23.932219+0000","last_clean":"2023-10-16T08:51:23.932219+0000","last_became_active":"2023-10-16T08:51:19.489229+0000","last_became_peered":"2023-10-16T08:51:19.489229+0000","last_unstale":"2023-10-16T08:51:23.932219+0000","last_undegraded":"2023-10-16T08:51:23.932219+0000","last_fullsized":"2023-10-16T08:51:23.932219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:30.514244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:37.318046+0000","last_change":"2023-10-16T08:51:18.473025+0000","last_active":"2023-10-16T08:51:37.318046+0000","last_peered":"2023-10-16T08:51:37.318046+0000","last_clean":"2023-10-16T08:51:37.318046+0000","last_became_active":"2023-10-16T08:51:18.471838+0000","last_became_peered":"2023-10-16T08:51:18.471838+0000","last_unstale":"2023-10-16T08:51:37.318046+0000","last_undegraded":"2023-10-16T08:51:37.318046+0000","last_fullsized":"2023-10-16T08:51:37.318046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:29.907304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629165+0000","last_change":"2023-10-16T08:51:23.687837+0000","last_active":"2023-10-16T08:51:24.629165+0000","last_peered":"2023-10-16T08:51:24.629165+0000","last_clean":"2023-10-16T08:51:24.629165+0000","last_became_active":"2023-10-16T08:51:23.687415+0000","last_became_peered":"2023-10-16T08:51:23.687415+0000","last_unstale":"2023-10-16T08:51:24.629165+0000","last_undegraded":"2023-10-16T08:51:24.629165+0000","last_fullsized":"2023-10-16T08:51:24.629165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681874+0000","last_change":"2023-10-16T08:51:19.493209+0000","last_active":"2023-10-16T08:51:23.681874+0000","last_peered":"2023-10-16T08:51:23.681874+0000","last_clean":"2023-10-16T08:51:23.681874+0000","last_became_active":"2023-10-16T08:51:19.493039+0000","last_became_peered":"2023-10-16T08:51:19.493039+0000","last_unstale":"2023-10-16T08:51:23.681874+0000","last_undegraded":"2023-10-16T08:51:23.681874+0000","last_fullsized":"2023-10-16T08:51:23.681874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674711+0000","last_change":"2023-10-16T08:51:18.463657+0000","last_active":"2023-10-16T08:51:23.674711+0000","last_peered":"2023-10-16T08:51:23.674711+0000","last_clean":"2023-10-16T08:51:23.674711+0000","last_became_active":"2023-10-16T08:51:18.463329+0000","last_became_peered":"2023-10-16T08:51:18.463329+0000","last_unstale":"2023-10-16T08:51:23.674711+0000","last_undegraded":"2023-10-16T08:51:23.674711+0000","last_fullsized":"2023-10-16T08:51:23.674711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002944+0000","last_change":"2023-10-16T08:51:23.690913+0000","last_active":"2023-10-16T08:51:25.002944+0000","last_peered":"2023-10-16T08:51:25.002944+0000","last_clean":"2023-10-16T08:51:25.002944+0000","last_became_active":"2023-10-16T08:51:23.690240+0000","last_became_peered":"2023-10-16T08:51:23.690240+0000","last_unstale":"2023-10-16T08:51:25.002944+0000","last_undegraded":"2023-10-16T08:51:25.002944+0000","last_fullsized":"2023-10-16T08:51:25.002944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:12.508988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664438+0000","last_change":"2023-10-16T08:51:19.479453+0000","last_active":"2023-10-16T08:51:23.664438+0000","last_peered":"2023-10-16T08:51:23.664438+0000","last_clean":"2023-10-16T08:51:23.664438+0000","last_became_active":"2023-10-16T08:51:19.479175+0000","last_became_peered":"2023-10-16T08:51:19.479175+0000","last_unstale":"2023-10-16T08:51:23.664438+0000","last_undegraded":"2023-10-16T08:51:23.664438+0000","last_fullsized":"2023-10-16T08:51:23.664438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655640+0000","last_change":"2023-10-16T08:51:18.477626+0000","last_active":"2023-10-16T08:51:23.655640+0000","last_peered":"2023-10-16T08:51:23.655640+0000","last_clean":"2023-10-16T08:51:23.655640+0000","last_became_active":"2023-10-16T08:51:18.476856+0000","last_became_peered":"2023-10-16T08:51:18.476856+0000","last_unstale":"2023-10-16T08:51:23.655640+0000","last_undegraded":"2023-10-16T08:51:23.655640+0000","last_fullsized":"2023-10-16T08:51:23.655640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:06.623099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632401+0000","last_change":"2023-10-16T08:51:23.684289+0000","last_active":"2023-10-16T08:51:24.632401+0000","last_peered":"2023-10-16T08:51:24.632401+0000","last_clean":"2023-10-16T08:51:24.632401+0000","last_became_active":"2023-10-16T08:51:23.682351+0000","last_became_peered":"2023-10-16T08:51:23.682351+0000","last_unstale":"2023-10-16T08:51:24.632401+0000","last_undegraded":"2023-10-16T08:51:24.632401+0000","last_fullsized":"2023-10-16T08:51:24.632401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:19:24.423311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655380+0000","last_change":"2023-10-16T08:51:19.496098+0000","last_active":"2023-10-16T08:51:23.655380+0000","last_peered":"2023-10-16T08:51:23.655380+0000","last_clean":"2023-10-16T08:51:23.655380+0000","last_became_active":"2023-10-16T08:51:19.495623+0000","last_became_peered":"2023-10-16T08:51:19.495623+0000","last_unstale":"2023-10-16T08:51:23.655380+0000","last_undegraded":"2023-10-16T08:51:23.655380+0000","last_fullsized":"2023-10-16T08:51:23.655380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:50.322181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673307+0000","last_change":"2023-10-16T08:51:18.474818+0000","last_active":"2023-10-16T08:51:23.673307+0000","last_peered":"2023-10-16T08:51:23.673307+0000","last_clean":"2023-10-16T08:51:23.673307+0000","last_became_active":"2023-10-16T08:51:18.473153+0000","last_became_peered":"2023-10-16T08:51:18.473153+0000","last_unstale":"2023-10-16T08:51:23.673307+0000","last_undegraded":"2023-10-16T08:51:23.673307+0000","last_fullsized":"2023-10-16T08:51:23.673307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632414+0000","last_change":"2023-10-16T08:51:23.943636+0000","last_active":"2023-10-16T08:51:24.632414+0000","last_peered":"2023-10-16T08:51:24.632414+0000","last_clean":"2023-10-16T08:51:24.632414+0000","last_became_active":"2023-10-16T08:51:23.943081+0000","last_became_peered":"2023-10-16T08:51:23.943081+0000","last_unstale":"2023-10-16T08:51:24.632414+0000","last_undegraded":"2023-10-16T08:51:24.632414+0000","last_fullsized":"2023-10-16T08:51:24.632414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780507+0000","last_change":"2023-10-16T08:51:23.941536+0000","last_active":"2023-10-16T08:51:24.780507+0000","last_peered":"2023-10-16T08:51:24.780507+0000","last_clean":"2023-10-16T08:51:24.780507+0000","last_became_active":"2023-10-16T08:51:23.940210+0000","last_became_peered":"2023-10-16T08:51:23.940210+0000","last_unstale":"2023-10-16T08:51:24.780507+0000","last_undegraded":"2023-10-16T08:51:24.780507+0000","last_fullsized":"2023-10-16T08:51:24.780507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:20.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676073+0000","last_change":"2023-10-16T08:51:19.492153+0000","last_active":"2023-10-16T08:51:23.676073+0000","last_peered":"2023-10-16T08:51:23.676073+0000","last_clean":"2023-10-16T08:51:23.676073+0000","last_became_active":"2023-10-16T08:51:19.491873+0000","last_became_peered":"2023-10-16T08:51:19.491873+0000","last_unstale":"2023-10-16T08:51:23.676073+0000","last_undegraded":"2023-10-16T08:51:23.676073+0000","last_fullsized":"2023-10-16T08:51:23.676073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:20.049093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656917+0000","last_change":"2023-10-16T08:51:18.470467+0000","last_active":"2023-10-16T08:51:23.656917+0000","last_peered":"2023-10-16T08:51:23.656917+0000","last_clean":"2023-10-16T08:51:23.656917+0000","last_became_active":"2023-10-16T08:51:18.469986+0000","last_became_peered":"2023-10-16T08:51:18.469986+0000","last_unstale":"2023-10-16T08:51:23.656917+0000","last_undegraded":"2023-10-16T08:51:23.656917+0000","last_fullsized":"2023-10-16T08:51:23.656917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:00.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632702+0000","last_change":"2023-10-16T08:51:23.694583+0000","last_active":"2023-10-16T08:51:24.632702+0000","last_peered":"2023-10-16T08:51:24.632702+0000","last_clean":"2023-10-16T08:51:24.632702+0000","last_became_active":"2023-10-16T08:51:23.694186+0000","last_became_peered":"2023-10-16T08:51:23.694186+0000","last_unstale":"2023-10-16T08:51:24.632702+0000","last_undegraded":"2023-10-16T08:51:24.632702+0000","last_fullsized":"2023-10-16T08:51:24.632702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658643+0000","last_change":"2023-10-16T08:51:19.477096+0000","last_active":"2023-10-16T08:51:23.658643+0000","last_peered":"2023-10-16T08:51:23.658643+0000","last_clean":"2023-10-16T08:51:23.658643+0000","last_became_active":"2023-10-16T08:51:19.473590+0000","last_became_peered":"2023-10-16T08:51:19.473590+0000","last_unstale":"2023-10-16T08:51:23.658643+0000","last_undegraded":"2023-10-16T08:51:23.658643+0000","last_fullsized":"2023-10-16T08:51:23.658643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654035+0000","last_change":"2023-10-16T08:51:18.471924+0000","last_active":"2023-10-16T08:51:23.654035+0000","last_peered":"2023-10-16T08:51:23.654035+0000","last_clean":"2023-10-16T08:51:23.654035+0000","last_became_active":"2023-10-16T08:51:18.471592+0000","last_became_peered":"2023-10-16T08:51:18.471592+0000","last_unstale":"2023-10-16T08:51:23.654035+0000","last_undegraded":"2023-10-16T08:51:23.654035+0000","last_fullsized":"2023-10-16T08:51:23.654035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:47:19.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669470+0000","last_change":"2023-10-16T08:51:18.474173+0000","last_active":"2023-10-16T08:51:23.669470+0000","last_peered":"2023-10-16T08:51:23.669470+0000","last_clean":"2023-10-16T08:51:23.669470+0000","last_became_active":"2023-10-16T08:51:18.473185+0000","last_became_peered":"2023-10-16T08:51:18.473185+0000","last_unstale":"2023-10-16T08:51:23.669470+0000","last_undegraded":"2023-10-16T08:51:23.669470+0000","last_fullsized":"2023-10-16T08:51:23.669470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:09:12.237149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663356+0000","last_change":"2023-10-16T08:51:19.488282+0000","last_active":"2023-10-16T08:51:23.663356+0000","last_peered":"2023-10-16T08:51:23.663356+0000","last_clean":"2023-10-16T08:51:23.663356+0000","last_became_active":"2023-10-16T08:51:19.487960+0000","last_became_peered":"2023-10-16T08:51:19.487960+0000","last_unstale":"2023-10-16T08:51:23.663356+0000","last_undegraded":"2023-10-16T08:51:23.663356+0000","last_fullsized":"2023-10-16T08:51:23.663356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002055+0000","last_change":"2023-10-16T08:51:23.689131+0000","last_active":"2023-10-16T08:51:25.002055+0000","last_peered":"2023-10-16T08:51:25.002055+0000","last_clean":"2023-10-16T08:51:25.002055+0000","last_became_active":"2023-10-16T08:51:23.686763+0000","last_became_peered":"2023-10-16T08:51:23.686763+0000","last_unstale":"2023-10-16T08:51:25.002055+0000","last_undegraded":"2023-10-16T08:51:25.002055+0000","last_fullsized":"2023-10-16T08:51:25.002055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:19.111523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:18.475217+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:18.474923+0000","last_became_peered":"2023-10-16T08:51:18.474923+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681558+0000","last_change":"2023-10-16T08:51:19.490076+0000","last_active":"2023-10-16T08:51:23.681558+0000","last_peered":"2023-10-16T08:51:23.681558+0000","last_clean":"2023-10-16T08:51:23.681558+0000","last_became_active":"2023-10-16T08:51:19.489836+0000","last_became_peered":"2023-10-16T08:51:19.489836+0000","last_unstale":"2023-10-16T08:51:23.681558+0000","last_undegraded":"2023-10-16T08:51:23.681558+0000","last_fullsized":"2023-10-16T08:51:23.681558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:01.471157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633844+0000","last_change":"2023-10-16T08:51:23.681986+0000","last_active":"2023-10-16T08:51:24.633844+0000","last_peered":"2023-10-16T08:51:24.633844+0000","last_clean":"2023-10-16T08:51:24.633844+0000","last_became_active":"2023-10-16T08:51:23.681604+0000","last_became_peered":"2023-10-16T08:51:23.681604+0000","last_unstale":"2023-10-16T08:51:24.633844+0000","last_undegraded":"2023-10-16T08:51:24.633844+0000","last_fullsized":"2023-10-16T08:51:24.633844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666407+0000","last_change":"2023-10-16T08:51:19.477397+0000","last_active":"2023-10-16T08:51:23.666407+0000","last_peered":"2023-10-16T08:51:23.666407+0000","last_clean":"2023-10-16T08:51:23.666407+0000","last_became_active":"2023-10-16T08:51:19.476711+0000","last_became_peered":"2023-10-16T08:51:19.476711+0000","last_unstale":"2023-10-16T08:51:23.666407+0000","last_undegraded":"2023-10-16T08:51:23.666407+0000","last_fullsized":"2023-10-16T08:51:23.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:19.481363+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:19.480970+0000","last_became_peered":"2023-10-16T08:51:19.480970+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656160+0000","last_change":"2023-10-16T08:51:19.477774+0000","last_active":"2023-10-16T08:51:23.656160+0000","last_peered":"2023-10-16T08:51:23.656160+0000","last_clean":"2023-10-16T08:51:23.656160+0000","last_became_active":"2023-10-16T08:51:19.475123+0000","last_became_peered":"2023-10-16T08:51:19.475123+0000","last_unstale":"2023-10-16T08:51:23.656160+0000","last_undegraded":"2023-10-16T08:51:23.656160+0000","last_fullsized":"2023-10-16T08:51:23.656160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:28.688010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663346+0000","last_change":"2023-10-16T08:51:19.470555+0000","last_active":"2023-10-16T08:51:23.663346+0000","last_peered":"2023-10-16T08:51:23.663346+0000","last_clean":"2023-10-16T08:51:23.663346+0000","last_became_active":"2023-10-16T08:51:19.470021+0000","last_became_peered":"2023-10-16T08:51:19.470021+0000","last_unstale":"2023-10-16T08:51:23.663346+0000","last_undegraded":"2023-10-16T08:51:23.663346+0000","last_fullsized":"2023-10-16T08:51:23.663346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655354+0000","last_change":"2023-10-16T08:51:19.477990+0000","last_active":"2023-10-16T08:51:23.655354+0000","last_peered":"2023-10-16T08:51:23.655354+0000","last_clean":"2023-10-16T08:51:23.655354+0000","last_became_active":"2023-10-16T08:51:19.477299+0000","last_became_peered":"2023-10-16T08:51:19.477299+0000","last_unstale":"2023-10-16T08:51:23.655354+0000","last_undegraded":"2023-10-16T08:51:23.655354+0000","last_fullsized":"2023-10-16T08:51:23.655354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674606+0000","last_change":"2023-10-16T08:51:19.492134+0000","last_active":"2023-10-16T08:51:23.674606+0000","last_peered":"2023-10-16T08:51:23.674606+0000","last_clean":"2023-10-16T08:51:23.674606+0000","last_became_active":"2023-10-16T08:51:19.491859+0000","last_became_peered":"2023-10-16T08:51:19.491859+0000","last_unstale":"2023-10-16T08:51:23.674606+0000","last_undegraded":"2023-10-16T08:51:23.674606+0000","last_fullsized":"2023-10-16T08:51:23.674606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:50:38.473722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671269+0000","last_change":"2023-10-16T08:51:19.491815+0000","last_active":"2023-10-16T08:51:23.671269+0000","last_peered":"2023-10-16T08:51:23.671269+0000","last_clean":"2023-10-16T08:51:23.671269+0000","last_became_active":"2023-10-16T08:51:19.491422+0000","last_became_peered":"2023-10-16T08:51:19.491422+0000","last_unstale":"2023-10-16T08:51:23.671269+0000","last_undegraded":"2023-10-16T08:51:23.671269+0000","last_fullsized":"2023-10-16T08:51:23.671269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657516+0000","last_change":"2023-10-16T08:51:19.492217+0000","last_active":"2023-10-16T08:51:23.657516+0000","last_peered":"2023-10-16T08:51:23.657516+0000","last_clean":"2023-10-16T08:51:23.657516+0000","last_became_active":"2023-10-16T08:51:19.491892+0000","last_became_peered":"2023-10-16T08:51:19.491892+0000","last_unstale":"2023-10-16T08:51:23.657516+0000","last_undegraded":"2023-10-16T08:51:23.657516+0000","last_fullsized":"2023-10-16T08:51:23.657516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656714+0000","last_change":"2023-10-16T08:51:19.475841+0000","last_active":"2023-10-16T08:51:23.656714+0000","last_peered":"2023-10-16T08:51:23.656714+0000","last_clean":"2023-10-16T08:51:23.656714+0000","last_became_active":"2023-10-16T08:51:19.475196+0000","last_became_peered":"2023-10-16T08:51:19.475196+0000","last_unstale":"2023-10-16T08:51:23.656714+0000","last_undegraded":"2023-10-16T08:51:23.656714+0000","last_fullsized":"2023-10-16T08:51:23.656714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653907+0000","last_change":"2023-10-16T08:51:19.492583+0000","last_active":"2023-10-16T08:51:23.653907+0000","last_peered":"2023-10-16T08:51:23.653907+0000","last_clean":"2023-10-16T08:51:23.653907+0000","last_became_active":"2023-10-16T08:51:19.492322+0000","last_became_peered":"2023-10-16T08:51:19.492322+0000","last_unstale":"2023-10-16T08:51:23.653907+0000","last_undegraded":"2023-10-16T08:51:23.653907+0000","last_fullsized":"2023-10-16T08:51:23.653907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655778+0000","last_change":"2023-10-16T08:51:19.484234+0000","last_active":"2023-10-16T08:51:23.655778+0000","last_peered":"2023-10-16T08:51:23.655778+0000","last_clean":"2023-10-16T08:51:23.655778+0000","last_became_active":"2023-10-16T08:51:19.483921+0000","last_became_peered":"2023-10-16T08:51:19.483921+0000","last_unstale":"2023-10-16T08:51:23.655778+0000","last_undegraded":"2023-10-16T08:51:23.655778+0000","last_fullsized":"2023-10-16T08:51:23.655778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:20.666617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663277+0000","last_change":"2023-10-16T08:51:19.487699+0000","last_active":"2023-10-16T08:51:23.663277+0000","last_peered":"2023-10-16T08:51:23.663277+0000","last_clean":"2023-10-16T08:51:23.663277+0000","last_became_active":"2023-10-16T08:51:19.487423+0000","last_became_peered":"2023-10-16T08:51:19.487423+0000","last_unstale":"2023-10-16T08:51:23.663277+0000","last_undegraded":"2023-10-16T08:51:23.663277+0000","last_fullsized":"2023-10-16T08:51:23.663277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669411+0000","last_change":"2023-10-16T08:51:19.496931+0000","last_active":"2023-10-16T08:51:23.669411+0000","last_peered":"2023-10-16T08:51:23.669411+0000","last_clean":"2023-10-16T08:51:23.669411+0000","last_became_active":"2023-10-16T08:51:19.494302+0000","last_became_peered":"2023-10-16T08:51:19.494302+0000","last_unstale":"2023-10-16T08:51:23.669411+0000","last_undegraded":"2023-10-16T08:51:23.669411+0000","last_fullsized":"2023-10-16T08:51:23.669411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.934841+0000","last_change":"2023-10-16T08:51:19.482651+0000","last_active":"2023-10-16T08:51:23.934841+0000","last_peered":"2023-10-16T08:51:23.934841+0000","last_clean":"2023-10-16T08:51:23.934841+0000","last_became_active":"2023-10-16T08:51:19.482392+0000","last_became_peered":"2023-10-16T08:51:19.482392+0000","last_unstale":"2023-10-16T08:51:23.934841+0000","last_undegraded":"2023-10-16T08:51:23.934841+0000","last_fullsized":"2023-10-16T08:51:23.934841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:50.214064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655880+0000","last_change":"2023-10-16T08:51:19.492889+0000","last_active":"2023-10-16T08:51:23.655880+0000","last_peered":"2023-10-16T08:51:23.655880+0000","last_clean":"2023-10-16T08:51:23.655880+0000","last_became_active":"2023-10-16T08:51:19.492576+0000","last_became_peered":"2023-10-16T08:51:19.492576+0000","last_unstale":"2023-10-16T08:51:23.655880+0000","last_undegraded":"2023-10-16T08:51:23.655880+0000","last_fullsized":"2023-10-16T08:51:23.655880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656813+0000","last_change":"2023-10-16T08:51:19.497299+0000","last_active":"2023-10-16T08:51:23.656813+0000","last_peered":"2023-10-16T08:51:23.656813+0000","last_clean":"2023-10-16T08:51:23.656813+0000","last_became_active":"2023-10-16T08:51:19.495738+0000","last_became_peered":"2023-10-16T08:51:19.495738+0000","last_unstale":"2023-10-16T08:51:23.656813+0000","last_undegraded":"2023-10-16T08:51:23.656813+0000","last_fullsized":"2023-10-16T08:51:23.656813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:01.994879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656466+0000","last_change":"2023-10-16T08:51:19.476970+0000","last_active":"2023-10-16T08:51:23.656466+0000","last_peered":"2023-10-16T08:51:23.656466+0000","last_clean":"2023-10-16T08:51:23.656466+0000","last_became_active":"2023-10-16T08:51:19.475512+0000","last_became_peered":"2023-10-16T08:51:19.475512+0000","last_unstale":"2023-10-16T08:51:23.656466+0000","last_undegraded":"2023-10-16T08:51:23.656466+0000","last_fullsized":"2023-10-16T08:51:23.656466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676171+0000","last_change":"2023-10-16T08:51:19.495546+0000","last_active":"2023-10-16T08:51:23.676171+0000","last_peered":"2023-10-16T08:51:23.676171+0000","last_clean":"2023-10-16T08:51:23.676171+0000","last_became_active":"2023-10-16T08:51:19.495247+0000","last_became_peered":"2023-10-16T08:51:19.495247+0000","last_unstale":"2023-10-16T08:51:23.676171+0000","last_undegraded":"2023-10-16T08:51:23.676171+0000","last_fullsized":"2023-10-16T08:51:23.676171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:20.976839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663138+0000","last_change":"2023-10-16T08:51:19.483501+0000","last_active":"2023-10-16T08:51:23.663138+0000","last_peered":"2023-10-16T08:51:23.663138+0000","last_clean":"2023-10-16T08:51:23.663138+0000","last_became_active":"2023-10-16T08:51:19.482944+0000","last_became_peered":"2023-10-16T08:51:19.482944+0000","last_unstale":"2023-10-16T08:51:23.663138+0000","last_undegraded":"2023-10-16T08:51:23.663138+0000","last_fullsized":"2023-10-16T08:51:23.663138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:53.572062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653847+0000","last_change":"2023-10-16T08:51:19.478486+0000","last_active":"2023-10-16T08:51:23.653847+0000","last_peered":"2023-10-16T08:51:23.653847+0000","last_clean":"2023-10-16T08:51:23.653847+0000","last_became_active":"2023-10-16T08:51:19.478148+0000","last_became_peered":"2023-10-16T08:51:19.478148+0000","last_unstale":"2023-10-16T08:51:23.653847+0000","last_undegraded":"2023-10-16T08:51:23.653847+0000","last_fullsized":"2023-10-16T08:51:23.653847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681778+0000","last_change":"2023-10-16T08:51:19.489601+0000","last_active":"2023-10-16T08:51:23.681778+0000","last_peered":"2023-10-16T08:51:23.681778+0000","last_clean":"2023-10-16T08:51:23.681778+0000","last_became_active":"2023-10-16T08:51:19.489183+0000","last_became_peered":"2023-10-16T08:51:19.489183+0000","last_unstale":"2023-10-16T08:51:23.681778+0000","last_undegraded":"2023-10-16T08:51:23.681778+0000","last_fullsized":"2023-10-16T08:51:23.681778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669156+0000","last_change":"2023-10-16T08:51:19.487335+0000","last_active":"2023-10-16T08:51:23.669156+0000","last_peered":"2023-10-16T08:51:23.669156+0000","last_clean":"2023-10-16T08:51:23.669156+0000","last_became_active":"2023-10-16T08:51:19.487075+0000","last_became_peered":"2023-10-16T08:51:19.487075+0000","last_unstale":"2023-10-16T08:51:23.669156+0000","last_undegraded":"2023-10-16T08:51:23.669156+0000","last_fullsized":"2023-10-16T08:51:23.669156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671049+0000","last_change":"2023-10-16T08:51:19.481528+0000","last_active":"2023-10-16T08:51:23.671049+0000","last_peered":"2023-10-16T08:51:23.671049+0000","last_clean":"2023-10-16T08:51:23.671049+0000","last_became_active":"2023-10-16T08:51:19.481200+0000","last_became_peered":"2023-10-16T08:51:19.481200+0000","last_unstale":"2023-10-16T08:51:23.671049+0000","last_undegraded":"2023-10-16T08:51:23.671049+0000","last_fullsized":"2023-10-16T08:51:23.671049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933808+0000","last_change":"2023-10-16T08:51:19.485179+0000","last_active":"2023-10-16T08:51:23.933808+0000","last_peered":"2023-10-16T08:51:23.933808+0000","last_clean":"2023-10-16T08:51:23.933808+0000","last_became_active":"2023-10-16T08:51:19.484475+0000","last_became_peered":"2023-10-16T08:51:19.484475+0000","last_unstale":"2023-10-16T08:51:23.933808+0000","last_undegraded":"2023-10-16T08:51:23.933808+0000","last_fullsized":"2023-10-16T08:51:23.933808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:26.362066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656954+0000","last_change":"2023-10-16T08:51:19.489098+0000","last_active":"2023-10-16T08:51:23.656954+0000","last_peered":"2023-10-16T08:51:23.656954+0000","last_clean":"2023-10-16T08:51:23.656954+0000","last_became_active":"2023-10-16T08:51:19.488810+0000","last_became_peered":"2023-10-16T08:51:19.488810+0000","last_unstale":"2023-10-16T08:51:23.656954+0000","last_undegraded":"2023-10-16T08:51:23.656954+0000","last_fullsized":"2023-10-16T08:51:23.656954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927711+0000","last_change":"2023-10-16T08:51:19.481280+0000","last_active":"2023-10-16T08:51:23.927711+0000","last_peered":"2023-10-16T08:51:23.927711+0000","last_clean":"2023-10-16T08:51:23.927711+0000","last_became_active":"2023-10-16T08:51:19.480918+0000","last_became_peered":"2023-10-16T08:51:19.480918+0000","last_unstale":"2023-10-16T08:51:23.927711+0000","last_undegraded":"2023-10-16T08:51:23.927711+0000","last_fullsized":"2023-10-16T08:51:23.927711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:27.239511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655534+0000","last_change":"2023-10-16T08:51:19.477823+0000","last_active":"2023-10-16T08:51:23.655534+0000","last_peered":"2023-10-16T08:51:23.655534+0000","last_clean":"2023-10-16T08:51:23.655534+0000","last_became_active":"2023-10-16T08:51:19.477234+0000","last_became_peered":"2023-10-16T08:51:19.477234+0000","last_unstale":"2023-10-16T08:51:23.655534+0000","last_undegraded":"2023-10-16T08:51:23.655534+0000","last_fullsized":"2023-10-16T08:51:23.655534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928445+0000","last_change":"2023-10-16T08:51:19.489820+0000","last_active":"2023-10-16T08:51:23.928445+0000","last_peered":"2023-10-16T08:51:23.928445+0000","last_clean":"2023-10-16T08:51:23.928445+0000","last_became_active":"2023-10-16T08:51:19.489507+0000","last_became_peered":"2023-10-16T08:51:19.489507+0000","last_unstale":"2023-10-16T08:51:23.928445+0000","last_undegraded":"2023-10-16T08:51:23.928445+0000","last_fullsized":"2023-10-16T08:51:23.928445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:08.297922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655383+0000","last_change":"2023-10-16T08:51:19.500564+0000","last_active":"2023-10-16T08:51:23.655383+0000","last_peered":"2023-10-16T08:51:23.655383+0000","last_clean":"2023-10-16T08:51:23.655383+0000","last_became_active":"2023-10-16T08:51:19.500259+0000","last_became_peered":"2023-10-16T08:51:19.500259+0000","last_unstale":"2023-10-16T08:51:23.655383+0000","last_undegraded":"2023-10-16T08:51:23.655383+0000","last_fullsized":"2023-10-16T08:51:23.655383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.662732+0000","last_change":"2023-10-16T08:51:19.475776+0000","last_active":"2023-10-16T08:51:23.662732+0000","last_peered":"2023-10-16T08:51:23.662732+0000","last_clean":"2023-10-16T08:51:23.662732+0000","last_became_active":"2023-10-16T08:51:19.475490+0000","last_became_peered":"2023-10-16T08:51:19.475490+0000","last_unstale":"2023-10-16T08:51:23.662732+0000","last_undegraded":"2023-10-16T08:51:23.662732+0000","last_fullsized":"2023-10-16T08:51:23.662732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681106+0000","last_change":"2023-10-16T08:51:19.478163+0000","last_active":"2023-10-16T08:51:23.681106+0000","last_peered":"2023-10-16T08:51:23.681106+0000","last_clean":"2023-10-16T08:51:23.681106+0000","last_became_active":"2023-10-16T08:51:19.477845+0000","last_became_peered":"2023-10-16T08:51:19.477845+0000","last_unstale":"2023-10-16T08:51:23.681106+0000","last_undegraded":"2023-10-16T08:51:23.681106+0000","last_fullsized":"2023-10-16T08:51:23.681106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:11.984655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933468+0000","last_change":"2023-10-16T08:51:19.484764+0000","last_active":"2023-10-16T08:51:23.933468+0000","last_peered":"2023-10-16T08:51:23.933468+0000","last_clean":"2023-10-16T08:51:23.933468+0000","last_became_active":"2023-10-16T08:51:19.480771+0000","last_became_peered":"2023-10-16T08:51:19.480771+0000","last_unstale":"2023-10-16T08:51:23.933468+0000","last_undegraded":"2023-10-16T08:51:23.933468+0000","last_fullsized":"2023-10-16T08:51:23.933468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:34.680318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":697914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":106964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.569}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":107124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":697970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T08:51:53.722 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T08:51:53.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.962+0000 7fa5c9f00640 1 Processor -- start 2023-10-16T08:51:53.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.962+0000 7fa5c9f00640 1 -- start start 2023-10-16T08:51:53.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c9f00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 0x7fa5c40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c9f00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5c415ce60 0x7fa5c40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c9f00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c4161620 con 0x7fa5c415ca80 2023-10-16T08:51:53.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c9f00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c40cafa0 con 0x7fa5c415ce60 2023-10-16T08:51:53.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c9f00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40cb280 con 0x7fa5c40b0720 2023-10-16T08:51:53.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c37fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa5c415ca80 0x7fa5c40b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:51002/0 (socket says 172.21.15.94:51002) 2023-10-16T08:51:53.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c37fe640 1 -- 172.21.15.94:0/2063547108 learned_addr learned my addr 172.21.15.94:0/2063547108 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:53.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c2ffd640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 0x7fa5c40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.964+0000 7fa5c3fff640 1 --2- 172.21.15.94:0/2063547108 >> v2:172.21.15.130:3300/0 conn(0x7fa5c415ce60 0x7fa5c40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102506561 0 0) 0x7fa5c4161620 con 0x7fa5c415ca80 2023-10-16T08:51:53.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ac003520 con 0x7fa5c415ca80 2023-10-16T08:51:53.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4247606790 0 0) 0x7fa5ac003520 con 0x7fa5c415ca80 2023-10-16T08:51:53.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 msgr2=0x7fa5c40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 0x7fa5c40cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 >> v2:172.21.15.130:3300/0 conn(0x7fa5c415ce60 msgr2=0x7fa5c40cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 --2- 172.21.15.94:0/2063547108 >> v2:172.21.15.130:3300/0 conn(0x7fa5c415ce60 0x7fa5c40cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40cb560 con 0x7fa5c415ca80 2023-10-16T08:51:53.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fa5b4001670 con 0x7fa5c415ca80 2023-10-16T08:51:53.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 >> v1:172.21.15.94:6789/0 conn(0x7fa5c415ca80 legacy=0x7fa5c40b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5ac0039e0 0x7fa5ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0047c0 0x7fa5ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 0x7fa5ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40cafa0 con 0x7fa5ac0039e0 2023-10-16T08:51:53.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40cb280 con 0x7fa5ac0047c0 2023-10-16T08:51:53.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.965+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac00b9d0 con 0x7fa5c40b0720 2023-10-16T08:51:53.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5ac0039e0 0x7fa5ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c3fff640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 0x7fa5ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c2ffd640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0047c0 0x7fa5ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c37fe640 1 -- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 msgr2=0x7fa5ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c40b0720 0x7fa5ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c37fe640 1 -- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0047c0 msgr2=0x7fa5ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:53.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0047c0 0x7fa5ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c37fe640 1 -- 172.21.15.94:0/2063547108 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac003520 con 0x7fa5ac0039e0 2023-10-16T08:51:53.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.966+0000 7fa5c2ffd640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0047c0 0x7fa5ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:51:53.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.967+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5ac0039e0 0x7fa5ac003e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c190 tx=0x7fa5ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a704de8dc557f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:53.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4005ad0 con 0x7fa5ac0039e0 2023-10-16T08:51:53.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4005c30 con 0x7fa5ac0039e0 2023-10-16T08:51:53.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c27fc640 1 -- 172.21.15.94:0/2063547108 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b402c810 con 0x7fa5ac0039e0 2023-10-16T08:51:53.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c9f00640 1 -- 172.21.15.94:0/2063547108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5ac0039e0 msgr2=0x7fa5ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/2063547108 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5ac0039e0 0x7fa5ac003e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c190 tx=0x7fa5ac0057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c3fff640 1 -- 172.21.15.94:0/2063547108 reap_dead start 2023-10-16T08:51:53.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.968+0000 7fa5c9f00640 1 -- 172.21.15.94:0/2063547108 shutdown_connections 2023-10-16T08:51:53.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.969+0000 7fa5c9f00640 1 -- 172.21.15.94:0/2063547108 >> 172.21.15.94:0/2063547108 conn(0x7fa5c406c1c0 msgr2=0x7fa5c406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:53.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.969+0000 7fa5c9f00640 1 -- 172.21.15.94:0/2063547108 shutdown_connections 2023-10-16T08:51:53.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.969+0000 7fa5c9f00640 1 -- 172.21.15.94:0/2063547108 wait complete. 2023-10-16T08:51:53.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.970+0000 7fa5c9f00640 1 Processor -- start 2023-10-16T08:51:53.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.970+0000 7fa5c9f00640 1 -- start start 2023-10-16T08:51:53.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.971+0000 7fa5c9f00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0039e0 0x7fa5c4149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.971+0000 7fa5c9f00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 0x7fa5c414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.971+0000 7fa5c9f00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c414b740 0x7fa5c40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.971+0000 7fa5c9f00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c415ef80 con 0x7fa5c4148820 2023-10-16T08:51:53.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.971+0000 7fa5c9f00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c414bc50 con 0x7fa5ac0039e0 2023-10-16T08:51:53.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.971+0000 7fa5c9f00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c414bf30 con 0x7fa5c414b740 2023-10-16T08:51:53.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 0x7fa5c414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 0x7fa5c414b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57228/0 (socket says 172.21.15.94:57228) 2023-10-16T08:51:53.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 -- 172.21.15.94:0/4066815168 learned_addr learned my addr 172.21.15.94:0/4066815168 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:53.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0039e0 0x7fa5c4149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 -- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c414b740 msgr2=0x7fa5c40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c414b740 0x7fa5c40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 -- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0039e0 msgr2=0x7fa5c4149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:53.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0039e0 0x7fa5c4149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:53.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 -- 172.21.15.94:0/4066815168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c415f200 con 0x7fa5c4148820 2023-10-16T08:51:53.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c2ffd640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 0x7fa5c414b200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8011540 tx=0x7fa5b8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:53.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8015870 con 0x7fa5c4148820 2023-10-16T08:51:53.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80159d0 con 0x7fa5c4148820 2023-10-16T08:51:53.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c415f4e0 con 0x7fa5c4148820 2023-10-16T08:51:53.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.972+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8015d40 con 0x7fa5c4148820 2023-10-16T08:51:53.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.973+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c415a400 con 0x7fa5c4148820 2023-10-16T08:51:53.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.974+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c4073ef0 con 0x7fa5c4148820 2023-10-16T08:51:53.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.975+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5b801d400 con 0x7fa5c4148820 2023-10-16T08:51:53.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.975+0000 7fa5abfff640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa5b006aea0 0x7fa5b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:53.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.976+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5b808a040 con 0x7fa5c4148820 2023-10-16T08:51:53.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.976+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa5b006aea0 0x7fa5b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:53.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.976+0000 7fa5c37fe640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa5b006aea0 0x7fa5b006d360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c160 tx=0x7fa5b4007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:53.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:53.980+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5b8054e00 con 0x7fa5c4148820 2023-10-16T08:51:54.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.152+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 --> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5c4071950 con 0x7fa5b006aea0 2023-10-16T08:51:54.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.177+0000 7fa5abfff640 1 -- 172.21.15.94:0/4066815168 <== mgr.4107 v2:172.21.15.94:6832/2208206022 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345045 (secure 0 0 0) 0x7fa5b40059e0 con 0x7fa5b006aea0 2023-10-16T08:51:54.183 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:54.185 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2023-10-16T08:51:54.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa5b006aea0 msgr2=0x7fa5b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa5b006aea0 0x7fa5b006d360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c160 tx=0x7fa5b4007000 comp rx=0 tx=0).stop 2023-10-16T08:51:54.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 msgr2=0x7fa5c414b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 0x7fa5c414b200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8011540 tx=0x7fa5b8011a00 comp rx=0 tx=0).stop 2023-10-16T08:51:54.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 shutdown_connections 2023-10-16T08:51:54.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5c414b740 0x7fa5c40b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5c4148820 0x7fa5c414b200 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa5b006aea0 0x7fa5b006d360 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 --2- 172.21.15.94:0/4066815168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5ac0039e0 0x7fa5c4149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 >> 172.21.15.94:0/4066815168 conn(0x7fa5c406c1c0 msgr2=0x7fa5c40ac270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:54.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 shutdown_connections 2023-10-16T08:51:54.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.183+0000 7fa5c9f00640 1 -- 172.21.15.94:0/4066815168 wait complete. 2023-10-16T08:51:54.202 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-10-16T08:51:53.825131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236140,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":3416064,"data_stored":2045726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005004"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664629+0000","last_change":"2023-10-16T08:51:18.472763+0000","last_active":"2023-10-16T08:51:23.664629+0000","last_peered":"2023-10-16T08:51:23.664629+0000","last_clean":"2023-10-16T08:51:23.664629+0000","last_became_active":"2023-10-16T08:51:18.472447+0000","last_became_peered":"2023-10-16T08:51:18.472447+0000","last_unstale":"2023-10-16T08:51:23.664629+0000","last_undegraded":"2023-10-16T08:51:23.664629+0000","last_fullsized":"2023-10-16T08:51:23.664629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:21.069905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656591+0000","last_change":"2023-10-16T08:51:19.478851+0000","last_active":"2023-10-16T08:51:23.656591+0000","last_peered":"2023-10-16T08:51:23.656591+0000","last_clean":"2023-10-16T08:51:23.656591+0000","last_became_active":"2023-10-16T08:51:19.478587+0000","last_became_peered":"2023-10-16T08:51:19.478587+0000","last_unstale":"2023-10-16T08:51:23.656591+0000","last_undegraded":"2023-10-16T08:51:23.656591+0000","last_fullsized":"2023-10-16T08:51:23.656591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632168+0000","last_change":"2023-10-16T08:51:23.936156+0000","last_active":"2023-10-16T08:51:24.632168+0000","last_peered":"2023-10-16T08:51:24.632168+0000","last_clean":"2023-10-16T08:51:24.632168+0000","last_became_active":"2023-10-16T08:51:23.935275+0000","last_became_peered":"2023-10-16T08:51:23.935275+0000","last_unstale":"2023-10-16T08:51:24.632168+0000","last_undegraded":"2023-10-16T08:51:24.632168+0000","last_fullsized":"2023-10-16T08:51:24.632168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:12:23.584433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656765+0000","last_change":"2023-10-16T08:51:18.463620+0000","last_active":"2023-10-16T08:51:23.656765+0000","last_peered":"2023-10-16T08:51:23.656765+0000","last_clean":"2023-10-16T08:51:23.656765+0000","last_became_active":"2023-10-16T08:51:18.463088+0000","last_became_peered":"2023-10-16T08:51:18.463088+0000","last_unstale":"2023-10-16T08:51:23.656765+0000","last_undegraded":"2023-10-16T08:51:23.656765+0000","last_fullsized":"2023-10-16T08:51:23.656765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664153+0000","last_change":"2023-10-16T08:51:19.483778+0000","last_active":"2023-10-16T08:51:23.664153+0000","last_peered":"2023-10-16T08:51:23.664153+0000","last_clean":"2023-10-16T08:51:23.664153+0000","last_became_active":"2023-10-16T08:51:19.479538+0000","last_became_peered":"2023-10-16T08:51:19.479538+0000","last_unstale":"2023-10-16T08:51:23.664153+0000","last_undegraded":"2023-10-16T08:51:23.664153+0000","last_fullsized":"2023-10-16T08:51:23.664153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001998+0000","last_change":"2023-10-16T08:51:23.687361+0000","last_active":"2023-10-16T08:51:25.001998+0000","last_peered":"2023-10-16T08:51:25.001998+0000","last_clean":"2023-10-16T08:51:25.001998+0000","last_became_active":"2023-10-16T08:51:23.686758+0000","last_became_peered":"2023-10-16T08:51:23.686758+0000","last_unstale":"2023-10-16T08:51:25.001998+0000","last_undegraded":"2023-10-16T08:51:25.001998+0000","last_fullsized":"2023-10-16T08:51:25.001998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:17:04.836076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932744+0000","last_change":"2023-10-16T08:51:18.479211+0000","last_active":"2023-10-16T08:51:23.932744+0000","last_peered":"2023-10-16T08:51:23.932744+0000","last_clean":"2023-10-16T08:51:23.932744+0000","last_became_active":"2023-10-16T08:51:18.478753+0000","last_became_peered":"2023-10-16T08:51:18.478753+0000","last_unstale":"2023-10-16T08:51:23.932744+0000","last_undegraded":"2023-10-16T08:51:23.932744+0000","last_fullsized":"2023-10-16T08:51:23.932744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:13.887687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655634+0000","last_change":"2023-10-16T08:51:19.497246+0000","last_active":"2023-10-16T08:51:23.655634+0000","last_peered":"2023-10-16T08:51:23.655634+0000","last_clean":"2023-10-16T08:51:23.655634+0000","last_became_active":"2023-10-16T08:51:19.496966+0000","last_became_peered":"2023-10-16T08:51:19.496966+0000","last_unstale":"2023-10-16T08:51:23.655634+0000","last_undegraded":"2023-10-16T08:51:23.655634+0000","last_fullsized":"2023-10-16T08:51:23.655634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002504+0000","last_change":"2023-10-16T08:51:23.694314+0000","last_active":"2023-10-16T08:51:25.002504+0000","last_peered":"2023-10-16T08:51:25.002504+0000","last_clean":"2023-10-16T08:51:25.002504+0000","last_became_active":"2023-10-16T08:51:23.693789+0000","last_became_peered":"2023-10-16T08:51:23.693789+0000","last_unstale":"2023-10-16T08:51:25.002504+0000","last_undegraded":"2023-10-16T08:51:25.002504+0000","last_fullsized":"2023-10-16T08:51:25.002504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:34.725310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928781+0000","last_change":"2023-10-16T08:51:18.480432+0000","last_active":"2023-10-16T08:51:23.928781+0000","last_peered":"2023-10-16T08:51:23.928781+0000","last_clean":"2023-10-16T08:51:23.928781+0000","last_became_active":"2023-10-16T08:51:18.479649+0000","last_became_peered":"2023-10-16T08:51:18.479649+0000","last_unstale":"2023-10-16T08:51:23.928781+0000","last_undegraded":"2023-10-16T08:51:23.928781+0000","last_fullsized":"2023-10-16T08:51:23.928781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:16:59.612239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657088+0000","last_change":"2023-10-16T08:51:19.501369+0000","last_active":"2023-10-16T08:51:23.657088+0000","last_peered":"2023-10-16T08:51:23.657088+0000","last_clean":"2023-10-16T08:51:23.657088+0000","last_became_active":"2023-10-16T08:51:19.501077+0000","last_became_peered":"2023-10-16T08:51:19.501077+0000","last_unstale":"2023-10-16T08:51:23.657088+0000","last_undegraded":"2023-10-16T08:51:23.657088+0000","last_fullsized":"2023-10-16T08:51:23.657088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:04.150410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002122+0000","last_change":"2023-10-16T08:51:23.684667+0000","last_active":"2023-10-16T08:51:25.002122+0000","last_peered":"2023-10-16T08:51:25.002122+0000","last_clean":"2023-10-16T08:51:25.002122+0000","last_became_active":"2023-10-16T08:51:23.683885+0000","last_became_peered":"2023-10-16T08:51:23.683885+0000","last_unstale":"2023-10-16T08:51:25.002122+0000","last_undegraded":"2023-10-16T08:51:25.002122+0000","last_fullsized":"2023-10-16T08:51:25.002122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:31.450577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669202+0000","last_change":"2023-10-16T08:51:19.494151+0000","last_active":"2023-10-16T08:51:23.669202+0000","last_peered":"2023-10-16T08:51:23.669202+0000","last_clean":"2023-10-16T08:51:23.669202+0000","last_became_active":"2023-10-16T08:51:19.493825+0000","last_became_peered":"2023-10-16T08:51:19.493825+0000","last_unstale":"2023-10-16T08:51:23.669202+0000","last_undegraded":"2023-10-16T08:51:23.669202+0000","last_fullsized":"2023-10-16T08:51:23.669202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932601+0000","last_change":"2023-10-16T08:51:18.475975+0000","last_active":"2023-10-16T08:51:23.932601+0000","last_peered":"2023-10-16T08:51:23.932601+0000","last_clean":"2023-10-16T08:51:23.932601+0000","last_became_active":"2023-10-16T08:51:18.474515+0000","last_became_peered":"2023-10-16T08:51:18.474515+0000","last_unstale":"2023-10-16T08:51:23.932601+0000","last_undegraded":"2023-10-16T08:51:23.932601+0000","last_fullsized":"2023-10-16T08:51:23.932601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:19.036322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004645+0000","last_change":"2023-10-16T08:51:23.687410+0000","last_active":"2023-10-16T08:51:25.004645+0000","last_peered":"2023-10-16T08:51:25.004645+0000","last_clean":"2023-10-16T08:51:25.004645+0000","last_became_active":"2023-10-16T08:51:23.686729+0000","last_became_peered":"2023-10-16T08:51:23.686729+0000","last_unstale":"2023-10-16T08:51:25.004645+0000","last_undegraded":"2023-10-16T08:51:25.004645+0000","last_fullsized":"2023-10-16T08:51:25.004645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653922+0000","last_change":"2023-10-16T08:51:19.472792+0000","last_active":"2023-10-16T08:51:23.653922+0000","last_peered":"2023-10-16T08:51:23.653922+0000","last_clean":"2023-10-16T08:51:23.653922+0000","last_became_active":"2023-10-16T08:51:19.472538+0000","last_became_peered":"2023-10-16T08:51:19.472538+0000","last_unstale":"2023-10-16T08:51:23.653922+0000","last_undegraded":"2023-10-16T08:51:23.653922+0000","last_fullsized":"2023-10-16T08:51:23.653922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676788+0000","last_change":"2023-10-16T08:51:18.460657+0000","last_active":"2023-10-16T08:51:23.676788+0000","last_peered":"2023-10-16T08:51:23.676788+0000","last_clean":"2023-10-16T08:51:23.676788+0000","last_became_active":"2023-10-16T08:51:18.460294+0000","last_became_peered":"2023-10-16T08:51:18.460294+0000","last_unstale":"2023-10-16T08:51:23.676788+0000","last_undegraded":"2023-10-16T08:51:23.676788+0000","last_fullsized":"2023-10-16T08:51:23.676788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003182+0000","last_change":"2023-10-16T08:51:23.687710+0000","last_active":"2023-10-16T08:51:25.003182+0000","last_peered":"2023-10-16T08:51:25.003182+0000","last_clean":"2023-10-16T08:51:25.003182+0000","last_became_active":"2023-10-16T08:51:23.686904+0000","last_became_peered":"2023-10-16T08:51:23.686904+0000","last_unstale":"2023-10-16T08:51:25.003182+0000","last_undegraded":"2023-10-16T08:51:25.003182+0000","last_fullsized":"2023-10-16T08:51:25.003182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658779+0000","last_change":"2023-10-16T08:51:19.493284+0000","last_active":"2023-10-16T08:51:23.658779+0000","last_peered":"2023-10-16T08:51:23.658779+0000","last_clean":"2023-10-16T08:51:23.658779+0000","last_became_active":"2023-10-16T08:51:19.493001+0000","last_became_peered":"2023-10-16T08:51:19.493001+0000","last_unstale":"2023-10-16T08:51:23.658779+0000","last_undegraded":"2023-10-16T08:51:23.658779+0000","last_fullsized":"2023-10-16T08:51:23.658779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676274+0000","last_change":"2023-10-16T08:51:18.474813+0000","last_active":"2023-10-16T08:51:23.676274+0000","last_peered":"2023-10-16T08:51:23.676274+0000","last_clean":"2023-10-16T08:51:23.676274+0000","last_became_active":"2023-10-16T08:51:18.474551+0000","last_became_peered":"2023-10-16T08:51:18.474551+0000","last_unstale":"2023-10-16T08:51:23.676274+0000","last_undegraded":"2023-10-16T08:51:23.676274+0000","last_fullsized":"2023-10-16T08:51:23.676274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:14:07.961126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630476+0000","last_change":"2023-10-16T08:51:23.936794+0000","last_active":"2023-10-16T08:51:24.630476+0000","last_peered":"2023-10-16T08:51:24.630476+0000","last_clean":"2023-10-16T08:51:24.630476+0000","last_became_active":"2023-10-16T08:51:23.936108+0000","last_became_peered":"2023-10-16T08:51:23.936108+0000","last_unstale":"2023-10-16T08:51:24.630476+0000","last_undegraded":"2023-10-16T08:51:24.630476+0000","last_fullsized":"2023-10-16T08:51:24.630476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:54.425130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674596+0000","last_change":"2023-10-16T08:51:19.487794+0000","last_active":"2023-10-16T08:51:23.674596+0000","last_peered":"2023-10-16T08:51:23.674596+0000","last_clean":"2023-10-16T08:51:23.674596+0000","last_became_active":"2023-10-16T08:51:19.487394+0000","last_became_peered":"2023-10-16T08:51:19.487394+0000","last_unstale":"2023-10-16T08:51:23.674596+0000","last_undegraded":"2023-10-16T08:51:23.674596+0000","last_fullsized":"2023-10-16T08:51:23.674596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:55.545822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927706+0000","last_change":"2023-10-16T08:51:18.475910+0000","last_active":"2023-10-16T08:51:23.927706+0000","last_peered":"2023-10-16T08:51:23.927706+0000","last_clean":"2023-10-16T08:51:23.927706+0000","last_became_active":"2023-10-16T08:51:18.475567+0000","last_became_peered":"2023-10-16T08:51:18.475567+0000","last_unstale":"2023-10-16T08:51:23.927706+0000","last_undegraded":"2023-10-16T08:51:23.927706+0000","last_fullsized":"2023-10-16T08:51:23.927706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.003131+0000","last_change":"2023-10-16T08:51:23.688779+0000","last_active":"2023-10-16T08:51:25.003131+0000","last_peered":"2023-10-16T08:51:25.003131+0000","last_clean":"2023-10-16T08:51:25.003131+0000","last_became_active":"2023-10-16T08:51:23.688065+0000","last_became_peered":"2023-10-16T08:51:23.688065+0000","last_unstale":"2023-10-16T08:51:25.003131+0000","last_undegraded":"2023-10-16T08:51:25.003131+0000","last_fullsized":"2023-10-16T08:51:25.003131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:37.434614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.668428+0000","last_change":"2023-10-16T08:51:19.483164+0000","last_active":"2023-10-16T08:51:23.668428+0000","last_peered":"2023-10-16T08:51:23.668428+0000","last_clean":"2023-10-16T08:51:23.668428+0000","last_became_active":"2023-10-16T08:51:19.482701+0000","last_became_peered":"2023-10-16T08:51:19.482701+0000","last_unstale":"2023-10-16T08:51:23.668428+0000","last_undegraded":"2023-10-16T08:51:23.668428+0000","last_fullsized":"2023-10-16T08:51:23.668428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:30:05.215149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673453+0000","last_change":"2023-10-16T08:51:18.479436+0000","last_active":"2023-10-16T08:51:23.673453+0000","last_peered":"2023-10-16T08:51:23.673453+0000","last_clean":"2023-10-16T08:51:23.673453+0000","last_became_active":"2023-10-16T08:51:18.479112+0000","last_became_peered":"2023-10-16T08:51:18.479112+0000","last_unstale":"2023-10-16T08:51:23.673453+0000","last_undegraded":"2023-10-16T08:51:23.673453+0000","last_fullsized":"2023-10-16T08:51:23.673453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:18.761013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002204+0000","last_change":"2023-10-16T08:51:23.941023+0000","last_active":"2023-10-16T08:51:25.002204+0000","last_peered":"2023-10-16T08:51:25.002204+0000","last_clean":"2023-10-16T08:51:25.002204+0000","last_became_active":"2023-10-16T08:51:23.939686+0000","last_became_peered":"2023-10-16T08:51:23.939686+0000","last_unstale":"2023-10-16T08:51:25.002204+0000","last_undegraded":"2023-10-16T08:51:25.002204+0000","last_fullsized":"2023-10-16T08:51:25.002204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:13.170275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657614+0000","last_change":"2023-10-16T08:51:19.480568+0000","last_active":"2023-10-16T08:51:23.657614+0000","last_peered":"2023-10-16T08:51:23.657614+0000","last_clean":"2023-10-16T08:51:23.657614+0000","last_became_active":"2023-10-16T08:51:19.480223+0000","last_became_peered":"2023-10-16T08:51:19.480223+0000","last_unstale":"2023-10-16T08:51:23.657614+0000","last_undegraded":"2023-10-16T08:51:23.657614+0000","last_fullsized":"2023-10-16T08:51:23.657614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:50.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.426065+0000","last_change":"2023-10-16T08:51:18.478908+0000","last_active":"2023-10-16T08:51:24.426065+0000","last_peered":"2023-10-16T08:51:24.426065+0000","last_clean":"2023-10-16T08:51:24.426065+0000","last_became_active":"2023-10-16T08:51:18.478555+0000","last_became_peered":"2023-10-16T08:51:18.478555+0000","last_unstale":"2023-10-16T08:51:24.426065+0000","last_undegraded":"2023-10-16T08:51:24.426065+0000","last_fullsized":"2023-10-16T08:51:24.426065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:08.306658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631947+0000","last_change":"2023-10-16T08:51:23.932191+0000","last_active":"2023-10-16T08:51:24.631947+0000","last_peered":"2023-10-16T08:51:24.631947+0000","last_clean":"2023-10-16T08:51:24.631947+0000","last_became_active":"2023-10-16T08:51:23.930143+0000","last_became_peered":"2023-10-16T08:51:23.930143+0000","last_unstale":"2023-10-16T08:51:24.631947+0000","last_undegraded":"2023-10-16T08:51:24.631947+0000","last_fullsized":"2023-10-16T08:51:24.631947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:39:17.871021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676364+0000","last_change":"2023-10-16T08:51:19.485482+0000","last_active":"2023-10-16T08:51:23.676364+0000","last_peered":"2023-10-16T08:51:23.676364+0000","last_clean":"2023-10-16T08:51:23.676364+0000","last_became_active":"2023-10-16T08:51:19.485128+0000","last_became_peered":"2023-10-16T08:51:19.485128+0000","last_unstale":"2023-10-16T08:51:23.676364+0000","last_undegraded":"2023-10-16T08:51:23.676364+0000","last_fullsized":"2023-10-16T08:51:23.676364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:44:22.627895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933002+0000","last_change":"2023-10-16T08:51:18.478714+0000","last_active":"2023-10-16T08:51:23.933002+0000","last_peered":"2023-10-16T08:51:23.933002+0000","last_clean":"2023-10-16T08:51:23.933002+0000","last_became_active":"2023-10-16T08:51:18.478354+0000","last_became_peered":"2023-10-16T08:51:18.478354+0000","last_unstale":"2023-10-16T08:51:23.933002+0000","last_undegraded":"2023-10-16T08:51:23.933002+0000","last_fullsized":"2023-10-16T08:51:23.933002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780092+0000","last_change":"2023-10-16T08:51:23.929043+0000","last_active":"2023-10-16T08:51:24.780092+0000","last_peered":"2023-10-16T08:51:24.780092+0000","last_clean":"2023-10-16T08:51:24.780092+0000","last_became_active":"2023-10-16T08:51:23.928546+0000","last_became_peered":"2023-10-16T08:51:23.928546+0000","last_unstale":"2023-10-16T08:51:24.780092+0000","last_undegraded":"2023-10-16T08:51:24.780092+0000","last_fullsized":"2023-10-16T08:51:24.780092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656981+0000","last_change":"2023-10-16T08:51:19.489157+0000","last_active":"2023-10-16T08:51:23.656981+0000","last_peered":"2023-10-16T08:51:23.656981+0000","last_clean":"2023-10-16T08:51:23.656981+0000","last_became_active":"2023-10-16T08:51:19.488862+0000","last_became_peered":"2023-10-16T08:51:19.488862+0000","last_unstale":"2023-10-16T08:51:23.656981+0000","last_undegraded":"2023-10-16T08:51:23.656981+0000","last_fullsized":"2023-10-16T08:51:23.656981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:15.931317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676443+0000","last_change":"2023-10-16T08:51:18.453987+0000","last_active":"2023-10-16T08:51:23.676443+0000","last_peered":"2023-10-16T08:51:23.676443+0000","last_clean":"2023-10-16T08:51:23.676443+0000","last_became_active":"2023-10-16T08:51:18.453706+0000","last_became_peered":"2023-10-16T08:51:18.453706+0000","last_unstale":"2023-10-16T08:51:23.676443+0000","last_undegraded":"2023-10-16T08:51:23.676443+0000","last_fullsized":"2023-10-16T08:51:23.676443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:24.379905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629365+0000","last_change":"2023-10-16T08:51:23.690542+0000","last_active":"2023-10-16T08:51:24.629365+0000","last_peered":"2023-10-16T08:51:24.629365+0000","last_clean":"2023-10-16T08:51:24.629365+0000","last_became_active":"2023-10-16T08:51:23.690171+0000","last_became_peered":"2023-10-16T08:51:23.690171+0000","last_unstale":"2023-10-16T08:51:24.629365+0000","last_undegraded":"2023-10-16T08:51:24.629365+0000","last_fullsized":"2023-10-16T08:51:24.629365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:56.713280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682083+0000","last_change":"2023-10-16T08:51:19.486242+0000","last_active":"2023-10-16T08:51:23.682083+0000","last_peered":"2023-10-16T08:51:23.682083+0000","last_clean":"2023-10-16T08:51:23.682083+0000","last_became_active":"2023-10-16T08:51:19.485941+0000","last_became_peered":"2023-10-16T08:51:19.485941+0000","last_unstale":"2023-10-16T08:51:23.682083+0000","last_undegraded":"2023-10-16T08:51:23.682083+0000","last_fullsized":"2023-10-16T08:51:23.682083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:06.410046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656642+0000","last_change":"2023-10-16T08:51:18.457937+0000","last_active":"2023-10-16T08:51:23.656642+0000","last_peered":"2023-10-16T08:51:23.656642+0000","last_clean":"2023-10-16T08:51:23.656642+0000","last_became_active":"2023-10-16T08:51:18.457566+0000","last_became_peered":"2023-10-16T08:51:18.457566+0000","last_unstale":"2023-10-16T08:51:23.656642+0000","last_undegraded":"2023-10-16T08:51:23.656642+0000","last_fullsized":"2023-10-16T08:51:23.656642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:38.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630284+0000","last_change":"2023-10-16T08:51:23.690160+0000","last_active":"2023-10-16T08:51:24.630284+0000","last_peered":"2023-10-16T08:51:24.630284+0000","last_clean":"2023-10-16T08:51:24.630284+0000","last_became_active":"2023-10-16T08:51:23.689134+0000","last_became_peered":"2023-10-16T08:51:23.689134+0000","last_unstale":"2023-10-16T08:51:24.630284+0000","last_undegraded":"2023-10-16T08:51:24.630284+0000","last_fullsized":"2023-10-16T08:51:24.630284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:38.891384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674275+0000","last_change":"2023-10-16T08:51:19.477337+0000","last_active":"2023-10-16T08:51:23.674275+0000","last_peered":"2023-10-16T08:51:23.674275+0000","last_clean":"2023-10-16T08:51:23.674275+0000","last_became_active":"2023-10-16T08:51:19.476998+0000","last_became_peered":"2023-10-16T08:51:19.476998+0000","last_unstale":"2023-10-16T08:51:23.674275+0000","last_undegraded":"2023-10-16T08:51:23.674275+0000","last_fullsized":"2023-10-16T08:51:23.674275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:33.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654094+0000","last_change":"2023-10-16T08:51:18.463848+0000","last_active":"2023-10-16T08:51:23.654094+0000","last_peered":"2023-10-16T08:51:23.654094+0000","last_clean":"2023-10-16T08:51:23.654094+0000","last_became_active":"2023-10-16T08:51:18.463071+0000","last_became_peered":"2023-10-16T08:51:18.463071+0000","last_unstale":"2023-10-16T08:51:23.654094+0000","last_undegraded":"2023-10-16T08:51:23.654094+0000","last_fullsized":"2023-10-16T08:51:23.654094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.630687+0000","last_change":"2023-10-16T08:51:23.691542+0000","last_active":"2023-10-16T08:51:24.630687+0000","last_peered":"2023-10-16T08:51:24.630687+0000","last_clean":"2023-10-16T08:51:24.630687+0000","last_became_active":"2023-10-16T08:51:23.691184+0000","last_became_peered":"2023-10-16T08:51:23.691184+0000","last_unstale":"2023-10-16T08:51:24.630687+0000","last_undegraded":"2023-10-16T08:51:24.630687+0000","last_fullsized":"2023-10-16T08:51:24.630687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:30.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663653+0000","last_change":"2023-10-16T08:51:19.489377+0000","last_active":"2023-10-16T08:51:23.663653+0000","last_peered":"2023-10-16T08:51:23.663653+0000","last_clean":"2023-10-16T08:51:23.663653+0000","last_became_active":"2023-10-16T08:51:19.488616+0000","last_became_peered":"2023-10-16T08:51:19.488616+0000","last_unstale":"2023-10-16T08:51:23.663653+0000","last_undegraded":"2023-10-16T08:51:23.663653+0000","last_fullsized":"2023-10-16T08:51:23.663653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927969+0000","last_change":"2023-10-16T08:51:18.476307+0000","last_active":"2023-10-16T08:51:23.927969+0000","last_peered":"2023-10-16T08:51:23.927969+0000","last_clean":"2023-10-16T08:51:23.927969+0000","last_became_active":"2023-10-16T08:51:18.475934+0000","last_became_peered":"2023-10-16T08:51:18.475934+0000","last_unstale":"2023-10-16T08:51:23.927969+0000","last_undegraded":"2023-10-16T08:51:23.927969+0000","last_fullsized":"2023-10-16T08:51:23.927969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:59:05.397275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780681+0000","last_change":"2023-10-16T08:51:23.940016+0000","last_active":"2023-10-16T08:51:24.780681+0000","last_peered":"2023-10-16T08:51:24.780681+0000","last_clean":"2023-10-16T08:51:24.780681+0000","last_became_active":"2023-10-16T08:51:23.939540+0000","last_became_peered":"2023-10-16T08:51:23.939540+0000","last_unstale":"2023-10-16T08:51:24.780681+0000","last_undegraded":"2023-10-16T08:51:24.780681+0000","last_fullsized":"2023-10-16T08:51:24.780681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:06.205944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655322+0000","last_change":"2023-10-16T08:51:19.488905+0000","last_active":"2023-10-16T08:51:23.655322+0000","last_peered":"2023-10-16T08:51:23.655322+0000","last_clean":"2023-10-16T08:51:23.655322+0000","last_became_active":"2023-10-16T08:51:19.488447+0000","last_became_peered":"2023-10-16T08:51:19.488447+0000","last_unstale":"2023-10-16T08:51:23.655322+0000","last_undegraded":"2023-10-16T08:51:23.655322+0000","last_fullsized":"2023-10-16T08:51:23.655322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654978+0000","last_change":"2023-10-16T08:51:18.461925+0000","last_active":"2023-10-16T08:51:23.654978+0000","last_peered":"2023-10-16T08:51:23.654978+0000","last_clean":"2023-10-16T08:51:23.654978+0000","last_became_active":"2023-10-16T08:51:18.461503+0000","last_became_peered":"2023-10-16T08:51:18.461503+0000","last_unstale":"2023-10-16T08:51:23.654978+0000","last_undegraded":"2023-10-16T08:51:23.654978+0000","last_fullsized":"2023-10-16T08:51:23.654978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:25.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928140+0000","last_change":"2023-10-16T08:51:09.503647+0000","last_active":"2023-10-16T08:51:23.928140+0000","last_peered":"2023-10-16T08:51:23.928140+0000","last_clean":"2023-10-16T08:51:23.928140+0000","last_became_active":"2023-10-16T08:51:09.501573+0000","last_became_peered":"2023-10-16T08:51:09.501573+0000","last_unstale":"2023-10-16T08:51:23.928140+0000","last_undegraded":"2023-10-16T08:51:23.928140+0000","last_fullsized":"2023-10-16T08:51:23.928140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_clean_scrub_stamp":"2023-10-16T08:51:08.277379+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:32.541738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632345+0000","last_change":"2023-10-16T08:51:23.937102+0000","last_active":"2023-10-16T08:51:24.632345+0000","last_peered":"2023-10-16T08:51:24.632345+0000","last_clean":"2023-10-16T08:51:24.632345+0000","last_became_active":"2023-10-16T08:51:23.935917+0000","last_became_peered":"2023-10-16T08:51:23.935917+0000","last_unstale":"2023-10-16T08:51:24.632345+0000","last_undegraded":"2023-10-16T08:51:24.632345+0000","last_fullsized":"2023-10-16T08:51:24.632345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:32.899076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932357+0000","last_change":"2023-10-16T08:51:19.482065+0000","last_active":"2023-10-16T08:51:23.932357+0000","last_peered":"2023-10-16T08:51:23.932357+0000","last_clean":"2023-10-16T08:51:23.932357+0000","last_became_active":"2023-10-16T08:51:19.481709+0000","last_became_peered":"2023-10-16T08:51:19.481709+0000","last_unstale":"2023-10-16T08:51:23.932357+0000","last_undegraded":"2023-10-16T08:51:23.932357+0000","last_fullsized":"2023-10-16T08:51:23.932357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:56:52.502214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656330+0000","last_change":"2023-10-16T08:51:18.461990+0000","last_active":"2023-10-16T08:51:23.656330+0000","last_peered":"2023-10-16T08:51:23.656330+0000","last_clean":"2023-10-16T08:51:23.656330+0000","last_became_active":"2023-10-16T08:51:18.461726+0000","last_became_peered":"2023-10-16T08:51:18.461726+0000","last_unstale":"2023-10-16T08:51:23.656330+0000","last_undegraded":"2023-10-16T08:51:23.656330+0000","last_fullsized":"2023-10-16T08:51:23.656330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:00.458386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.631811+0000","last_change":"2023-10-16T08:51:23.931184+0000","last_active":"2023-10-16T08:51:24.631811+0000","last_peered":"2023-10-16T08:51:24.631811+0000","last_clean":"2023-10-16T08:51:24.631811+0000","last_became_active":"2023-10-16T08:51:23.929798+0000","last_became_peered":"2023-10-16T08:51:23.929798+0000","last_unstale":"2023-10-16T08:51:24.631811+0000","last_undegraded":"2023-10-16T08:51:24.631811+0000","last_fullsized":"2023-10-16T08:51:24.631811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:24.877683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655861+0000","last_change":"2023-10-16T08:51:19.498976+0000","last_active":"2023-10-16T08:51:23.655861+0000","last_peered":"2023-10-16T08:51:23.655861+0000","last_clean":"2023-10-16T08:51:23.655861+0000","last_became_active":"2023-10-16T08:51:19.498594+0000","last_became_peered":"2023-10-16T08:51:19.498594+0000","last_unstale":"2023-10-16T08:51:23.655861+0000","last_undegraded":"2023-10-16T08:51:23.655861+0000","last_fullsized":"2023-10-16T08:51:23.655861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.675885+0000","last_change":"2023-10-16T08:51:18.466809+0000","last_active":"2023-10-16T08:51:23.675885+0000","last_peered":"2023-10-16T08:51:23.675885+0000","last_clean":"2023-10-16T08:51:23.675885+0000","last_became_active":"2023-10-16T08:51:18.466510+0000","last_became_peered":"2023-10-16T08:51:18.466510+0000","last_unstale":"2023-10-16T08:51:23.675885+0000","last_undegraded":"2023-10-16T08:51:23.675885+0000","last_fullsized":"2023-10-16T08:51:23.675885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:21:49.782547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780180+0000","last_change":"2023-10-16T08:51:23.685215+0000","last_active":"2023-10-16T08:51:24.780180+0000","last_peered":"2023-10-16T08:51:24.780180+0000","last_clean":"2023-10-16T08:51:24.780180+0000","last_became_active":"2023-10-16T08:51:23.684822+0000","last_became_peered":"2023-10-16T08:51:23.684822+0000","last_unstale":"2023-10-16T08:51:24.780180+0000","last_undegraded":"2023-10-16T08:51:24.780180+0000","last_fullsized":"2023-10-16T08:51:24.780180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933980+0000","last_change":"2023-10-16T08:51:19.499775+0000","last_active":"2023-10-16T08:51:23.933980+0000","last_peered":"2023-10-16T08:51:23.933980+0000","last_clean":"2023-10-16T08:51:23.933980+0000","last_became_active":"2023-10-16T08:51:19.499561+0000","last_became_peered":"2023-10-16T08:51:19.499561+0000","last_unstale":"2023-10-16T08:51:23.933980+0000","last_undegraded":"2023-10-16T08:51:23.933980+0000","last_fullsized":"2023-10-16T08:51:23.933980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:58:34.736828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655991+0000","last_change":"2023-10-16T08:51:18.461494+0000","last_active":"2023-10-16T08:51:23.655991+0000","last_peered":"2023-10-16T08:51:23.655991+0000","last_clean":"2023-10-16T08:51:23.655991+0000","last_became_active":"2023-10-16T08:51:18.461196+0000","last_became_peered":"2023-10-16T08:51:18.461196+0000","last_unstale":"2023-10-16T08:51:23.655991+0000","last_undegraded":"2023-10-16T08:51:23.655991+0000","last_fullsized":"2023-10-16T08:51:23.655991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:15:54.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.004761+0000","last_change":"2023-10-16T08:51:23.942518+0000","last_active":"2023-10-16T08:51:25.004761+0000","last_peered":"2023-10-16T08:51:25.004761+0000","last_clean":"2023-10-16T08:51:25.004761+0000","last_became_active":"2023-10-16T08:51:23.940495+0000","last_became_peered":"2023-10-16T08:51:23.940495+0000","last_unstale":"2023-10-16T08:51:25.004761+0000","last_undegraded":"2023-10-16T08:51:25.004761+0000","last_fullsized":"2023-10-16T08:51:25.004761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932360+0000","last_change":"2023-10-16T08:51:19.502686+0000","last_active":"2023-10-16T08:51:23.932360+0000","last_peered":"2023-10-16T08:51:23.932360+0000","last_clean":"2023-10-16T08:51:23.932360+0000","last_became_active":"2023-10-16T08:51:19.502370+0000","last_became_peered":"2023-10-16T08:51:19.502370+0000","last_unstale":"2023-10-16T08:51:23.932360+0000","last_undegraded":"2023-10-16T08:51:23.932360+0000","last_fullsized":"2023-10-16T08:51:23.932360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:33.452930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.682777+0000","last_change":"2023-10-16T08:51:18.457359+0000","last_active":"2023-10-16T08:51:23.682777+0000","last_peered":"2023-10-16T08:51:23.682777+0000","last_clean":"2023-10-16T08:51:23.682777+0000","last_became_active":"2023-10-16T08:51:18.454341+0000","last_became_peered":"2023-10-16T08:51:18.454341+0000","last_unstale":"2023-10-16T08:51:23.682777+0000","last_undegraded":"2023-10-16T08:51:23.682777+0000","last_fullsized":"2023-10-16T08:51:23.682777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:28:03.145085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.001723+0000","last_change":"2023-10-16T08:51:23.687589+0000","last_active":"2023-10-16T08:51:25.001723+0000","last_peered":"2023-10-16T08:51:25.001723+0000","last_clean":"2023-10-16T08:51:25.001723+0000","last_became_active":"2023-10-16T08:51:23.687045+0000","last_became_peered":"2023-10-16T08:51:23.687045+0000","last_unstale":"2023-10-16T08:51:25.001723+0000","last_undegraded":"2023-10-16T08:51:25.001723+0000","last_fullsized":"2023-10-16T08:51:25.001723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:16.195721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927678+0000","last_change":"2023-10-16T08:51:19.499551+0000","last_active":"2023-10-16T08:51:23.927678+0000","last_peered":"2023-10-16T08:51:23.927678+0000","last_clean":"2023-10-16T08:51:23.927678+0000","last_became_active":"2023-10-16T08:51:19.499250+0000","last_became_peered":"2023-10-16T08:51:19.499250+0000","last_unstale":"2023-10-16T08:51:23.927678+0000","last_undegraded":"2023-10-16T08:51:23.927678+0000","last_fullsized":"2023-10-16T08:51:23.927678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:23:08.959209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653215+0000","last_change":"2023-10-16T08:51:18.452602+0000","last_active":"2023-10-16T08:51:23.653215+0000","last_peered":"2023-10-16T08:51:23.653215+0000","last_clean":"2023-10-16T08:51:23.653215+0000","last_became_active":"2023-10-16T08:51:18.452286+0000","last_became_peered":"2023-10-16T08:51:18.452286+0000","last_unstale":"2023-10-16T08:51:23.653215+0000","last_undegraded":"2023-10-16T08:51:23.653215+0000","last_fullsized":"2023-10-16T08:51:23.653215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:53:09.991021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780619+0000","last_change":"2023-10-16T08:51:23.680434+0000","last_active":"2023-10-16T08:51:24.780619+0000","last_peered":"2023-10-16T08:51:24.780619+0000","last_clean":"2023-10-16T08:51:24.780619+0000","last_became_active":"2023-10-16T08:51:23.679325+0000","last_became_peered":"2023-10-16T08:51:23.679325+0000","last_unstale":"2023-10-16T08:51:24.780619+0000","last_undegraded":"2023-10-16T08:51:24.780619+0000","last_fullsized":"2023-10-16T08:51:24.780619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:54.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666563+0000","last_change":"2023-10-16T08:51:19.477576+0000","last_active":"2023-10-16T08:51:23.666563+0000","last_peered":"2023-10-16T08:51:23.666563+0000","last_clean":"2023-10-16T08:51:23.666563+0000","last_became_active":"2023-10-16T08:51:19.477091+0000","last_became_peered":"2023-10-16T08:51:19.477091+0000","last_unstale":"2023-10-16T08:51:23.666563+0000","last_undegraded":"2023-10-16T08:51:23.666563+0000","last_fullsized":"2023-10-16T08:51:23.666563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669994+0000","last_change":"2023-10-16T08:51:18.471810+0000","last_active":"2023-10-16T08:51:23.669994+0000","last_peered":"2023-10-16T08:51:23.669994+0000","last_clean":"2023-10-16T08:51:23.669994+0000","last_became_active":"2023-10-16T08:51:18.471510+0000","last_became_peered":"2023-10-16T08:51:18.471510+0000","last_unstale":"2023-10-16T08:51:23.669994+0000","last_undegraded":"2023-10-16T08:51:23.669994+0000","last_fullsized":"2023-10-16T08:51:23.669994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:56:36.201906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633912+0000","last_change":"2023-10-16T08:51:23.938213+0000","last_active":"2023-10-16T08:51:24.633912+0000","last_peered":"2023-10-16T08:51:24.633912+0000","last_clean":"2023-10-16T08:51:24.633912+0000","last_became_active":"2023-10-16T08:51:23.937788+0000","last_became_peered":"2023-10-16T08:51:23.937788+0000","last_unstale":"2023-10-16T08:51:24.633912+0000","last_undegraded":"2023-10-16T08:51:24.633912+0000","last_fullsized":"2023-10-16T08:51:24.633912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:49:28.604941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932586+0000","last_change":"2023-10-16T08:51:19.505378+0000","last_active":"2023-10-16T08:51:23.932586+0000","last_peered":"2023-10-16T08:51:23.932586+0000","last_clean":"2023-10-16T08:51:23.932586+0000","last_became_active":"2023-10-16T08:51:19.500129+0000","last_became_peered":"2023-10-16T08:51:19.500129+0000","last_unstale":"2023-10-16T08:51:23.932586+0000","last_undegraded":"2023-10-16T08:51:23.932586+0000","last_fullsized":"2023-10-16T08:51:23.932586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:07:33.223548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656405+0000","last_change":"2023-10-16T08:51:18.462956+0000","last_active":"2023-10-16T08:51:23.656405+0000","last_peered":"2023-10-16T08:51:23.656405+0000","last_clean":"2023-10-16T08:51:23.656405+0000","last_became_active":"2023-10-16T08:51:18.462673+0000","last_became_peered":"2023-10-16T08:51:18.462673+0000","last_unstale":"2023-10-16T08:51:23.656405+0000","last_undegraded":"2023-10-16T08:51:23.656405+0000","last_fullsized":"2023-10-16T08:51:23.656405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:34.739453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.634200+0000","last_change":"2023-10-16T08:51:23.938458+0000","last_active":"2023-10-16T08:51:24.634200+0000","last_peered":"2023-10-16T08:51:24.634200+0000","last_clean":"2023-10-16T08:51:24.634200+0000","last_became_active":"2023-10-16T08:51:23.938009+0000","last_became_peered":"2023-10-16T08:51:23.938009+0000","last_unstale":"2023-10-16T08:51:24.634200+0000","last_undegraded":"2023-10-16T08:51:24.634200+0000","last_fullsized":"2023-10-16T08:51:24.634200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:17:08.498890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663209+0000","last_change":"2023-10-16T08:51:19.490700+0000","last_active":"2023-10-16T08:51:23.663209+0000","last_peered":"2023-10-16T08:51:23.663209+0000","last_clean":"2023-10-16T08:51:23.663209+0000","last_became_active":"2023-10-16T08:51:19.490423+0000","last_became_peered":"2023-10-16T08:51:19.490423+0000","last_unstale":"2023-10-16T08:51:23.663209+0000","last_undegraded":"2023-10-16T08:51:23.663209+0000","last_fullsized":"2023-10-16T08:51:23.663209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:44:19.773784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663431+0000","last_change":"2023-10-16T08:51:18.467662+0000","last_active":"2023-10-16T08:51:23.663431+0000","last_peered":"2023-10-16T08:51:23.663431+0000","last_clean":"2023-10-16T08:51:23.663431+0000","last_became_active":"2023-10-16T08:51:18.466371+0000","last_became_peered":"2023-10-16T08:51:18.466371+0000","last_unstale":"2023-10-16T08:51:23.663431+0000","last_undegraded":"2023-10-16T08:51:23.663431+0000","last_fullsized":"2023-10-16T08:51:23.663431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:41:34.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.009698+0000","last_change":"2023-10-16T08:51:23.933148+0000","last_active":"2023-10-16T08:51:25.009698+0000","last_peered":"2023-10-16T08:51:25.009698+0000","last_clean":"2023-10-16T08:51:25.009698+0000","last_became_active":"2023-10-16T08:51:23.929507+0000","last_became_peered":"2023-10-16T08:51:23.929507+0000","last_unstale":"2023-10-16T08:51:25.009698+0000","last_undegraded":"2023-10-16T08:51:25.009698+0000","last_fullsized":"2023-10-16T08:51:25.009698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.932219+0000","last_change":"2023-10-16T08:51:19.489578+0000","last_active":"2023-10-16T08:51:23.932219+0000","last_peered":"2023-10-16T08:51:23.932219+0000","last_clean":"2023-10-16T08:51:23.932219+0000","last_became_active":"2023-10-16T08:51:19.489229+0000","last_became_peered":"2023-10-16T08:51:19.489229+0000","last_unstale":"2023-10-16T08:51:23.932219+0000","last_undegraded":"2023-10-16T08:51:23.932219+0000","last_fullsized":"2023-10-16T08:51:23.932219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:22:30.514244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:37.318046+0000","last_change":"2023-10-16T08:51:18.473025+0000","last_active":"2023-10-16T08:51:37.318046+0000","last_peered":"2023-10-16T08:51:37.318046+0000","last_clean":"2023-10-16T08:51:37.318046+0000","last_became_active":"2023-10-16T08:51:18.471838+0000","last_became_peered":"2023-10-16T08:51:18.471838+0000","last_unstale":"2023-10-16T08:51:37.318046+0000","last_undegraded":"2023-10-16T08:51:37.318046+0000","last_fullsized":"2023-10-16T08:51:37.318046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:57:29.907304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.629165+0000","last_change":"2023-10-16T08:51:23.687837+0000","last_active":"2023-10-16T08:51:24.629165+0000","last_peered":"2023-10-16T08:51:24.629165+0000","last_clean":"2023-10-16T08:51:24.629165+0000","last_became_active":"2023-10-16T08:51:23.687415+0000","last_became_peered":"2023-10-16T08:51:23.687415+0000","last_unstale":"2023-10-16T08:51:24.629165+0000","last_undegraded":"2023-10-16T08:51:24.629165+0000","last_fullsized":"2023-10-16T08:51:24.629165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:25:37.663996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681874+0000","last_change":"2023-10-16T08:51:19.493209+0000","last_active":"2023-10-16T08:51:23.681874+0000","last_peered":"2023-10-16T08:51:23.681874+0000","last_clean":"2023-10-16T08:51:23.681874+0000","last_became_active":"2023-10-16T08:51:19.493039+0000","last_became_peered":"2023-10-16T08:51:19.493039+0000","last_unstale":"2023-10-16T08:51:23.681874+0000","last_undegraded":"2023-10-16T08:51:23.681874+0000","last_fullsized":"2023-10-16T08:51:23.681874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674711+0000","last_change":"2023-10-16T08:51:18.463657+0000","last_active":"2023-10-16T08:51:23.674711+0000","last_peered":"2023-10-16T08:51:23.674711+0000","last_clean":"2023-10-16T08:51:23.674711+0000","last_became_active":"2023-10-16T08:51:18.463329+0000","last_became_peered":"2023-10-16T08:51:18.463329+0000","last_unstale":"2023-10-16T08:51:23.674711+0000","last_undegraded":"2023-10-16T08:51:23.674711+0000","last_fullsized":"2023-10-16T08:51:23.674711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:06:21.035650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002944+0000","last_change":"2023-10-16T08:51:23.690913+0000","last_active":"2023-10-16T08:51:25.002944+0000","last_peered":"2023-10-16T08:51:25.002944+0000","last_clean":"2023-10-16T08:51:25.002944+0000","last_became_active":"2023-10-16T08:51:23.690240+0000","last_became_peered":"2023-10-16T08:51:23.690240+0000","last_unstale":"2023-10-16T08:51:25.002944+0000","last_undegraded":"2023-10-16T08:51:25.002944+0000","last_fullsized":"2023-10-16T08:51:25.002944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:12.508988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.664438+0000","last_change":"2023-10-16T08:51:19.479453+0000","last_active":"2023-10-16T08:51:23.664438+0000","last_peered":"2023-10-16T08:51:23.664438+0000","last_clean":"2023-10-16T08:51:23.664438+0000","last_became_active":"2023-10-16T08:51:19.479175+0000","last_became_peered":"2023-10-16T08:51:19.479175+0000","last_unstale":"2023-10-16T08:51:23.664438+0000","last_undegraded":"2023-10-16T08:51:23.664438+0000","last_fullsized":"2023-10-16T08:51:23.664438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655640+0000","last_change":"2023-10-16T08:51:18.477626+0000","last_active":"2023-10-16T08:51:23.655640+0000","last_peered":"2023-10-16T08:51:23.655640+0000","last_clean":"2023-10-16T08:51:23.655640+0000","last_became_active":"2023-10-16T08:51:18.476856+0000","last_became_peered":"2023-10-16T08:51:18.476856+0000","last_unstale":"2023-10-16T08:51:23.655640+0000","last_undegraded":"2023-10-16T08:51:23.655640+0000","last_fullsized":"2023-10-16T08:51:23.655640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:06.623099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632401+0000","last_change":"2023-10-16T08:51:23.684289+0000","last_active":"2023-10-16T08:51:24.632401+0000","last_peered":"2023-10-16T08:51:24.632401+0000","last_clean":"2023-10-16T08:51:24.632401+0000","last_became_active":"2023-10-16T08:51:23.682351+0000","last_became_peered":"2023-10-16T08:51:23.682351+0000","last_unstale":"2023-10-16T08:51:24.632401+0000","last_undegraded":"2023-10-16T08:51:24.632401+0000","last_fullsized":"2023-10-16T08:51:24.632401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:19:24.423311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655380+0000","last_change":"2023-10-16T08:51:19.496098+0000","last_active":"2023-10-16T08:51:23.655380+0000","last_peered":"2023-10-16T08:51:23.655380+0000","last_clean":"2023-10-16T08:51:23.655380+0000","last_became_active":"2023-10-16T08:51:19.495623+0000","last_became_peered":"2023-10-16T08:51:19.495623+0000","last_unstale":"2023-10-16T08:51:23.655380+0000","last_undegraded":"2023-10-16T08:51:23.655380+0000","last_fullsized":"2023-10-16T08:51:23.655380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:50.322181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.673307+0000","last_change":"2023-10-16T08:51:18.474818+0000","last_active":"2023-10-16T08:51:23.673307+0000","last_peered":"2023-10-16T08:51:23.673307+0000","last_clean":"2023-10-16T08:51:23.673307+0000","last_became_active":"2023-10-16T08:51:18.473153+0000","last_became_peered":"2023-10-16T08:51:18.473153+0000","last_unstale":"2023-10-16T08:51:23.673307+0000","last_undegraded":"2023-10-16T08:51:23.673307+0000","last_fullsized":"2023-10-16T08:51:23.673307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632414+0000","last_change":"2023-10-16T08:51:23.943636+0000","last_active":"2023-10-16T08:51:24.632414+0000","last_peered":"2023-10-16T08:51:24.632414+0000","last_clean":"2023-10-16T08:51:24.632414+0000","last_became_active":"2023-10-16T08:51:23.943081+0000","last_became_peered":"2023-10-16T08:51:23.943081+0000","last_unstale":"2023-10-16T08:51:24.632414+0000","last_undegraded":"2023-10-16T08:51:24.632414+0000","last_fullsized":"2023-10-16T08:51:24.632414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:10:55.999783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.780507+0000","last_change":"2023-10-16T08:51:23.941536+0000","last_active":"2023-10-16T08:51:24.780507+0000","last_peered":"2023-10-16T08:51:24.780507+0000","last_clean":"2023-10-16T08:51:24.780507+0000","last_became_active":"2023-10-16T08:51:23.940210+0000","last_became_peered":"2023-10-16T08:51:23.940210+0000","last_unstale":"2023-10-16T08:51:24.780507+0000","last_undegraded":"2023-10-16T08:51:24.780507+0000","last_fullsized":"2023-10-16T08:51:24.780507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:19:20.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676073+0000","last_change":"2023-10-16T08:51:19.492153+0000","last_active":"2023-10-16T08:51:23.676073+0000","last_peered":"2023-10-16T08:51:23.676073+0000","last_clean":"2023-10-16T08:51:23.676073+0000","last_became_active":"2023-10-16T08:51:19.491873+0000","last_became_peered":"2023-10-16T08:51:19.491873+0000","last_unstale":"2023-10-16T08:51:23.676073+0000","last_undegraded":"2023-10-16T08:51:23.676073+0000","last_fullsized":"2023-10-16T08:51:23.676073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:53:20.049093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656917+0000","last_change":"2023-10-16T08:51:18.470467+0000","last_active":"2023-10-16T08:51:23.656917+0000","last_peered":"2023-10-16T08:51:23.656917+0000","last_clean":"2023-10-16T08:51:23.656917+0000","last_became_active":"2023-10-16T08:51:18.469986+0000","last_became_peered":"2023-10-16T08:51:18.469986+0000","last_unstale":"2023-10-16T08:51:23.656917+0000","last_undegraded":"2023-10-16T08:51:23.656917+0000","last_fullsized":"2023-10-16T08:51:23.656917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:00.105214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.632702+0000","last_change":"2023-10-16T08:51:23.694583+0000","last_active":"2023-10-16T08:51:24.632702+0000","last_peered":"2023-10-16T08:51:24.632702+0000","last_clean":"2023-10-16T08:51:24.632702+0000","last_became_active":"2023-10-16T08:51:23.694186+0000","last_became_peered":"2023-10-16T08:51:23.694186+0000","last_unstale":"2023-10-16T08:51:24.632702+0000","last_undegraded":"2023-10-16T08:51:24.632702+0000","last_fullsized":"2023-10-16T08:51:24.632702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:32:08.361476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.658643+0000","last_change":"2023-10-16T08:51:19.477096+0000","last_active":"2023-10-16T08:51:23.658643+0000","last_peered":"2023-10-16T08:51:23.658643+0000","last_clean":"2023-10-16T08:51:23.658643+0000","last_became_active":"2023-10-16T08:51:19.473590+0000","last_became_peered":"2023-10-16T08:51:19.473590+0000","last_unstale":"2023-10-16T08:51:23.658643+0000","last_undegraded":"2023-10-16T08:51:23.658643+0000","last_fullsized":"2023-10-16T08:51:23.658643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654035+0000","last_change":"2023-10-16T08:51:18.471924+0000","last_active":"2023-10-16T08:51:23.654035+0000","last_peered":"2023-10-16T08:51:23.654035+0000","last_clean":"2023-10-16T08:51:23.654035+0000","last_became_active":"2023-10-16T08:51:18.471592+0000","last_became_peered":"2023-10-16T08:51:18.471592+0000","last_unstale":"2023-10-16T08:51:23.654035+0000","last_undegraded":"2023-10-16T08:51:23.654035+0000","last_fullsized":"2023-10-16T08:51:23.654035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:47:19.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669470+0000","last_change":"2023-10-16T08:51:18.474173+0000","last_active":"2023-10-16T08:51:23.669470+0000","last_peered":"2023-10-16T08:51:23.669470+0000","last_clean":"2023-10-16T08:51:23.669470+0000","last_became_active":"2023-10-16T08:51:18.473185+0000","last_became_peered":"2023-10-16T08:51:18.473185+0000","last_unstale":"2023-10-16T08:51:23.669470+0000","last_undegraded":"2023-10-16T08:51:23.669470+0000","last_fullsized":"2023-10-16T08:51:23.669470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:09:12.237149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663356+0000","last_change":"2023-10-16T08:51:19.488282+0000","last_active":"2023-10-16T08:51:23.663356+0000","last_peered":"2023-10-16T08:51:23.663356+0000","last_clean":"2023-10-16T08:51:23.663356+0000","last_became_active":"2023-10-16T08:51:19.487960+0000","last_became_peered":"2023-10-16T08:51:19.487960+0000","last_unstale":"2023-10-16T08:51:23.663356+0000","last_undegraded":"2023-10-16T08:51:23.663356+0000","last_fullsized":"2023-10-16T08:51:23.663356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:25.002055+0000","last_change":"2023-10-16T08:51:23.689131+0000","last_active":"2023-10-16T08:51:25.002055+0000","last_peered":"2023-10-16T08:51:25.002055+0000","last_clean":"2023-10-16T08:51:25.002055+0000","last_became_active":"2023-10-16T08:51:23.686763+0000","last_became_peered":"2023-10-16T08:51:23.686763+0000","last_unstale":"2023-10-16T08:51:25.002055+0000","last_undegraded":"2023-10-16T08:51:25.002055+0000","last_fullsized":"2023-10-16T08:51:25.002055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:33:19.111523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:18.475217+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:18.474923+0000","last_became_peered":"2023-10-16T08:51:18.474923+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:17.408176+0000","last_clean_scrub_stamp":"2023-10-16T08:51:17.408176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:52.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681558+0000","last_change":"2023-10-16T08:51:19.490076+0000","last_active":"2023-10-16T08:51:23.681558+0000","last_peered":"2023-10-16T08:51:23.681558+0000","last_clean":"2023-10-16T08:51:23.681558+0000","last_became_active":"2023-10-16T08:51:19.489836+0000","last_became_peered":"2023-10-16T08:51:19.489836+0000","last_unstale":"2023-10-16T08:51:23.681558+0000","last_undegraded":"2023-10-16T08:51:23.681558+0000","last_fullsized":"2023-10-16T08:51:23.681558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:12:01.471157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T08:51:24.633844+0000","last_change":"2023-10-16T08:51:23.681986+0000","last_active":"2023-10-16T08:51:24.633844+0000","last_peered":"2023-10-16T08:51:24.633844+0000","last_clean":"2023-10-16T08:51:24.633844+0000","last_became_active":"2023-10-16T08:51:23.681604+0000","last_became_peered":"2023-10-16T08:51:23.681604+0000","last_unstale":"2023-10-16T08:51:24.633844+0000","last_undegraded":"2023-10-16T08:51:24.633844+0000","last_fullsized":"2023-10-16T08:51:24.633844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:22.632013+0000","last_clean_scrub_stamp":"2023-10-16T08:51:22.632013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:17:42.378142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.666407+0000","last_change":"2023-10-16T08:51:19.477397+0000","last_active":"2023-10-16T08:51:23.666407+0000","last_peered":"2023-10-16T08:51:23.666407+0000","last_clean":"2023-10-16T08:51:23.666407+0000","last_became_active":"2023-10-16T08:51:19.476711+0000","last_became_peered":"2023-10-16T08:51:19.476711+0000","last_unstale":"2023-10-16T08:51:23.666407+0000","last_undegraded":"2023-10-16T08:51:23.666407+0000","last_fullsized":"2023-10-16T08:51:23.666407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:25:01.117985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.654004+0000","last_change":"2023-10-16T08:51:19.481363+0000","last_active":"2023-10-16T08:51:23.654004+0000","last_peered":"2023-10-16T08:51:23.654004+0000","last_clean":"2023-10-16T08:51:23.654004+0000","last_became_active":"2023-10-16T08:51:19.480970+0000","last_became_peered":"2023-10-16T08:51:19.480970+0000","last_unstale":"2023-10-16T08:51:23.654004+0000","last_undegraded":"2023-10-16T08:51:23.654004+0000","last_fullsized":"2023-10-16T08:51:23.654004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656160+0000","last_change":"2023-10-16T08:51:19.477774+0000","last_active":"2023-10-16T08:51:23.656160+0000","last_peered":"2023-10-16T08:51:23.656160+0000","last_clean":"2023-10-16T08:51:23.656160+0000","last_became_active":"2023-10-16T08:51:19.475123+0000","last_became_peered":"2023-10-16T08:51:19.475123+0000","last_unstale":"2023-10-16T08:51:23.656160+0000","last_undegraded":"2023-10-16T08:51:23.656160+0000","last_fullsized":"2023-10-16T08:51:23.656160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:30:28.688010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663346+0000","last_change":"2023-10-16T08:51:19.470555+0000","last_active":"2023-10-16T08:51:23.663346+0000","last_peered":"2023-10-16T08:51:23.663346+0000","last_clean":"2023-10-16T08:51:23.663346+0000","last_became_active":"2023-10-16T08:51:19.470021+0000","last_became_peered":"2023-10-16T08:51:19.470021+0000","last_unstale":"2023-10-16T08:51:23.663346+0000","last_undegraded":"2023-10-16T08:51:23.663346+0000","last_fullsized":"2023-10-16T08:51:23.663346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655354+0000","last_change":"2023-10-16T08:51:19.477990+0000","last_active":"2023-10-16T08:51:23.655354+0000","last_peered":"2023-10-16T08:51:23.655354+0000","last_clean":"2023-10-16T08:51:23.655354+0000","last_became_active":"2023-10-16T08:51:19.477299+0000","last_became_peered":"2023-10-16T08:51:19.477299+0000","last_unstale":"2023-10-16T08:51:23.655354+0000","last_undegraded":"2023-10-16T08:51:23.655354+0000","last_fullsized":"2023-10-16T08:51:23.655354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:28:51.034238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.674606+0000","last_change":"2023-10-16T08:51:19.492134+0000","last_active":"2023-10-16T08:51:23.674606+0000","last_peered":"2023-10-16T08:51:23.674606+0000","last_clean":"2023-10-16T08:51:23.674606+0000","last_became_active":"2023-10-16T08:51:19.491859+0000","last_became_peered":"2023-10-16T08:51:19.491859+0000","last_unstale":"2023-10-16T08:51:23.674606+0000","last_undegraded":"2023-10-16T08:51:23.674606+0000","last_fullsized":"2023-10-16T08:51:23.674606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:50:38.473722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671269+0000","last_change":"2023-10-16T08:51:19.491815+0000","last_active":"2023-10-16T08:51:23.671269+0000","last_peered":"2023-10-16T08:51:23.671269+0000","last_clean":"2023-10-16T08:51:23.671269+0000","last_became_active":"2023-10-16T08:51:19.491422+0000","last_became_peered":"2023-10-16T08:51:19.491422+0000","last_unstale":"2023-10-16T08:51:23.671269+0000","last_undegraded":"2023-10-16T08:51:23.671269+0000","last_fullsized":"2023-10-16T08:51:23.671269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.657516+0000","last_change":"2023-10-16T08:51:19.492217+0000","last_active":"2023-10-16T08:51:23.657516+0000","last_peered":"2023-10-16T08:51:23.657516+0000","last_clean":"2023-10-16T08:51:23.657516+0000","last_became_active":"2023-10-16T08:51:19.491892+0000","last_became_peered":"2023-10-16T08:51:19.491892+0000","last_unstale":"2023-10-16T08:51:23.657516+0000","last_undegraded":"2023-10-16T08:51:23.657516+0000","last_fullsized":"2023-10-16T08:51:23.657516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656714+0000","last_change":"2023-10-16T08:51:19.475841+0000","last_active":"2023-10-16T08:51:23.656714+0000","last_peered":"2023-10-16T08:51:23.656714+0000","last_clean":"2023-10-16T08:51:23.656714+0000","last_became_active":"2023-10-16T08:51:19.475196+0000","last_became_peered":"2023-10-16T08:51:19.475196+0000","last_unstale":"2023-10-16T08:51:23.656714+0000","last_undegraded":"2023-10-16T08:51:23.656714+0000","last_fullsized":"2023-10-16T08:51:23.656714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:43:25.214342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653907+0000","last_change":"2023-10-16T08:51:19.492583+0000","last_active":"2023-10-16T08:51:23.653907+0000","last_peered":"2023-10-16T08:51:23.653907+0000","last_clean":"2023-10-16T08:51:23.653907+0000","last_became_active":"2023-10-16T08:51:19.492322+0000","last_became_peered":"2023-10-16T08:51:19.492322+0000","last_unstale":"2023-10-16T08:51:23.653907+0000","last_undegraded":"2023-10-16T08:51:23.653907+0000","last_fullsized":"2023-10-16T08:51:23.653907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T08:52:39.854684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655778+0000","last_change":"2023-10-16T08:51:19.484234+0000","last_active":"2023-10-16T08:51:23.655778+0000","last_peered":"2023-10-16T08:51:23.655778+0000","last_clean":"2023-10-16T08:51:23.655778+0000","last_became_active":"2023-10-16T08:51:19.483921+0000","last_became_peered":"2023-10-16T08:51:19.483921+0000","last_unstale":"2023-10-16T08:51:23.655778+0000","last_undegraded":"2023-10-16T08:51:23.655778+0000","last_fullsized":"2023-10-16T08:51:23.655778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:33:20.666617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663277+0000","last_change":"2023-10-16T08:51:19.487699+0000","last_active":"2023-10-16T08:51:23.663277+0000","last_peered":"2023-10-16T08:51:23.663277+0000","last_clean":"2023-10-16T08:51:23.663277+0000","last_became_active":"2023-10-16T08:51:19.487423+0000","last_became_peered":"2023-10-16T08:51:19.487423+0000","last_unstale":"2023-10-16T08:51:23.663277+0000","last_undegraded":"2023-10-16T08:51:23.663277+0000","last_fullsized":"2023-10-16T08:51:23.663277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669411+0000","last_change":"2023-10-16T08:51:19.496931+0000","last_active":"2023-10-16T08:51:23.669411+0000","last_peered":"2023-10-16T08:51:23.669411+0000","last_clean":"2023-10-16T08:51:23.669411+0000","last_became_active":"2023-10-16T08:51:19.494302+0000","last_became_peered":"2023-10-16T08:51:19.494302+0000","last_unstale":"2023-10-16T08:51:23.669411+0000","last_undegraded":"2023-10-16T08:51:23.669411+0000","last_fullsized":"2023-10-16T08:51:23.669411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:16:35.752224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.934841+0000","last_change":"2023-10-16T08:51:19.482651+0000","last_active":"2023-10-16T08:51:23.934841+0000","last_peered":"2023-10-16T08:51:23.934841+0000","last_clean":"2023-10-16T08:51:23.934841+0000","last_became_active":"2023-10-16T08:51:19.482392+0000","last_became_peered":"2023-10-16T08:51:19.482392+0000","last_unstale":"2023-10-16T08:51:23.934841+0000","last_undegraded":"2023-10-16T08:51:23.934841+0000","last_fullsized":"2023-10-16T08:51:23.934841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:50.214064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655880+0000","last_change":"2023-10-16T08:51:19.492889+0000","last_active":"2023-10-16T08:51:23.655880+0000","last_peered":"2023-10-16T08:51:23.655880+0000","last_clean":"2023-10-16T08:51:23.655880+0000","last_became_active":"2023-10-16T08:51:19.492576+0000","last_became_peered":"2023-10-16T08:51:19.492576+0000","last_unstale":"2023-10-16T08:51:23.655880+0000","last_undegraded":"2023-10-16T08:51:23.655880+0000","last_fullsized":"2023-10-16T08:51:23.655880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:58:25.392676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656813+0000","last_change":"2023-10-16T08:51:19.497299+0000","last_active":"2023-10-16T08:51:23.656813+0000","last_peered":"2023-10-16T08:51:23.656813+0000","last_clean":"2023-10-16T08:51:23.656813+0000","last_became_active":"2023-10-16T08:51:19.495738+0000","last_became_peered":"2023-10-16T08:51:19.495738+0000","last_unstale":"2023-10-16T08:51:23.656813+0000","last_undegraded":"2023-10-16T08:51:23.656813+0000","last_fullsized":"2023-10-16T08:51:23.656813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:01.994879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656466+0000","last_change":"2023-10-16T08:51:19.476970+0000","last_active":"2023-10-16T08:51:23.656466+0000","last_peered":"2023-10-16T08:51:23.656466+0000","last_clean":"2023-10-16T08:51:23.656466+0000","last_became_active":"2023-10-16T08:51:19.475512+0000","last_became_peered":"2023-10-16T08:51:19.475512+0000","last_unstale":"2023-10-16T08:51:23.656466+0000","last_undegraded":"2023-10-16T08:51:23.656466+0000","last_fullsized":"2023-10-16T08:51:23.656466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.676171+0000","last_change":"2023-10-16T08:51:19.495546+0000","last_active":"2023-10-16T08:51:23.676171+0000","last_peered":"2023-10-16T08:51:23.676171+0000","last_clean":"2023-10-16T08:51:23.676171+0000","last_became_active":"2023-10-16T08:51:19.495247+0000","last_became_peered":"2023-10-16T08:51:19.495247+0000","last_unstale":"2023-10-16T08:51:23.676171+0000","last_undegraded":"2023-10-16T08:51:23.676171+0000","last_fullsized":"2023-10-16T08:51:23.676171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:54:20.976839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.663138+0000","last_change":"2023-10-16T08:51:19.483501+0000","last_active":"2023-10-16T08:51:23.663138+0000","last_peered":"2023-10-16T08:51:23.663138+0000","last_clean":"2023-10-16T08:51:23.663138+0000","last_became_active":"2023-10-16T08:51:19.482944+0000","last_became_peered":"2023-10-16T08:51:19.482944+0000","last_unstale":"2023-10-16T08:51:23.663138+0000","last_undegraded":"2023-10-16T08:51:23.663138+0000","last_fullsized":"2023-10-16T08:51:23.663138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:53.572062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.653847+0000","last_change":"2023-10-16T08:51:19.478486+0000","last_active":"2023-10-16T08:51:23.653847+0000","last_peered":"2023-10-16T08:51:23.653847+0000","last_clean":"2023-10-16T08:51:23.653847+0000","last_became_active":"2023-10-16T08:51:19.478148+0000","last_became_peered":"2023-10-16T08:51:19.478148+0000","last_unstale":"2023-10-16T08:51:23.653847+0000","last_undegraded":"2023-10-16T08:51:23.653847+0000","last_fullsized":"2023-10-16T08:51:23.653847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:44:24.202712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681778+0000","last_change":"2023-10-16T08:51:19.489601+0000","last_active":"2023-10-16T08:51:23.681778+0000","last_peered":"2023-10-16T08:51:23.681778+0000","last_clean":"2023-10-16T08:51:23.681778+0000","last_became_active":"2023-10-16T08:51:19.489183+0000","last_became_peered":"2023-10-16T08:51:19.489183+0000","last_unstale":"2023-10-16T08:51:23.681778+0000","last_undegraded":"2023-10-16T08:51:23.681778+0000","last_fullsized":"2023-10-16T08:51:23.681778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:36:09.319429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.669156+0000","last_change":"2023-10-16T08:51:19.487335+0000","last_active":"2023-10-16T08:51:23.669156+0000","last_peered":"2023-10-16T08:51:23.669156+0000","last_clean":"2023-10-16T08:51:23.669156+0000","last_became_active":"2023-10-16T08:51:19.487075+0000","last_became_peered":"2023-10-16T08:51:19.487075+0000","last_unstale":"2023-10-16T08:51:23.669156+0000","last_undegraded":"2023-10-16T08:51:23.669156+0000","last_fullsized":"2023-10-16T08:51:23.669156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:54:07.635870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.671049+0000","last_change":"2023-10-16T08:51:19.481528+0000","last_active":"2023-10-16T08:51:23.671049+0000","last_peered":"2023-10-16T08:51:23.671049+0000","last_clean":"2023-10-16T08:51:23.671049+0000","last_became_active":"2023-10-16T08:51:19.481200+0000","last_became_peered":"2023-10-16T08:51:19.481200+0000","last_unstale":"2023-10-16T08:51:23.671049+0000","last_undegraded":"2023-10-16T08:51:23.671049+0000","last_fullsized":"2023-10-16T08:51:23.671049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:09:10.966295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933808+0000","last_change":"2023-10-16T08:51:19.485179+0000","last_active":"2023-10-16T08:51:23.933808+0000","last_peered":"2023-10-16T08:51:23.933808+0000","last_clean":"2023-10-16T08:51:23.933808+0000","last_became_active":"2023-10-16T08:51:19.484475+0000","last_became_peered":"2023-10-16T08:51:19.484475+0000","last_unstale":"2023-10-16T08:51:23.933808+0000","last_undegraded":"2023-10-16T08:51:23.933808+0000","last_fullsized":"2023-10-16T08:51:23.933808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:26.362066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.656954+0000","last_change":"2023-10-16T08:51:19.489098+0000","last_active":"2023-10-16T08:51:23.656954+0000","last_peered":"2023-10-16T08:51:23.656954+0000","last_clean":"2023-10-16T08:51:23.656954+0000","last_became_active":"2023-10-16T08:51:19.488810+0000","last_became_peered":"2023-10-16T08:51:19.488810+0000","last_unstale":"2023-10-16T08:51:23.656954+0000","last_undegraded":"2023-10-16T08:51:23.656954+0000","last_fullsized":"2023-10-16T08:51:23.656954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.927711+0000","last_change":"2023-10-16T08:51:19.481280+0000","last_active":"2023-10-16T08:51:23.927711+0000","last_peered":"2023-10-16T08:51:23.927711+0000","last_clean":"2023-10-16T08:51:23.927711+0000","last_became_active":"2023-10-16T08:51:19.480918+0000","last_became_peered":"2023-10-16T08:51:19.480918+0000","last_unstale":"2023-10-16T08:51:23.927711+0000","last_undegraded":"2023-10-16T08:51:23.927711+0000","last_fullsized":"2023-10-16T08:51:23.927711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:22:27.239511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655534+0000","last_change":"2023-10-16T08:51:19.477823+0000","last_active":"2023-10-16T08:51:23.655534+0000","last_peered":"2023-10-16T08:51:23.655534+0000","last_clean":"2023-10-16T08:51:23.655534+0000","last_became_active":"2023-10-16T08:51:19.477234+0000","last_became_peered":"2023-10-16T08:51:19.477234+0000","last_unstale":"2023-10-16T08:51:23.655534+0000","last_undegraded":"2023-10-16T08:51:23.655534+0000","last_fullsized":"2023-10-16T08:51:23.655534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:35:06.100984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.928445+0000","last_change":"2023-10-16T08:51:19.489820+0000","last_active":"2023-10-16T08:51:23.928445+0000","last_peered":"2023-10-16T08:51:23.928445+0000","last_clean":"2023-10-16T08:51:23.928445+0000","last_became_active":"2023-10-16T08:51:19.489507+0000","last_became_peered":"2023-10-16T08:51:19.489507+0000","last_unstale":"2023-10-16T08:51:23.928445+0000","last_undegraded":"2023-10-16T08:51:23.928445+0000","last_fullsized":"2023-10-16T08:51:23.928445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:41:08.297922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.655383+0000","last_change":"2023-10-16T08:51:19.500564+0000","last_active":"2023-10-16T08:51:23.655383+0000","last_peered":"2023-10-16T08:51:23.655383+0000","last_clean":"2023-10-16T08:51:23.655383+0000","last_became_active":"2023-10-16T08:51:19.500259+0000","last_became_peered":"2023-10-16T08:51:19.500259+0000","last_unstale":"2023-10-16T08:51:23.655383+0000","last_undegraded":"2023-10-16T08:51:23.655383+0000","last_fullsized":"2023-10-16T08:51:23.655383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:57:28.317285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.662732+0000","last_change":"2023-10-16T08:51:19.475776+0000","last_active":"2023-10-16T08:51:23.662732+0000","last_peered":"2023-10-16T08:51:23.662732+0000","last_clean":"2023-10-16T08:51:23.662732+0000","last_became_active":"2023-10-16T08:51:19.475490+0000","last_became_peered":"2023-10-16T08:51:19.475490+0000","last_unstale":"2023-10-16T08:51:23.662732+0000","last_undegraded":"2023-10-16T08:51:23.662732+0000","last_fullsized":"2023-10-16T08:51:23.662732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:31:26.695048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.681106+0000","last_change":"2023-10-16T08:51:19.478163+0000","last_active":"2023-10-16T08:51:23.681106+0000","last_peered":"2023-10-16T08:51:23.681106+0000","last_clean":"2023-10-16T08:51:23.681106+0000","last_became_active":"2023-10-16T08:51:19.477845+0000","last_became_peered":"2023-10-16T08:51:19.477845+0000","last_unstale":"2023-10-16T08:51:23.681106+0000","last_undegraded":"2023-10-16T08:51:23.681106+0000","last_fullsized":"2023-10-16T08:51:23.681106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:43:11.984655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T08:51:23.933468+0000","last_change":"2023-10-16T08:51:19.484764+0000","last_active":"2023-10-16T08:51:23.933468+0000","last_peered":"2023-10-16T08:51:23.933468+0000","last_clean":"2023-10-16T08:51:23.933468+0000","last_became_active":"2023-10-16T08:51:19.480771+0000","last_became_peered":"2023-10-16T08:51:19.480771+0000","last_unstale":"2023-10-16T08:51:23.933468+0000","last_undegraded":"2023-10-16T08:51:23.933468+0000","last_fullsized":"2023-10-16T08:51:23.933468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:18.420947+0000","last_clean_scrub_stamp":"2023-10-16T08:51:18.420947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:34.680318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":697914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":107090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":282624,"data_stored":110805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8119999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":106964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.569}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":278528,"data_stored":107124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":876544,"data_stored":697970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T08:51:54.209 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T08:51:54.209 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T08:51:54.210 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T08:51:54.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T08:51:54.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.450+0000 7f3c55652640 1 Processor -- start 2023-10-16T08:51:54.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.451+0000 7f3c55652640 1 -- start start 2023-10-16T08:51:54.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.452+0000 7f3c55652640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 0x7f3c500701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.452+0000 7f3c55652640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c500707f0 con 0x7f3c500b0010 2023-10-16T08:51:54.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.452+0000 7f3c55652640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c50070ad0 con 0x7f3c5015f040 2023-10-16T08:51:54.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.452+0000 7f3c55652640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5015b1d0 con 0x7f3c5015ad00 2023-10-16T08:51:54.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.452+0000 7f3c4effd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3c500b0010 0x7f3c500b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:51016/0 (socket says 172.21.15.94:51016) 2023-10-16T08:51:54.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.452+0000 7f3c4effd640 1 -- 172.21.15.94:0/3949261799 learned_addr learned my addr 172.21.15.94:0/3949261799 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:54.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 0x7f3c500701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543955367 0 0) 0x7f3c500707f0 con 0x7f3c500b0010 2023-10-16T08:51:54.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c30003520 con 0x7f3c500b0010 2023-10-16T08:51:54.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 732382278 0 0) 0x7f3c30003520 con 0x7f3c500b0010 2023-10-16T08:51:54.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 msgr2=0x7f3c500701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:54.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 0x7f3c500701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 >> v1:172.21.15.130:6789/0 conn(0x7f3c5015f040 legacy=0x7f3c5015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5015b4b0 con 0x7f3c500b0010 2023-10-16T08:51:54.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f3c40001670 con 0x7f3c500b0010 2023-10-16T08:51:54.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 >> v1:172.21.15.94:6789/0 conn(0x7f3c500b0010 legacy=0x7f3c500b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c30003a10 0x7f3c30003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 0x7f3c30005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5015b1d0 con 0x7f3c300047c0 2023-10-16T08:51:54.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3000bb40 con 0x7f3c30003a10 2023-10-16T08:51:54.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.453+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3000bd00 con 0x7f3c5015ad00 2023-10-16T08:51:54.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4effd640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c30003a10 0x7f3c30003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4f7fe640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 0x7f3c30005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 msgr2=0x7f3c30005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:54.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c5015ad00 0x7f3c30005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c30003a10 msgr2=0x7f3c30003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:54.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c30003a10 0x7f3c30003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.454+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/3949261799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30003520 con 0x7f3c300047c0 2023-10-16T08:51:54.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.455+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c38007330 tx=0x7f3c300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcb0b6eaf8bdbb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:54.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.455+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3802cca0 con 0x7f3c300047c0 2023-10-16T08:51:54.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.455+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3802ce00 con 0x7f3c300047c0 2023-10-16T08:51:54.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.455+0000 7f3c4dffb640 1 -- 172.21.15.94:0/3949261799 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38034660 con 0x7f3c300047c0 2023-10-16T08:51:54.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c55652640 1 -- 172.21.15.94:0/3949261799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c300047c0 msgr2=0x7f3c30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c55652640 1 --2- 172.21.15.94:0/3949261799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c300047c0 0x7f3c30004c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c38007330 tx=0x7f3c300057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c4f7fe640 1 -- 172.21.15.94:0/3949261799 reap_dead start 2023-10-16T08:51:54.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c55652640 1 -- 172.21.15.94:0/3949261799 shutdown_connections 2023-10-16T08:51:54.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c55652640 1 -- 172.21.15.94:0/3949261799 >> 172.21.15.94:0/3949261799 conn(0x7f3c5006c1c0 msgr2=0x7f3c5006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:54.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c55652640 1 -- 172.21.15.94:0/3949261799 shutdown_connections 2023-10-16T08:51:54.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.456+0000 7f3c55652640 1 -- 172.21.15.94:0/3949261799 wait complete. 2023-10-16T08:51:54.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.458+0000 7f3c55652640 1 Processor -- start 2023-10-16T08:51:54.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.458+0000 7f3c55652640 1 -- start start 2023-10-16T08:51:54.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c55652640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c300047c0 0x7f3c501f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c55652640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 0x7f3c500c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c55652640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c500c78d0 0x7f3c50154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c55652640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5015eaa0 con 0x7f3c5015e620 2023-10-16T08:51:54.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c55652640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501f0930 con 0x7f3c300047c0 2023-10-16T08:51:54.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c55652640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501f0c10 con 0x7f3c500c78d0 2023-10-16T08:51:54.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 0x7f3c500c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 0x7f3c500c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:57252/0 (socket says 172.21.15.94:57252) 2023-10-16T08:51:54.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/93437587 learned_addr learned my addr 172.21.15.94:0/93437587 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:54.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/93437587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c500c78d0 msgr2=0x7f3c50154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c500c78d0 0x7f3c50154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/93437587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c300047c0 msgr2=0x7f3c501f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c300047c0 0x7f3c501f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.459+0000 7f3c4e7fc640 1 -- 172.21.15.94:0/93437587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c501f0ef0 con 0x7f3c5015e620 2023-10-16T08:51:54.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.460+0000 7f3c4e7fc640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 0x7f3c500c7390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3c38037040 tx=0x7f3c38004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:54.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.460+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38003990 con 0x7f3c5015e620 2023-10-16T08:51:54.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.460+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c38003af0 con 0x7f3c5015e620 2023-10-16T08:51:54.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.460+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38003ea0 con 0x7f3c5015e620 2023-10-16T08:51:54.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.460+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c501f11d0 con 0x7f3c5015e620 2023-10-16T08:51:54.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.460+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c500c7010 con 0x7f3c5015e620 2023-10-16T08:51:54.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.461+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c50073ef0 con 0x7f3c5015e620 2023-10-16T08:51:54.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.462+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c38004000 con 0x7f3c5015e620 2023-10-16T08:51:54.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.463+0000 7f3c477fe640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3c3406aea0 0x7f3c3406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.463+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c380ac110 con 0x7f3c5015e620 2023-10-16T08:51:54.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.463+0000 7f3c4effd640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3c3406aea0 0x7f3c3406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.464+0000 7f3c4effd640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3c3406aea0 0x7f3c3406d360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c5015dc50 tx=0x7f3c40001010 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:54.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.467+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c38076e30 con 0x7f3c5015e620 2023-10-16T08:51:54.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.696+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3c5006c7f0 con 0x7f3c5015e620 2023-10-16T08:51:54.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.697+0000 7f3c477fe640 1 -- 172.21.15.94:0/93437587 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3c3807a450 con 0x7f3c5015e620 2023-10-16T08:51:54.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:54.699 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T08:51:54.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.699+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3c3406aea0 msgr2=0x7f3c3406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.699+0000 7f3c55652640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3c3406aea0 0x7f3c3406d360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c5015dc50 tx=0x7f3c40001010 comp rx=0 tx=0).stop 2023-10-16T08:51:54.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.699+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 msgr2=0x7f3c500c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.699+0000 7f3c55652640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 0x7f3c500c7390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3c38037040 tx=0x7f3c38004ab0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 shutdown_connections 2023-10-16T08:51:54.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c500c78d0 0x7f3c50154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3c5015e620 0x7f3c500c7390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3c3406aea0 0x7f3c3406d360 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 --2- 172.21.15.94:0/93437587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c300047c0 0x7f3c501f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 >> 172.21.15.94:0/93437587 conn(0x7f3c5006c1c0 msgr2=0x7f3c50072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:54.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 shutdown_connections 2023-10-16T08:51:54.704 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.700+0000 7f3c55652640 1 -- 172.21.15.94:0/93437587 wait complete. 2023-10-16T08:51:54.719 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T08:51:54.720 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:54.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.923+0000 7ff95e9f0640 1 Processor -- start 2023-10-16T08:51:54.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.923+0000 7ff95e9f0640 1 -- start start 2023-10-16T08:51:54.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e9f0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff95815a8d0 0x7ff9580cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e9f0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9580ca660 0x7ff9580cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e9f0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95815acb0 con 0x7ff95806ff40 2023-10-16T08:51:54.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e9f0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580c1c60 con 0x7ff95815a8d0 2023-10-16T08:51:54.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e9f0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95815e350 con 0x7ff9580ca660 2023-10-16T08:51:54.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95d9ee640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff95815a8d0 0x7ff9580cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e1ef640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff95806ff40 0x7ff95806bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48196/0 (socket says 172.21.15.94:48196) 2023-10-16T08:51:54.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.925+0000 7ff95e1ef640 1 -- 172.21.15.94:0/263187564 learned_addr learned my addr 172.21.15.94:0/263187564 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:54.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.926+0000 7ff95d1ed640 1 --2- 172.21.15.94:0/263187564 >> v2:172.21.15.130:3300/0 conn(0x7ff9580ca660 0x7ff9580cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.926+0000 7ff95d9ee640 1 -- 172.21.15.94:0/263187564 >> v2:172.21.15.130:3300/0 conn(0x7ff9580ca660 msgr2=0x7ff9580cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:54.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.926+0000 7ff95d9ee640 1 --2- 172.21.15.94:0/263187564 >> v2:172.21.15.130:3300/0 conn(0x7ff9580ca660 0x7ff9580cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.926+0000 7ff95d9ee640 1 -- 172.21.15.94:0/263187564 >> v1:172.21.15.94:6789/0 conn(0x7ff95806ff40 legacy=0x7ff95806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.926+0000 7ff95d9ee640 1 -- 172.21.15.94:0/263187564 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95815e630 con 0x7ff95815a8d0 2023-10-16T08:51:54.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.926+0000 7ff95d1ed640 1 --2- 172.21.15.94:0/263187564 >> v2:172.21.15.130:3300/0 conn(0x7ff9580ca660 0x7ff9580cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:54.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.927+0000 7ff95d9ee640 1 --2- 172.21.15.94:0/263187564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff95815a8d0 0x7ff9580cab40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9580b0aa0 tx=0x7ff95402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b1d99d29c5fc46 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:54.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.927+0000 7ff95c9ec640 1 -- 172.21.15.94:0/263187564 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954031830 con 0x7ff95815a8d0 2023-10-16T08:51:54.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.927+0000 7ff95c9ec640 1 -- 172.21.15.94:0/263187564 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954031990 con 0x7ff95815a8d0 2023-10-16T08:51:54.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.927+0000 7ff95c9ec640 1 -- 172.21.15.94:0/263187564 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954031d20 con 0x7ff95815a8d0 2023-10-16T08:51:54.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 -- 172.21.15.94:0/263187564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff95815a8d0 msgr2=0x7ff9580cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/263187564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff95815a8d0 0x7ff9580cab40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9580b0aa0 tx=0x7ff95402b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 -- 172.21.15.94:0/263187564 shutdown_connections 2023-10-16T08:51:54.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/263187564 >> v2:172.21.15.130:3300/0 conn(0x7ff9580ca660 0x7ff9580cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/263187564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff95815a8d0 0x7ff9580cab40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 -- 172.21.15.94:0/263187564 >> 172.21.15.94:0/263187564 conn(0x7ff95806a470 msgr2=0x7ff9580afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:54.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 -- 172.21.15.94:0/263187564 shutdown_connections 2023-10-16T08:51:54.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.928+0000 7ff95e9f0640 1 -- 172.21.15.94:0/263187564 wait complete. 2023-10-16T08:51:54.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.930+0000 7ff95e9f0640 1 Processor -- start 2023-10-16T08:51:54.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.930+0000 7ff95e9f0640 1 -- start start 2023-10-16T08:51:54.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95e9f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff95806ff40 0x7ff9580c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95e9f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 0x7ff95815d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95e9f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff95815a8d0 0x7ff958158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95e9f0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580c11a0 con 0x7ff9580ca660 2023-10-16T08:51:54.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95e9f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95815dd80 con 0x7ff95815a8d0 2023-10-16T08:51:54.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95e9f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580c7e90 con 0x7ff95806ff40 2023-10-16T08:51:54.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95d1ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 0x7ff95815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95d1ed640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 0x7ff95815d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51956/0 (socket says 172.21.15.94:51956) 2023-10-16T08:51:54.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.931+0000 7ff95d1ed640 1 -- 172.21.15.94:0/605978831 learned_addr learned my addr 172.21.15.94:0/605978831 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:54.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95e1ef640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff95815a8d0 0x7ff958158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d9ee640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff95806ff40 0x7ff9580c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d1ed640 1 -- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff95806ff40 msgr2=0x7ff9580c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d1ed640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff95806ff40 0x7ff9580c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d1ed640 1 -- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff95815a8d0 msgr2=0x7ff958158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:54.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d1ed640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff95815a8d0 0x7ff958158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:54.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d1ed640 1 -- 172.21.15.94:0/605978831 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540093a0 con 0x7ff9580ca660 2023-10-16T08:51:54.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95e1ef640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff95815a8d0 0x7ff958158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:54.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95d1ed640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 0x7ff95815d840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c7f0 tx=0x7ff94800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:54.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800cea0 con 0x7ff9580ca660 2023-10-16T08:51:54.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948004230 con 0x7ff9580ca660 2023-10-16T08:51:54.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9580c8170 con 0x7ff9580ca660 2023-10-16T08:51:54.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.932+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948007830 con 0x7ff9580ca660 2023-10-16T08:51:54.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.933+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9580cd6f0 con 0x7ff9580ca660 2023-10-16T08:51:54.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.934+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9580c83b0 con 0x7ff9580ca660 2023-10-16T08:51:54.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.935+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff948007990 con 0x7ff9580ca660 2023-10-16T08:51:54.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.936+0000 7ff94e7fc640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff93c06ae70 0x7ff93c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:54.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.936+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff948089800 con 0x7ff9580ca660 2023-10-16T08:51:54.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.936+0000 7ff95d9ee640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff93c06ae70 0x7ff93c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:54.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.937+0000 7ff95d9ee640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff93c06ae70 0x7ff93c06d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff954036000 tx=0x7ff95403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:54.944 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:54.941+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff948054650 con 0x7ff9580ca660 2023-10-16T08:51:55.133 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.131+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff95804e9b0 con 0x7ff9580ca660 2023-10-16T08:51:55.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.133+0000 7ff94e7fc640 1 -- 172.21.15.94:0/605978831 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff948087e60 con 0x7ff9580ca660 2023-10-16T08:51:55.136 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:55.136 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:55.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.135+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff93c06ae70 msgr2=0x7ff93c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.135+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff93c06ae70 0x7ff93c06d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff954036000 tx=0x7ff95403c040 comp rx=0 tx=0).stop 2023-10-16T08:51:55.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 msgr2=0x7ff95815d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 0x7ff95815d840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c7f0 tx=0x7ff94800ccb0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 shutdown_connections 2023-10-16T08:51:55.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff93c06ae70 0x7ff93c06d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff95815a8d0 0x7ff958158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9580ca660 0x7ff95815d840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 --2- 172.21.15.94:0/605978831 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff95806ff40 0x7ff9580c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 >> 172.21.15.94:0/605978831 conn(0x7ff95806a470 msgr2=0x7ff9580ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 shutdown_connections 2023-10-16T08:51:55.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.136+0000 7ff95e9f0640 1 -- 172.21.15.94:0/605978831 wait complete. 2023-10-16T08:51:55.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:51:55.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:51:55.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.359+0000 7f5424002640 1 Processor -- start 2023-10-16T08:51:55.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.359+0000 7f5424002640 1 -- start start 2023-10-16T08:51:55.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5424002640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5424002640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f541c0ca110 0x7f541c0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5424002640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f541c15d3f0 0x7f541c15d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5424002640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c0caab0 con 0x7f541c0ca110 2023-10-16T08:51:55.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5424002640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c072480 con 0x7f541c15d3f0 2023-10-16T08:51:55.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5424002640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0cd0c0 con 0x7f541c159890 2023-10-16T08:51:55.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f542159d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f541c0ca110 0x7f541c0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f542159d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f541c0ca110 0x7f541c0ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51966/0 (socket says 172.21.15.94:51966) 2023-10-16T08:51:55.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f542159d640 1 -- 172.21.15.94:0/969366671 learned_addr learned my addr 172.21.15.94:0/969366671 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:55.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f5421d9e640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f542259f640 1 --2- 172.21.15.94:0/969366671 >> v2:172.21.15.130:3300/0 conn(0x7f541c15d3f0 0x7f541c15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f542159d640 1 -- 172.21.15.94:0/969366671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 msgr2=0x7f541c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:55.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.361+0000 7f542159d640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.362+0000 7f542159d640 1 -- 172.21.15.94:0/969366671 >> v2:172.21.15.130:3300/0 conn(0x7f541c15d3f0 msgr2=0x7f541c15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:55.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.362+0000 7f542159d640 1 --2- 172.21.15.94:0/969366671 >> v2:172.21.15.130:3300/0 conn(0x7f541c15d3f0 0x7f541c15d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.362+0000 7f542159d640 1 -- 172.21.15.94:0/969366671 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0cc540 con 0x7f541c0ca110 2023-10-16T08:51:55.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.362+0000 7f5421d9e640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:55.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.362+0000 7f542259f640 1 --2- 172.21.15.94:0/969366671 >> v2:172.21.15.130:3300/0 conn(0x7f541c15d3f0 0x7f541c15d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:55.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.363+0000 7f542159d640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0ca570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f541c0cd9d0 tx=0x7f540c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d69b7f699b3f8d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:55.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.363+0000 7f5420d9c640 1 -- 172.21.15.94:0/969366671 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c031870 con 0x7f541c0ca110 2023-10-16T08:51:55.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.363+0000 7f5420d9c640 1 -- 172.21.15.94:0/969366671 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c0319d0 con 0x7f541c0ca110 2023-10-16T08:51:55.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.363+0000 7f5420d9c640 1 -- 172.21.15.94:0/969366671 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c031d60 con 0x7f541c0ca110 2023-10-16T08:51:55.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 -- 172.21.15.94:0/969366671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 msgr2=0x7f541c0ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0ca570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f541c0cd9d0 tx=0x7f540c02b910 comp rx=0 tx=0).stop 2023-10-16T08:51:55.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 -- 172.21.15.94:0/969366671 shutdown_connections 2023-10-16T08:51:55.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 --2- 172.21.15.94:0/969366671 >> v2:172.21.15.130:3300/0 conn(0x7f541c15d3f0 0x7f541c15d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0ca570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 --2- 172.21.15.94:0/969366671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 -- 172.21.15.94:0/969366671 >> 172.21.15.94:0/969366671 conn(0x7f541c0b0030 msgr2=0x7f541c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:55.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 -- 172.21.15.94:0/969366671 shutdown_connections 2023-10-16T08:51:55.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.364+0000 7f5424002640 1 -- 172.21.15.94:0/969366671 wait complete. 2023-10-16T08:51:55.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.366+0000 7f5424002640 1 Processor -- start 2023-10-16T08:51:55.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.366+0000 7f5424002640 1 -- start start 2023-10-16T08:51:55.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5424002640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5424002640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c0c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5424002640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f541c15d3f0 0x7f541c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5424002640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0c4b60 con 0x7f541c0ca110 2023-10-16T08:51:55.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5424002640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0c4e00 con 0x7f541c15d3f0 2023-10-16T08:51:55.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5424002640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0c20d0 con 0x7f541c159890 2023-10-16T08:51:55.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51970/0 (socket says 172.21.15.94:51970) 2023-10-16T08:51:55.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 -- 172.21.15.94:0/2121832315 learned_addr learned my addr 172.21.15.94:0/2121832315 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:55.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 -- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 msgr2=0x7f541c0c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f542159d640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c0c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f542259f640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f541c15d3f0 0x7f541c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c0c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 -- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f541c15d3f0 msgr2=0x7f541c1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.367+0000 7f5421d9e640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f541c15d3f0 0x7f541c1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f5421d9e640 1 -- 172.21.15.94:0/2121832315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0094d0 con 0x7f541c0ca110 2023-10-16T08:51:55.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f542259f640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f541c15d3f0 0x7f541c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:55.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f5421d9e640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0c4620 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f541800ce00 tx=0x7f541800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:55.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800f890 con 0x7f541c0ca110 2023-10-16T08:51:55.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800f9f0 con 0x7f541c0ca110 2023-10-16T08:51:55.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800fdc0 con 0x7f541c0ca110 2023-10-16T08:51:55.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c0c23b0 con 0x7f541c0ca110 2023-10-16T08:51:55.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.368+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c0c2970 con 0x7f541c0ca110 2023-10-16T08:51:55.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.369+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c073ef0 con 0x7f541c0ca110 2023-10-16T08:51:55.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.370+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f541800b040 con 0x7f541c0ca110 2023-10-16T08:51:55.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.371+0000 7f54127fc640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f540006ae70 0x7f540006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.371+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f541808a290 con 0x7f541c0ca110 2023-10-16T08:51:55.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.371+0000 7f542159d640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f540006ae70 0x7f540006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.372+0000 7f542159d640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f540006ae70 0x7f540006d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f540c036000 tx=0x7f540c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:55.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.375+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5418055050 con 0x7f541c0ca110 2023-10-16T08:51:55.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.566+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f541c0ca7c0 con 0x7f541c0ca110 2023-10-16T08:51:55.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.567+0000 7f54127fc640 1 -- 172.21.15.94:0/2121832315 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f541801d020 con 0x7f541c0ca110 2023-10-16T08:51:55.569 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:51:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f540006ae70 msgr2=0x7f540006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f540006ae70 0x7f540006d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f540c036000 tx=0x7f540c03c040 comp rx=0 tx=0).stop 2023-10-16T08:51:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 msgr2=0x7f541c0c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0c4620 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f541800ce00 tx=0x7f541800a650 comp rx=0 tx=0).stop 2023-10-16T08:51:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 shutdown_connections 2023-10-16T08:51:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f540006ae70 0x7f540006d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f541c15d3f0 0x7f541c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f541c159890 0x7f541c0c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 --2- 172.21.15.94:0/2121832315 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f541c0ca110 0x7f541c0c4620 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.569+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 >> 172.21.15.94:0/2121832315 conn(0x7f541c0b0030 msgr2=0x7f541c158950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:55.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.570+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 shutdown_connections 2023-10-16T08:51:55.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.570+0000 7f5424002640 1 -- 172.21.15.94:0/2121832315 wait complete. 2023-10-16T08:51:55.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:51:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.802+0000 7f79e2c5d640 1 Processor -- start 2023-10-16T08:51:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.802+0000 7f79e2c5d640 1 -- start start 2023-10-16T08:51:55.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.803+0000 7f79e2c5d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f79dc0c9260 0x7f79dc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.803+0000 7f79e2c5d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0cdbb0 0x7f79dc0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.803+0000 7f79e2c5d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc0cb180 con 0x7f79dc15c580 2023-10-16T08:51:55.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.803+0000 7f79e2c5d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc0cac40 con 0x7f79dc0c9260 2023-10-16T08:51:55.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.803+0000 7f79e2c5d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0cf440 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79e09f9640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f79dc15c580 0x7f79dc0c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48206/0 (socket says 172.21.15.94:48206) 2023-10-16T08:51:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79e09f9640 1 -- 172.21.15.94:0/1644713767 learned_addr learned my addr 172.21.15.94:0/1644713767 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:55.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79dbfff640 1 --2- 172.21.15.94:0/1644713767 >> v2:172.21.15.94:3300/0 conn(0x7f79dc0c9260 0x7f79dc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79e11fa640 1 --2- 172.21.15.94:0/1644713767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0cdbb0 0x7f79dc0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79dbfff640 1 -- 172.21.15.94:0/1644713767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0cdbb0 msgr2=0x7f79dc0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79dbfff640 1 --2- 172.21.15.94:0/1644713767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0cdbb0 0x7f79dc0cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79dbfff640 1 -- 172.21.15.94:0/1644713767 >> v1:172.21.15.94:6789/0 conn(0x7f79dc15c580 legacy=0x7f79dc0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79dbfff640 1 -- 172.21.15.94:0/1644713767 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0ceec0 con 0x7f79dc0c9260 2023-10-16T08:51:55.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.804+0000 7f79db7fe640 1 -- 172.21.15.94:0/1644713767 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198902721 0 0) 0x7f79dc0cb180 con 0x7f79dc15c580 2023-10-16T08:51:55.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.806+0000 7f79dbfff640 1 --2- 172.21.15.94:0/1644713767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0c9260 0x7f79dc0cd5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79c80097a0 tx=0x7f79c802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7193e6f603f261db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:55.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.806+0000 7f79db7fe640 1 -- 172.21.15.94:0/1644713767 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8031780 con 0x7f79dc0c9260 2023-10-16T08:51:55.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.806+0000 7f79db7fe640 1 -- 172.21.15.94:0/1644713767 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c80318e0 con 0x7f79dc0c9260 2023-10-16T08:51:55.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.806+0000 7f79db7fe640 1 -- 172.21.15.94:0/1644713767 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8031c70 con 0x7f79dc0c9260 2023-10-16T08:51:55.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.806+0000 7f79e2c5d640 1 -- 172.21.15.94:0/1644713767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0c9260 msgr2=0x7f79dc0cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.806+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/1644713767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0c9260 0x7f79dc0cd5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79c80097a0 tx=0x7f79c802b820 comp rx=0 tx=0).stop 2023-10-16T08:51:55.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.807+0000 7f79e2c5d640 1 -- 172.21.15.94:0/1644713767 shutdown_connections 2023-10-16T08:51:55.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.807+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/1644713767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0cdbb0 0x7f79dc0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.807+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/1644713767 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0c9260 0x7f79dc0cd5f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.807+0000 7f79e2c5d640 1 -- 172.21.15.94:0/1644713767 >> 172.21.15.94:0/1644713767 conn(0x7f79dc0b0030 msgr2=0x7f79dc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:55.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.807+0000 7f79e2c5d640 1 -- 172.21.15.94:0/1644713767 shutdown_connections 2023-10-16T08:51:55.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.807+0000 7f79e2c5d640 1 -- 172.21.15.94:0/1644713767 wait complete. 2023-10-16T08:51:55.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.808+0000 7f79e2c5d640 1 Processor -- start 2023-10-16T08:51:55.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.808+0000 7f79e2c5d640 1 -- start start 2023-10-16T08:51:55.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.809+0000 7f79e2c5d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0c9260 0x7f79dc148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.809+0000 7f79e2c5d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 0x7f79dc152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.809+0000 7f79e2c5d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79dc15c580 0x7f79dc1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.809+0000 7f79e2c5d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc150930 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.809+0000 7f79e2c5d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc150c10 con 0x7f79dc15c580 2023-10-16T08:51:55.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.809+0000 7f79e2c5d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc150ef0 con 0x7f79dc0c9260 2023-10-16T08:51:55.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 0x7f79dc152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 0x7f79dc152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51978/0 (socket says 172.21.15.94:51978) 2023-10-16T08:51:55.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 -- 172.21.15.94:0/642118830 learned_addr learned my addr 172.21.15.94:0/642118830 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:55.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79e09f9640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0c9260 0x7f79dc148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79e11fa640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79dc15c580 0x7f79dc1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 -- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0c9260 msgr2=0x7f79dc148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0c9260 0x7f79dc148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 -- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79dc15c580 msgr2=0x7f79dc1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:55.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79dc15c580 0x7f79dc1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:55.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 -- 172.21.15.94:0/642118830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009400 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.810+0000 7f79dbfff640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 0x7f79dc152180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79c8034040 tx=0x7f79c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:55.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.811+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8032960 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.811+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c8032ac0 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.811+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8032e70 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.811+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc1511d0 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.811+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc148590 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.812+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc1516f0 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.813+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79c8045400 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.814+0000 7f79d97fa640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f79c006ae70 0x7f79c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.814+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79c80abe50 con 0x7f79dc0cdbb0 2023-10-16T08:51:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.814+0000 7f79e09f9640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f79c006ae70 0x7f79c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:55.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.815+0000 7f79e09f9640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f79c006ae70 0x7f79c006d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f79d0000f60 tx=0x7f79d0007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:55.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:55.818+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79dc1516f0 con 0x7f79dc0cdbb0 2023-10-16T08:51:56.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.013+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79dc1516f0 con 0x7f79dc0cdbb0 2023-10-16T08:51:56.015 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.014+0000 7f79d97fa640 1 -- 172.21.15.94:0/642118830 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79dc1516f0 con 0x7f79dc0cdbb0 2023-10-16T08:51:56.017 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:56.018 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f79c006ae70 msgr2=0x7f79c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f79c006ae70 0x7f79c006d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f79d0000f60 tx=0x7f79d0007c00 comp rx=0 tx=0).stop 2023-10-16T08:51:56.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 msgr2=0x7f79dc152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 0x7f79dc152180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79c8034040 tx=0x7f79c80046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 shutdown_connections 2023-10-16T08:51:56.019 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f79c006ae70 0x7f79c006d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79dc15c580 0x7f79dc1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79dc0cdbb0 0x7f79dc152180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 --2- 172.21.15.94:0/642118830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f79dc0c9260 0x7f79dc148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 >> 172.21.15.94:0/642118830 conn(0x7f79dc0b0030 msgr2=0x7f79dc0ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:56.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.016+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 shutdown_connections 2023-10-16T08:51:56.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.017+0000 7f79e2c5d640 1 -- 172.21.15.94:0/642118830 wait complete. 2023-10-16T08:51:56.037 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:51:56.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.249+0000 7f63ca290640 1 Processor -- start 2023-10-16T08:51:56.252 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.249+0000 7f63ca290640 1 -- start start 2023-10-16T08:51:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.251+0000 7f63ca290640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.251+0000 7f63ca290640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f63c406d230 0x7f63c406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.251+0000 7f63ca290640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63c40ce920 0x7f63c40ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.251+0000 7f63ca290640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c406df90 con 0x7f63c40ce920 2023-10-16T08:51:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.251+0000 7f63ca290640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c40cf2d0 con 0x7f63c406d230 2023-10-16T08:51:56.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.251+0000 7f63ca290640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40cdac0 con 0x7f63c415c8e0 2023-10-16T08:51:56.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63c40ce920 0x7f63c40ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63c40ce920 0x7f63c40ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51986/0 (socket says 172.21.15.94:51986) 2023-10-16T08:51:56.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 -- 172.21.15.94:0/515014291 learned_addr learned my addr 172.21.15.94:0/515014291 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:56.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c8a8d640 1 --2- 172.21.15.94:0/515014291 >> v2:172.21.15.130:3300/0 conn(0x7f63c406d230 0x7f63c406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c928e640 1 --2- 172.21.15.94:0/515014291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 -- 172.21.15.94:0/515014291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 msgr2=0x7f63c40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 --2- 172.21.15.94:0/515014291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.257 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 -- 172.21.15.94:0/515014291 >> v2:172.21.15.130:3300/0 conn(0x7f63c406d230 msgr2=0x7f63c406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 --2- 172.21.15.94:0/515014291 >> v2:172.21.15.130:3300/0 conn(0x7f63c406d230 0x7f63c406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.252+0000 7f63c9a8f640 1 -- 172.21.15.94:0/515014291 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40cd1f0 con 0x7f63c40ce920 2023-10-16T08:51:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.253+0000 7f63c9a8f640 1 --2- 172.21.15.94:0/515014291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c40ced90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f63c40b1080 tx=0x7f63bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe4f2b9c0657543 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.253+0000 7f63bbfff640 1 -- 172.21.15.94:0/515014291 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc031870 con 0x7f63c40ce920 2023-10-16T08:51:56.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63bbfff640 1 -- 172.21.15.94:0/515014291 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc0319d0 con 0x7f63c40ce920 2023-10-16T08:51:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63bbfff640 1 -- 172.21.15.94:0/515014291 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc031d60 con 0x7f63c40ce920 2023-10-16T08:51:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 -- 172.21.15.94:0/515014291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 msgr2=0x7f63c40ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 --2- 172.21.15.94:0/515014291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c40ced90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f63c40b1080 tx=0x7f63bc02b910 comp rx=0 tx=0).stop 2023-10-16T08:51:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 -- 172.21.15.94:0/515014291 shutdown_connections 2023-10-16T08:51:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 --2- 172.21.15.94:0/515014291 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c40ced90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 --2- 172.21.15.94:0/515014291 >> v2:172.21.15.130:3300/0 conn(0x7f63c406d230 0x7f63c406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 --2- 172.21.15.94:0/515014291 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 -- 172.21.15.94:0/515014291 >> 172.21.15.94:0/515014291 conn(0x7f63c406a200 msgr2=0x7f63c406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:56.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.254+0000 7f63ca290640 1 -- 172.21.15.94:0/515014291 shutdown_connections 2023-10-16T08:51:56.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.255+0000 7f63ca290640 1 -- 172.21.15.94:0/515014291 wait complete. 2023-10-16T08:51:56.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.256+0000 7f63ca290640 1 Processor -- start 2023-10-16T08:51:56.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.256+0000 7f63ca290640 1 -- start start 2023-10-16T08:51:56.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.257+0000 7f63ca290640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63c406d230 0x7f63c40b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.257+0000 7f63ca290640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.257+0000 7f63ca290640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.257+0000 7f63ca290640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415afb0 con 0x7f63c40ce920 2023-10-16T08:51:56.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.257+0000 7f63ca290640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40b1c50 con 0x7f63c406d230 2023-10-16T08:51:56.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.257+0000 7f63ca290640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40b1f30 con 0x7f63c415c8e0 2023-10-16T08:51:56.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c415a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52000/0 (socket says 172.21.15.94:52000) 2023-10-16T08:51:56.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 -- 172.21.15.94:0/3763399961 learned_addr learned my addr 172.21.15.94:0/3763399961 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:56.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c9a8f640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c928e640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63c406d230 0x7f63c40b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 -- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 msgr2=0x7f63c415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 -- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63c406d230 msgr2=0x7f63c40b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63c406d230 0x7f63c40b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 -- 172.21.15.94:0/3763399961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0094d0 con 0x7f63c40ce920 2023-10-16T08:51:56.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c928e640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63c406d230 0x7f63c40b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:56.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c9a8f640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:56.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63c8a8d640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c415a2b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63c0007ef0 tx=0x7f63c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:56.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.258+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0014620 con 0x7f63c40ce920 2023-10-16T08:51:56.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.259+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0014780 con 0x7f63c40ce920 2023-10-16T08:51:56.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.259+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c40b2210 con 0x7f63c40ce920 2023-10-16T08:51:56.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.259+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0014b30 con 0x7f63c40ce920 2023-10-16T08:51:56.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.259+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c40b27d0 con 0x7f63c40ce920 2023-10-16T08:51:56.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.260+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c404e9b0 con 0x7f63c40ce920 2023-10-16T08:51:56.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.261+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63c0014c90 con 0x7f63c40ce920 2023-10-16T08:51:56.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.262+0000 7f63b9ffb640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63b006ae70 0x7f63b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.262+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63c008a300 con 0x7f63c40ce920 2023-10-16T08:51:56.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.262+0000 7f63c928e640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63b006ae70 0x7f63b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.263+0000 7f63c928e640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63b006ae70 0x7f63b006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f63b4006fd0 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:56.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.266+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63c00550c0 con 0x7f63c40ce920 2023-10-16T08:51:56.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.453+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63c40aca70 con 0x7f63c40ce920 2023-10-16T08:51:56.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.454+0000 7f63b9ffb640 1 -- 172.21.15.94:0/3763399961 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63c00586e0 con 0x7f63c40ce920 2023-10-16T08:51:56.456 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:51:56.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63b006ae70 msgr2=0x7f63b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63b006ae70 0x7f63b006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f63b4006fd0 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2023-10-16T08:51:56.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 msgr2=0x7f63c415a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c415a2b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63c0007ef0 tx=0x7f63c000e4b0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 shutdown_connections 2023-10-16T08:51:56.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63c415c8e0 0x7f63c415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63c40ce920 0x7f63c415a2b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f63b006ae70 0x7f63b006d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 --2- 172.21.15.94:0/3763399961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63c406d230 0x7f63c40b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 >> 172.21.15.94:0/3763399961 conn(0x7f63c406a200 msgr2=0x7f63c40cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:56.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 shutdown_connections 2023-10-16T08:51:56.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.456+0000 7f63ca290640 1 -- 172.21.15.94:0/3763399961 wait complete. 2023-10-16T08:51:56.476 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:51:56.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.691+0000 7f0b3466b640 1 Processor -- start 2023-10-16T08:51:56.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.691+0000 7f0b3466b640 1 -- start start 2023-10-16T08:51:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.693+0000 7f0b3466b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 0x7f0b2c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.693+0000 7f0b3466b640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2c160730 con 0x7f0b2c1611f0 2023-10-16T08:51:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.693+0000 7f0b3466b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2c15dd60 con 0x7f0b2c15cbf0 2023-10-16T08:51:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.693+0000 7f0b3466b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c1609f0 con 0x7f0b2c0cb3b0 2023-10-16T08:51:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.693+0000 7f0b31c06640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0b2c1611f0 0x7f0b2c15cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48210/0 (socket says 172.21.15.94:48210) 2023-10-16T08:51:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.693+0000 7f0b31c06640 1 -- 172.21.15.94:0/2114800440 learned_addr learned my addr 172.21.15.94:0/2114800440 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:56.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b32c08640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 0x7f0b2c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922610989 0 0) 0x7f0b2c160730 con 0x7f0b2c1611f0 2023-10-16T08:51:56.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b18003520 con 0x7f0b2c1611f0 2023-10-16T08:51:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735778312 0 0) 0x7f0b18003520 con 0x7f0b2c1611f0 2023-10-16T08:51:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 msgr2=0x7f0b2c15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 0x7f0b2c15d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 >> v1:172.21.15.130:6789/0 conn(0x7f0b2c15cbf0 legacy=0x7f0b2c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c160cd0 con 0x7f0b2c1611f0 2023-10-16T08:51:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f0b1c001670 con 0x7f0b2c1611f0 2023-10-16T08:51:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 >> v1:172.21.15.94:6789/0 conn(0x7f0b2c1611f0 legacy=0x7f0b2c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 0x7f0b180039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b18003ee0 0x7f0b180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b18004d00 0x7f0b18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c1609f0 con 0x7f0b18003ee0 2023-10-16T08:51:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1800b9e0 con 0x7f0b18004d00 2023-10-16T08:51:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.694+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1800bba0 con 0x7f0b2c0cb3b0 2023-10-16T08:51:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b31c06640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b18003ee0 0x7f0b180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b32407640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 0x7f0b180039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b32c08640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b18004d00 0x7f0b18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b31c06640 1 -- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 msgr2=0x7f0b180039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:56.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b31c06640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b2c0cb3b0 0x7f0b180039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b31c06640 1 -- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b18004d00 msgr2=0x7f0b18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:56.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b31c06640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b18004d00 0x7f0b18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.702 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.695+0000 7f0b31c06640 1 -- 172.21.15.94:0/2114800440 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18003520 con 0x7f0b18003ee0 2023-10-16T08:51:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.696+0000 7f0b31c06640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b18003ee0 0x7f0b180047c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00c210 tx=0x7f0b180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8182b20250e0caf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.696+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c005ad0 con 0x7f0b18003ee0 2023-10-16T08:51:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.696+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c005c50 con 0x7f0b18003ee0 2023-10-16T08:51:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.696+0000 7f0b31405640 1 -- 172.21.15.94:0/2114800440 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c02c810 con 0x7f0b18003ee0 2023-10-16T08:51:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b3466b640 1 -- 172.21.15.94:0/2114800440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b18003ee0 msgr2=0x7f0b180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2114800440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b18003ee0 0x7f0b180047c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00c210 tx=0x7f0b180057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b32c08640 1 -- 172.21.15.94:0/2114800440 reap_dead start 2023-10-16T08:51:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b3466b640 1 -- 172.21.15.94:0/2114800440 shutdown_connections 2023-10-16T08:51:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b3466b640 1 -- 172.21.15.94:0/2114800440 >> 172.21.15.94:0/2114800440 conn(0x7f0b2c0b0030 msgr2=0x7f0b2c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:56.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b3466b640 1 -- 172.21.15.94:0/2114800440 shutdown_connections 2023-10-16T08:51:56.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.697+0000 7f0b3466b640 1 -- 172.21.15.94:0/2114800440 wait complete. 2023-10-16T08:51:56.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.699+0000 7f0b3466b640 1 Processor -- start 2023-10-16T08:51:56.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.699+0000 7f0b3466b640 1 -- start start 2023-10-16T08:51:56.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b3466b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b18003ee0 0x7f0b2c0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b3466b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b2c0af990 0x7f0b2c1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b3466b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 0x7f0b2c071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b3466b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0afe10 con 0x7f0b2c071300 2023-10-16T08:51:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b3466b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c071cc0 con 0x7f0b2c0af990 2023-10-16T08:51:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b3466b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0ae2d0 con 0x7f0b18003ee0 2023-10-16T08:51:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b32c08640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 0x7f0b2c071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b32c08640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 0x7f0b2c071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52020/0 (socket says 172.21.15.94:52020) 2023-10-16T08:51:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.700+0000 7f0b32c08640 1 -- 172.21.15.94:0/2862998134 learned_addr learned my addr 172.21.15.94:0/2862998134 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b31c06640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b2c0af990 0x7f0b2c1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32407640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b18003ee0 0x7f0b2c0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32c08640 1 -- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b18003ee0 msgr2=0x7f0b2c0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32c08640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b18003ee0 0x7f0b2c0adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32c08640 1 -- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b2c0af990 msgr2=0x7f0b2c1f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32c08640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b2c0af990 0x7f0b2c1f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32c08640 1 -- 172.21.15.94:0/2862998134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0ae5b0 con 0x7f0b2c071300 2023-10-16T08:51:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b31c06640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b2c0af990 0x7f0b2c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:56.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b32c08640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 0x7f0b2c071780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0cde60 tx=0x7f0b240115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:56.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400e070 con 0x7f0b2c071300 2023-10-16T08:51:56.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24011e10 con 0x7f0b2c071300 2023-10-16T08:51:56.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24003990 con 0x7f0b2c071300 2023-10-16T08:51:56.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c0ae890 con 0x7f0b2c071300 2023-10-16T08:51:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.701+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c1f2460 con 0x7f0b2c071300 2023-10-16T08:51:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.702+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c073ef0 con 0x7f0b2c071300 2023-10-16T08:51:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.703+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b24003af0 con 0x7f0b2c071300 2023-10-16T08:51:56.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.704+0000 7f0b22ffd640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0b1006aea0 0x7f0b1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:56.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.704+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b24089f60 con 0x7f0b2c071300 2023-10-16T08:51:56.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.705+0000 7f0b32407640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0b1006aea0 0x7f0b1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.705+0000 7f0b32407640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0b1006aea0 0x7f0b1006d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b28001720 tx=0x7f0b28007b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.709+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b24054d20 con 0x7f0b2c071300 2023-10-16T08:51:56.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.901+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0b2c0cf2d0 con 0x7f0b2c071300 2023-10-16T08:51:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.902+0000 7f0b22ffd640 1 -- 172.21.15.94:0/2862998134 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0b24058340 con 0x7f0b2c071300 2023-10-16T08:51:56.904 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:56.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0b1006aea0 msgr2=0x7f0b1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0b1006aea0 0x7f0b1006d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b28001720 tx=0x7f0b28007b70 comp rx=0 tx=0).stop 2023-10-16T08:51:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 msgr2=0x7f0b2c071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 0x7f0b2c071780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0cde60 tx=0x7f0b240115a0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 shutdown_connections 2023-10-16T08:51:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b2c071300 0x7f0b2c071780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0b1006aea0 0x7f0b1006d360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b2c0af990 0x7f0b2c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 --2- 172.21.15.94:0/2862998134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b18003ee0 0x7f0b2c0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 >> 172.21.15.94:0/2862998134 conn(0x7f0b2c0b0030 msgr2=0x7f0b2c0c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 shutdown_connections 2023-10-16T08:51:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:56.905+0000 7f0b3466b640 1 -- 172.21.15.94:0/2862998134 wait complete. 2023-10-16T08:51:56.926 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:51:57.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.134+0000 7fd8b5ee5640 1 Processor -- start 2023-10-16T08:51:57.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.134+0000 7fd8b5ee5640 1 -- start start 2023-10-16T08:51:57.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8b5ee5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 0x7fd8b00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8b5ee5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 0x7fd8b015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8b5ee5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00707f0 con 0x7fd8b015ad00 2023-10-16T08:51:57.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8b5ee5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b0070ad0 con 0x7fd8b015f040 2023-10-16T08:51:57.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8b5ee5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b015b1d0 con 0x7fd8b00b0010 2023-10-16T08:51:57.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8affff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 0x7fd8b015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.136+0000 7fd8af7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 0x7fd8b00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8af7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 0x7fd8b00701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:33488/0 (socket says 172.21.15.94:33488) 2023-10-16T08:51:57.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8affff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 0x7fd8b015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:40940/0 (socket says 172.21.15.94:40940) 2023-10-16T08:51:57.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8af7fe640 1 -- 172.21.15.94:0/2805929430 learned_addr learned my addr 172.21.15.94:0/2805929430 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:57.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8af7fe640 1 -- 172.21.15.94:0/2805929430 >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 msgr2=0x7fd8b015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:57.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8af7fe640 1 --2- 172.21.15.94:0/2805929430 >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 0x7fd8b015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8af7fe640 1 -- 172.21.15.94:0/2805929430 >> v1:172.21.15.130:6789/0 conn(0x7fd8b015ad00 legacy=0x7fd8b00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8af7fe640 1 -- 172.21.15.94:0/2805929430 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b015b4b0 con 0x7fd8b00b0010 2023-10-16T08:51:57.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.137+0000 7fd8affff640 1 --2- 172.21.15.94:0/2805929430 >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 0x7fd8b015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:51:57.142 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.139+0000 7fd8af7fe640 1 --2- 172.21.15.94:0/2805929430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 0x7fd8b00701a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009870 tx=0x7fd8a002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9d3cb7678632f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:57.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.139+0000 7fd8aeffd640 1 -- 172.21.15.94:0/2805929430 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0030840 con 0x7fd8b00b0010 2023-10-16T08:51:57.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.139+0000 7fd8aeffd640 1 -- 172.21.15.94:0/2805929430 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a00309a0 con 0x7fd8b00b0010 2023-10-16T08:51:57.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.139+0000 7fd8aeffd640 1 -- 172.21.15.94:0/2805929430 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0030d30 con 0x7fd8b00b0010 2023-10-16T08:51:57.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/2805929430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 msgr2=0x7fd8b00701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/2805929430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 0x7fd8b00701a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009870 tx=0x7fd8a002b980 comp rx=0 tx=0).stop 2023-10-16T08:51:57.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/2805929430 shutdown_connections 2023-10-16T08:51:57.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/2805929430 >> v2:172.21.15.130:3300/0 conn(0x7fd8b015f040 0x7fd8b015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/2805929430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b00b0010 0x7fd8b00701a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/2805929430 >> 172.21.15.94:0/2805929430 conn(0x7fd8b006c1c0 msgr2=0x7fd8b006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:57.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/2805929430 shutdown_connections 2023-10-16T08:51:57.145 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.140+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/2805929430 wait complete. 2023-10-16T08:51:57.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.142+0000 7fd8b5ee5640 1 Processor -- start 2023-10-16T08:51:57.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.142+0000 7fd8b5ee5640 1 -- start start 2023-10-16T08:51:57.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8b5ee5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8b00b0010 0x7fd8b01f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8b5ee5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 0x7fd8b014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8b5ee5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b015f040 0x7fd8b01f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8b5ee5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01f3e70 con 0x7fd8b015ad00 2023-10-16T08:51:57.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8b5ee5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01f4150 con 0x7fd8b00b0010 2023-10-16T08:51:57.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8b5ee5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01f4430 con 0x7fd8b015f040 2023-10-16T08:51:57.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 0x7fd8b014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 0x7fd8b014f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52034/0 (socket says 172.21.15.94:52034) 2023-10-16T08:51:57.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8a7fff640 1 -- 172.21.15.94:0/1026591672 learned_addr learned my addr 172.21.15.94:0/1026591672 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:57.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.143+0000 7fd8af7fe640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8b00b0010 0x7fd8b01f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8a7fff640 1 -- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b015f040 msgr2=0x7fd8b01f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8affff640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b015f040 0x7fd8b01f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8a7fff640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b015f040 0x7fd8b01f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8a7fff640 1 -- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8b00b0010 msgr2=0x7fd8b01f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8a7fff640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8b00b0010 0x7fd8b01f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8a7fff640 1 -- 172.21.15.94:0/1026591672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8009a70 con 0x7fd8b015ad00 2023-10-16T08:51:57.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8af7fe640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8b00b0010 0x7fd8b01f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:57.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8a7fff640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 0x7fd8b014f360 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c400 tx=0x7fd89800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:57.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980052d0 con 0x7fd8b015ad00 2023-10-16T08:51:57.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898005430 con 0x7fd8b015ad00 2023-10-16T08:51:57.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898003830 con 0x7fd8b015ad00 2023-10-16T08:51:57.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a00094d0 con 0x7fd8b015ad00 2023-10-16T08:51:57.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.144+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b01f49f0 con 0x7fd8b015ad00 2023-10-16T08:51:57.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.145+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b0073ef0 con 0x7fd8b015ad00 2023-10-16T08:51:57.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.146+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd898003990 con 0x7fd8b015ad00 2023-10-16T08:51:57.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.147+0000 7fd8acff9640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd89006aea0 0x7fd89006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.147+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd898088f40 con 0x7fd8b015ad00 2023-10-16T08:51:57.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.147+0000 7fd8af7fe640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd89006aea0 0x7fd89006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.148+0000 7fd8af7fe640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd89006aea0 0x7fd89006d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0036000 tx=0x7fd8a003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:57.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.152+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd898053c60 con 0x7fd8b015ad00 2023-10-16T08:51:57.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.362+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8b00cdee0 con 0x7fd8b015ad00 2023-10-16T08:51:57.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.363+0000 7fd8acff9640 1 -- 172.21.15.94:0/1026591672 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fd898057280 con 0x7fd8b015ad00 2023-10-16T08:51:57.366 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:57.366 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:51:57.366 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:51:57.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd89006aea0 msgr2=0x7fd89006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd89006aea0 0x7fd89006d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0036000 tx=0x7fd8a003b040 comp rx=0 tx=0).stop 2023-10-16T08:51:57.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 msgr2=0x7fd8b014f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 0x7fd8b014f360 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c400 tx=0x7fd89800c8c0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 shutdown_connections 2023-10-16T08:51:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8b015f040 0x7fd8b01f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8b015ad00 0x7fd8b014f360 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd89006aea0 0x7fd89006d360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 --2- 172.21.15.94:0/1026591672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8b00b0010 0x7fd8b01f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 >> 172.21.15.94:0/1026591672 conn(0x7fd8b006c1c0 msgr2=0x7fd8b00ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 shutdown_connections 2023-10-16T08:51:57.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.366+0000 7fd8b5ee5640 1 -- 172.21.15.94:0/1026591672 wait complete. 2023-10-16T08:51:57.387 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:51:57.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.589+0000 7f928b2c2640 1 Processor -- start 2023-10-16T08:51:57.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.589+0000 7f928b2c2640 1 -- start start 2023-10-16T08:51:57.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.590+0000 7f928b2c2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92840b0720 0x7f92840cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928b2c2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f928415ce60 0x7f92840cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928b2c2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9284161620 con 0x7f928415ca80 2023-10-16T08:51:57.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928b2c2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92840cafa0 con 0x7f92840b0720 2023-10-16T08:51:57.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928b2c2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92840cb280 con 0x7f928415ce60 2023-10-16T08:51:57.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928885d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92840b0720 0x7f92840cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928985f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f928415ce60 0x7f92840cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928885d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92840b0720 0x7f92840cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:40948/0 (socket says 172.21.15.94:40948) 2023-10-16T08:51:57.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.591+0000 7f928885d640 1 -- 172.21.15.94:0/1102405500 learned_addr learned my addr 172.21.15.94:0/1102405500 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:57.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.592+0000 7f928885d640 1 -- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f928415ce60 msgr2=0x7f92840cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:57.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.592+0000 7f928885d640 1 --2- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f928415ce60 0x7f92840cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.592+0000 7f928885d640 1 -- 172.21.15.94:0/1102405500 >> v1:172.21.15.130:6789/0 conn(0x7f928415ca80 legacy=0x7f92840b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.592+0000 7f928885d640 1 -- 172.21.15.94:0/1102405500 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840cb560 con 0x7f92840b0720 2023-10-16T08:51:57.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.593+0000 7f928885d640 1 --2- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92840b0720 0x7f92840cddf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9274009870 tx=0x7f927402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5c0e917810f9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:57.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.594+0000 7f927bfff640 1 -- 172.21.15.94:0/1102405500 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274030840 con 0x7f92840b0720 2023-10-16T08:51:57.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.594+0000 7f927bfff640 1 -- 172.21.15.94:0/1102405500 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92740309a0 con 0x7f92840b0720 2023-10-16T08:51:57.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.594+0000 7f927bfff640 1 -- 172.21.15.94:0/1102405500 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274030d30 con 0x7f92840b0720 2023-10-16T08:51:57.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 -- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92840b0720 msgr2=0x7f92840cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 --2- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92840b0720 0x7f92840cddf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9274009870 tx=0x7f927402b980 comp rx=0 tx=0).stop 2023-10-16T08:51:57.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 -- 172.21.15.94:0/1102405500 shutdown_connections 2023-10-16T08:51:57.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 --2- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f928415ce60 0x7f92840cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 --2- 172.21.15.94:0/1102405500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92840b0720 0x7f92840cddf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 -- 172.21.15.94:0/1102405500 >> 172.21.15.94:0/1102405500 conn(0x7f928406c1c0 msgr2=0x7f928406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:57.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 -- 172.21.15.94:0/1102405500 shutdown_connections 2023-10-16T08:51:57.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.595+0000 7f928b2c2640 1 -- 172.21.15.94:0/1102405500 wait complete. 2023-10-16T08:51:57.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.597+0000 7f928b2c2640 1 Processor -- start 2023-10-16T08:51:57.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.598+0000 7f928b2c2640 1 -- start start 2023-10-16T08:51:57.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928b2c2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92840b0720 0x7f92841f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928b2c2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f928415ca80 0x7f92840c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928b2c2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 0x7f92841f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928b2c2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928415dfc0 con 0x7f928415ce60 2023-10-16T08:51:57.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928b2c2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928415d340 con 0x7f928415ca80 2023-10-16T08:51:57.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928b2c2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928415d620 con 0x7f92840b0720 2023-10-16T08:51:57.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928985f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 0x7f92841f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928985f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 0x7f92841f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52038/0 (socket says 172.21.15.94:52038) 2023-10-16T08:51:57.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928985f640 1 -- 172.21.15.94:0/2598914516 learned_addr learned my addr 172.21.15.94:0/2598914516 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:57.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928905e640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92840b0720 0x7f92841f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.599+0000 7f928885d640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f928415ca80 0x7f92840c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928985f640 1 -- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92840b0720 msgr2=0x7f92841f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928985f640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92840b0720 0x7f92841f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928985f640 1 -- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f928415ca80 msgr2=0x7f92840c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928985f640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f928415ca80 0x7f92840c2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928985f640 1 -- 172.21.15.94:0/2598914516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740094d0 con 0x7f928415ce60 2023-10-16T08:51:57.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928985f640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 0x7f92841f22d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f927c004650 tx=0x7f927c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:57.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c009630 con 0x7f928415ce60 2023-10-16T08:51:57.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c00c940 con 0x7f928415ce60 2023-10-16T08:51:57.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c00ccf0 con 0x7f928415ce60 2023-10-16T08:51:57.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928415d900 con 0x7f928415ce60 2023-10-16T08:51:57.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.600+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92840c3010 con 0x7f928415ce60 2023-10-16T08:51:57.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.602+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928415e100 con 0x7f928415ce60 2023-10-16T08:51:57.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.603+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f927c013470 con 0x7f928415ce60 2023-10-16T08:51:57.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.603+0000 7f9279ffb640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f926806aea0 0x7f926806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:57.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.604+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f927c089aa0 con 0x7f928415ce60 2023-10-16T08:51:57.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.604+0000 7f928905e640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f926806aea0 0x7f926806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:57.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.604+0000 7f928905e640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f926806aea0 0x7f926806d360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92800012e0 tx=0x7f9280009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:57.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.608+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f928415e100 con 0x7f928415ce60 2023-10-16T08:51:57.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.799+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f928415e100 con 0x7f928415ce60 2023-10-16T08:51:57.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.801+0000 7f9279ffb640 1 -- 172.21.15.94:0/2598914516 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f928415e100 con 0x7f928415ce60 2023-10-16T08:51:57.804 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:51:57.804 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:51:57.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f926806aea0 msgr2=0x7f926806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f926806aea0 0x7f926806d360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92800012e0 tx=0x7f9280009040 comp rx=0 tx=0).stop 2023-10-16T08:51:57.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 msgr2=0x7f92841f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:57.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 0x7f92841f22d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f927c004650 tx=0x7f927c00ece0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 shutdown_connections 2023-10-16T08:51:57.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f928415ce60 0x7f92841f22d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f926806aea0 0x7f926806d360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f928415ca80 0x7f92840c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 --2- 172.21.15.94:0/2598914516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92840b0720 0x7f92841f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:57.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.804+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 >> 172.21.15.94:0/2598914516 conn(0x7f928406c1c0 msgr2=0x7f92840acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:57.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.805+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 shutdown_connections 2023-10-16T08:51:57.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:57.805+0000 7f928b2c2640 1 -- 172.21.15.94:0/2598914516 wait complete. 2023-10-16T08:51:57.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:51:57.826 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:51:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.041+0000 7f8a32875640 1 Processor -- start 2023-10-16T08:51:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.041+0000 7f8a32875640 1 -- start start 2023-10-16T08:51:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a32875640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a2c15cb80 0x7f8a2c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a32875640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c0cc470 0x7f8a2c070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a32875640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0cc1e0 con 0x7f8a2c0cacf0 2023-10-16T08:51:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a32875640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c070170 con 0x7f8a2c15cb80 2023-10-16T08:51:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a32875640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cd360 con 0x7f8a2c0cc470 2023-10-16T08:51:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a31873640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8a2c0cacf0 0x7f8a2c0cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48226/0 (socket says 172.21.15.94:48226) 2023-10-16T08:51:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a31873640 1 -- 172.21.15.94:0/1620691662 learned_addr learned my addr 172.21.15.94:0/1620691662 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.043+0000 7f8a31072640 1 --2- 172.21.15.94:0/1620691662 >> v2:172.21.15.94:3300/0 conn(0x7f8a2c15cb80 0x7f8a2c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.044+0000 7f8a32074640 1 --2- 172.21.15.94:0/1620691662 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c0cc470 0x7f8a2c070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.044+0000 7f8a31072640 1 -- 172.21.15.94:0/1620691662 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c0cc470 msgr2=0x7f8a2c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.044+0000 7f8a31072640 1 --2- 172.21.15.94:0/1620691662 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c0cc470 0x7f8a2c070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.044+0000 7f8a31072640 1 -- 172.21.15.94:0/1620691662 >> v1:172.21.15.94:6789/0 conn(0x7f8a2c0cacf0 legacy=0x7f8a2c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.044+0000 7f8a31072640 1 -- 172.21.15.94:0/1620691662 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0ccac0 con 0x7f8a2c15cb80 2023-10-16T08:51:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.044+0000 7f8a30871640 1 -- 172.21.15.94:0/1620691662 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161641884 0 0) 0x7f8a2c0cc1e0 con 0x7f8a2c0cacf0 2023-10-16T08:51:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.045+0000 7f8a31072640 1 --2- 172.21.15.94:0/1620691662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c15cb80 0x7f8a2c0cdc20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097a0 tx=0x7f8a1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f004699e23562a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.045+0000 7f8a30871640 1 -- 172.21.15.94:0/1620691662 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c031830 con 0x7f8a2c15cb80 2023-10-16T08:51:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.045+0000 7f8a30871640 1 -- 172.21.15.94:0/1620691662 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c031990 con 0x7f8a2c15cb80 2023-10-16T08:51:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.045+0000 7f8a30871640 1 -- 172.21.15.94:0/1620691662 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c031d20 con 0x7f8a2c15cb80 2023-10-16T08:51:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 -- 172.21.15.94:0/1620691662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c15cb80 msgr2=0x7f8a2c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 --2- 172.21.15.94:0/1620691662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c15cb80 0x7f8a2c0cdc20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097a0 tx=0x7f8a1c02b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 -- 172.21.15.94:0/1620691662 shutdown_connections 2023-10-16T08:51:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 --2- 172.21.15.94:0/1620691662 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c0cc470 0x7f8a2c070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 --2- 172.21.15.94:0/1620691662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c15cb80 0x7f8a2c0cdc20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 -- 172.21.15.94:0/1620691662 >> 172.21.15.94:0/1620691662 conn(0x7f8a2c06a470 msgr2=0x7f8a2c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 -- 172.21.15.94:0/1620691662 shutdown_connections 2023-10-16T08:51:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.046+0000 7f8a32875640 1 -- 172.21.15.94:0/1620691662 wait complete. 2023-10-16T08:51:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.048+0000 7f8a32875640 1 Processor -- start 2023-10-16T08:51:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.048+0000 7f8a32875640 1 -- start start 2023-10-16T08:51:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a32875640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c0cacf0 0x7f8a2c1f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a32875640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 0x7f8a2c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a32875640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c15cb80 0x7f8a2c0c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a32875640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1f2250 con 0x7f8a2c0cc470 2023-10-16T08:51:58.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a32875640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1e42f0 con 0x7f8a2c0cacf0 2023-10-16T08:51:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a32875640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c23d0 con 0x7f8a2c15cb80 2023-10-16T08:51:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 0x7f8a2c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 0x7f8a2c0c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52048/0 (socket says 172.21.15.94:52048) 2023-10-16T08:51:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 -- 172.21.15.94:0/1955674614 learned_addr learned my addr 172.21.15.94:0/1955674614 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 -- 172.21.15.94:0/1955674614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c15cb80 msgr2=0x7f8a2c0c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c15cb80 0x7f8a2c0c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 -- 172.21.15.94:0/1955674614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c0cacf0 msgr2=0x7f8a2c1f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c0cacf0 0x7f8a2c1f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.049+0000 7f8a31072640 1 -- 172.21.15.94:0/1955674614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009400 con 0x7f8a2c0cc470 2023-10-16T08:51:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.050+0000 7f8a31072640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 0x7f8a2c0c6c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c000c00 tx=0x7f8a1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.050+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0317d0 con 0x7f8a2c0cc470 2023-10-16T08:51:58.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.050+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c03aa60 con 0x7f8a2c0cc470 2023-10-16T08:51:58.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.050+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c03ae10 con 0x7f8a2c0cc470 2023-10-16T08:51:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.050+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c0c49a0 con 0x7f8a2c0cc470 2023-10-16T08:51:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.050+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0c4c40 con 0x7f8a2c0cc470 2023-10-16T08:51:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.051+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c04e9b0 con 0x7f8a2c0cc470 2023-10-16T08:51:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.052+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a1c04d450 con 0x7f8a2c0cc470 2023-10-16T08:51:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.053+0000 7f8a227fc640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8a1006ae70 0x7f8a1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.053+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a1c0ab9a0 con 0x7f8a2c0cc470 2023-10-16T08:51:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.053+0000 7f8a31873640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8a1006ae70 0x7f8a1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.054+0000 7f8a31873640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8a1006ae70 0x7f8a1006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a28007fd0 tx=0x7f8a28007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.057+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a1c0767f0 con 0x7f8a2c0cc470 2023-10-16T08:51:58.253 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.251+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a2c0c25c0 con 0x7f8a2c0cc470 2023-10-16T08:51:58.254 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.252+0000 7f8a227fc640 1 -- 172.21.15.94:0/1955674614 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a1c035020 con 0x7f8a2c0cc470 2023-10-16T08:51:58.254 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:51:58.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.254+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8a1006ae70 msgr2=0x7f8a1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.254+0000 7f8a32875640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8a1006ae70 0x7f8a1006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a28007fd0 tx=0x7f8a28007920 comp rx=0 tx=0).stop 2023-10-16T08:51:58.256 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.254+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 msgr2=0x7f8a2c0c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.257 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.254+0000 7f8a32875640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 0x7f8a2c0c6c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c000c00 tx=0x7f8a1c0046c0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.257 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 shutdown_connections 2023-10-16T08:51:58.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a2c15cb80 0x7f8a2c0c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a2c0cc470 0x7f8a2c0c6c00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8a1006ae70 0x7f8a1006d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 --2- 172.21.15.94:0/1955674614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a2c0cacf0 0x7f8a2c1f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 >> 172.21.15.94:0/1955674614 conn(0x7f8a2c06a470 msgr2=0x7f8a2c154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:58.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 shutdown_connections 2023-10-16T08:51:58.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.255+0000 7f8a32875640 1 -- 172.21.15.94:0/1955674614 wait complete. 2023-10-16T08:51:58.275 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:51:58.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.486+0000 7f8c1ffff640 1 Processor -- start 2023-10-16T08:51:58.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.486+0000 7f8c1ffff640 1 -- start start 2023-10-16T08:51:58.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.487+0000 7f8c1ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c2015c8e0 0x7f8c200cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.487+0000 7f8c1ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8c200cf030 0x7f8c2006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.487+0000 7f8c1ffff640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c200cdac0 con 0x7f8c2006d230 2023-10-16T08:51:58.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.487+0000 7f8c1ffff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2006df90 con 0x7f8c2015c8e0 2023-10-16T08:51:58.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.487+0000 7f8c1ffff640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200cd1f0 con 0x7f8c200cf030 2023-10-16T08:51:58.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1effd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c2015c8e0 0x7f8c200cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1e7fc640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8c2006d230 0x7f8c200ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48240/0 (socket says 172.21.15.94:48240) 2023-10-16T08:51:58.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1effd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c2015c8e0 0x7f8c200cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52064/0 (socket says 172.21.15.94:52064) 2023-10-16T08:51:58.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1e7fc640 1 -- 172.21.15.94:0/3840173437 learned_addr learned my addr 172.21.15.94:0/3840173437 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:58.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1f7fe640 1 --2- 172.21.15.94:0/3840173437 >> v2:172.21.15.130:3300/0 conn(0x7f8c200cf030 0x7f8c2006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1effd640 1 -- 172.21.15.94:0/3840173437 >> v2:172.21.15.130:3300/0 conn(0x7f8c200cf030 msgr2=0x7f8c2006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:58.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1effd640 1 --2- 172.21.15.94:0/3840173437 >> v2:172.21.15.130:3300/0 conn(0x7f8c200cf030 0x7f8c2006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1effd640 1 -- 172.21.15.94:0/3840173437 >> v1:172.21.15.94:6789/0 conn(0x7f8c2006d230 legacy=0x7f8c200ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1dffb640 1 -- 172.21.15.94:0/3840173437 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298040742 0 0) 0x7f8c200cdac0 con 0x7f8c2006d230 2023-10-16T08:51:58.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.488+0000 7f8c1effd640 1 -- 172.21.15.94:0/3840173437 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2006dcb0 con 0x7f8c2015c8e0 2023-10-16T08:51:58.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.490+0000 7f8c1effd640 1 --2- 172.21.15.94:0/3840173437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c200cdf50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c8ae0 tx=0x7f8c1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f1a7a7d6a5d61c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.490+0000 7f8c1dffb640 1 -- 172.21.15.94:0/3840173437 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10031830 con 0x7f8c2015c8e0 2023-10-16T08:51:58.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.490+0000 7f8c1dffb640 1 -- 172.21.15.94:0/3840173437 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10031990 con 0x7f8c2015c8e0 2023-10-16T08:51:58.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.490+0000 7f8c1dffb640 1 -- 172.21.15.94:0/3840173437 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10031d20 con 0x7f8c2015c8e0 2023-10-16T08:51:58.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.490+0000 7f8c1ffff640 1 -- 172.21.15.94:0/3840173437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 msgr2=0x7f8c200cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.490+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/3840173437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c200cdf50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c8ae0 tx=0x7f8c1002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.491+0000 7f8c1ffff640 1 -- 172.21.15.94:0/3840173437 shutdown_connections 2023-10-16T08:51:58.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.491+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/3840173437 >> v2:172.21.15.130:3300/0 conn(0x7f8c200cf030 0x7f8c2006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.491+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/3840173437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c200cdf50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.491+0000 7f8c1ffff640 1 -- 172.21.15.94:0/3840173437 >> 172.21.15.94:0/3840173437 conn(0x7f8c2006a200 msgr2=0x7f8c2006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:58.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.491+0000 7f8c1ffff640 1 -- 172.21.15.94:0/3840173437 shutdown_connections 2023-10-16T08:51:58.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.491+0000 7f8c1ffff640 1 -- 172.21.15.94:0/3840173437 wait complete. 2023-10-16T08:51:58.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.492+0000 7f8c1ffff640 1 Processor -- start 2023-10-16T08:51:58.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.492+0000 7f8c1ffff640 1 -- start start 2023-10-16T08:51:58.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.493+0000 7f8c1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c2006d230 0x7f8c2015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.493+0000 7f8c1ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c200cf030 0x7f8c200c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.493+0000 7f8c1ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c201f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.493+0000 7f8c1ffff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200c2750 con 0x7f8c2015c8e0 2023-10-16T08:51:58.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.493+0000 7f8c1ffff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200ac1f0 con 0x7f8c2006d230 2023-10-16T08:51:58.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.493+0000 7f8c1ffff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c201f22b0 con 0x7f8c200cf030 2023-10-16T08:51:58.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c201f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c201f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52076/0 (socket says 172.21.15.94:52076) 2023-10-16T08:51:58.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 -- 172.21.15.94:0/2906931049 learned_addr learned my addr 172.21.15.94:0/2906931049 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:58.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1effd640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c2006d230 0x7f8c2015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1e7fc640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c200cf030 0x7f8c200c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 -- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c200cf030 msgr2=0x7f8c200c2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c200cf030 0x7f8c200c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 -- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c2006d230 msgr2=0x7f8c2015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c2006d230 0x7f8c2015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 -- 172.21.15.94:0/2906931049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009400 con 0x7f8c2015c8e0 2023-10-16T08:51:58.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1effd640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c2006d230 0x7f8c2015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:58.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.494+0000 7f8c1f7fe640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c201f1d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c18007e70 tx=0x7f8c1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.495+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18014620 con 0x7f8c2015c8e0 2023-10-16T08:51:58.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.495+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c180147a0 con 0x7f8c2015c8e0 2023-10-16T08:51:58.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.495+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18014b50 con 0x7f8c2015c8e0 2023-10-16T08:51:58.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.495+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c200c8c60 con 0x7f8c2015c8e0 2023-10-16T08:51:58.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.495+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c200c9220 con 0x7f8c2015c8e0 2023-10-16T08:51:58.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.496+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2004e9b0 con 0x7f8c2015c8e0 2023-10-16T08:51:58.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.497+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c18014cb0 con 0x7f8c2015c8e0 2023-10-16T08:51:58.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.497+0000 7f8c077fe640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8c0c06ae70 0x7f8c0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.498+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c1808a240 con 0x7f8c2015c8e0 2023-10-16T08:51:58.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.498+0000 7f8c1effd640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8c0c06ae70 0x7f8c0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.498+0000 7f8c1effd640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8c0c06ae70 0x7f8c0c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c10036000 tx=0x7f8c1003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.502+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c18055090 con 0x7f8c2015c8e0 2023-10-16T08:51:58.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.691+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c2006cb20 con 0x7f8c2015c8e0 2023-10-16T08:51:58.694 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.692+0000 7f8c077fe640 1 -- 172.21.15.94:0/2906931049 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c180586b0 con 0x7f8c2015c8e0 2023-10-16T08:51:58.694 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:58.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8c0c06ae70 msgr2=0x7f8c0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8c0c06ae70 0x7f8c0c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c10036000 tx=0x7f8c1003c040 comp rx=0 tx=0).stop 2023-10-16T08:51:58.697 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 msgr2=0x7f8c201f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c201f1d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c18007e70 tx=0x7f8c1800e4b0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 shutdown_connections 2023-10-16T08:51:58.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c2015c8e0 0x7f8c201f1d70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c200cf030 0x7f8c200c2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.698 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f8c0c06ae70 0x7f8c0c06d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 --2- 172.21.15.94:0/2906931049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c2006d230 0x7f8c2015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 >> 172.21.15.94:0/2906931049 conn(0x7f8c2006a200 msgr2=0x7f8c200ac9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:58.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 shutdown_connections 2023-10-16T08:51:58.699 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.695+0000 7f8c1ffff640 1 -- 172.21.15.94:0/2906931049 wait complete. 2023-10-16T08:51:58.714 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:51:58.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.926+0000 7fc97970f640 1 Processor -- start 2023-10-16T08:51:58.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.926+0000 7fc97970f640 1 -- start start 2023-10-16T08:51:58.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.928+0000 7fc97970f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.928+0000 7fc97970f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9740cb3b0 0x7fc97415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.928+0000 7fc97970f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc974160730 con 0x7fc97415cbf0 2023-10-16T08:51:58.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.928+0000 7fc97970f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97415dd60 con 0x7fc9740cb3b0 2023-10-16T08:51:58.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.928+0000 7fc97970f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741609f0 con 0x7fc9741611f0 2023-10-16T08:51:58.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9740cb3b0 0x7fc97415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc9740cb3b0 0x7fc97415d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52078/0 (socket says 172.21.15.94:52078) 2023-10-16T08:51:58.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 -- 172.21.15.94:0/989887022 learned_addr learned my addr 172.21.15.94:0/989887022 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:58.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc96bfff640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 -- 172.21.15.94:0/989887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 msgr2=0x7fc97415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:58.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 -- 172.21.15.94:0/989887022 >> v1:172.21.15.94:6789/0 conn(0x7fc97415cbf0 legacy=0x7fc9740caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9737fe640 1 -- 172.21.15.94:0/989887022 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974160cd0 con 0x7fc9740cb3b0 2023-10-16T08:51:58.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc9727fc640 1 -- 172.21.15.94:0/989887022 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329897634 0 0) 0x7fc974160730 con 0x7fc97415cbf0 2023-10-16T08:51:58.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.929+0000 7fc96bfff640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:58.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.931+0000 7fc9737fe640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9740cb3b0 0x7fc97415d510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009e50 tx=0x7fc96c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe067da4c04a013 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.931+0000 7fc9727fc640 1 -- 172.21.15.94:0/989887022 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c02ca80 con 0x7fc9740cb3b0 2023-10-16T08:51:58.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.931+0000 7fc9727fc640 1 -- 172.21.15.94:0/989887022 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c02cbe0 con 0x7fc9740cb3b0 2023-10-16T08:51:58.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.931+0000 7fc9727fc640 1 -- 172.21.15.94:0/989887022 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0343f0 con 0x7fc9740cb3b0 2023-10-16T08:51:58.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.931+0000 7fc97970f640 1 -- 172.21.15.94:0/989887022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9740cb3b0 msgr2=0x7fc97415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.931+0000 7fc97970f640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9740cb3b0 0x7fc97415d510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009e50 tx=0x7fc96c02bee0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.932+0000 7fc97970f640 1 -- 172.21.15.94:0/989887022 shutdown_connections 2023-10-16T08:51:58.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.932+0000 7fc97970f640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9740cb3b0 0x7fc97415d510 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.932+0000 7fc97970f640 1 --2- 172.21.15.94:0/989887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.932+0000 7fc97970f640 1 -- 172.21.15.94:0/989887022 >> 172.21.15.94:0/989887022 conn(0x7fc9740b0030 msgr2=0x7fc9740b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:58.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.932+0000 7fc97970f640 1 -- 172.21.15.94:0/989887022 shutdown_connections 2023-10-16T08:51:58.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.932+0000 7fc97970f640 1 -- 172.21.15.94:0/989887022 wait complete. 2023-10-16T08:51:58.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.933+0000 7fc97970f640 1 Processor -- start 2023-10-16T08:51:58.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 -- start start 2023-10-16T08:51:58.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9740cb3b0 0x7fc9740ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 0x7fc9740ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c2030 con 0x7fc97415cbf0 2023-10-16T08:51:58.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c3320 con 0x7fc9740cb3b0 2023-10-16T08:51:58.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.934+0000 7fc97970f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c2280 con 0x7fc9741611f0 2023-10-16T08:51:58.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 0x7fc9740ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 0x7fc9740ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52086/0 (socket says 172.21.15.94:52086) 2023-10-16T08:51:58.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 -- 172.21.15.94:0/2719131001 learned_addr learned my addr 172.21.15.94:0/2719131001 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:58.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 -- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 msgr2=0x7fc97415f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc972ffd640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9740cb3b0 0x7fc9740ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 -- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9740cb3b0 msgr2=0x7fc9740ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:58.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9740cb3b0 0x7fc9740ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:58.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 -- 172.21.15.94:0/2719131001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009b30 con 0x7fc97415cbf0 2023-10-16T08:51:58.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc972ffd640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9740cb3b0 0x7fc9740ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:58.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.935+0000 7fc96bfff640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 0x7fc9740ae770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c7c0 tx=0x7fc95c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.936+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c007820 con 0x7fc97415cbf0 2023-10-16T08:51:58.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.936+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c007980 con 0x7fc97415cbf0 2023-10-16T08:51:58.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.936+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c007d10 con 0x7fc97415cbf0 2023-10-16T08:51:58.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.936+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9740c2560 con 0x7fc97415cbf0 2023-10-16T08:51:58.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.936+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740c2b20 con 0x7fc97415cbf0 2023-10-16T08:51:58.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.937+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc974073ef0 con 0x7fc97415cbf0 2023-10-16T08:51:58.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.938+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc95c0113f0 con 0x7fc97415cbf0 2023-10-16T08:51:58.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.939+0000 7fc96b7fe640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:58.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.939+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc95c0899f0 con 0x7fc97415cbf0 2023-10-16T08:51:58.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.939+0000 7fc972ffd640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:58.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.939+0000 7fc972ffd640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc95406ae70 0x7fc95406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc964000f60 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:58.947 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:58.943+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc95c0547b0 con 0x7fc97415cbf0 2023-10-16T08:51:59.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.133+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9740cc1a0 con 0x7fc97415cbf0 2023-10-16T08:51:59.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.134+0000 7fc96b7fe640 1 -- 172.21.15.94:0/2719131001 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc95c01f0a0 con 0x7fc97415cbf0 2023-10-16T08:51:59.136 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:51:59.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc95406ae70 msgr2=0x7fc95406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc95406ae70 0x7fc95406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc964000f60 tx=0x7fc964009040 comp rx=0 tx=0).stop 2023-10-16T08:51:59.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 msgr2=0x7fc9740ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 0x7fc9740ae770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c7c0 tx=0x7fc95c00cc80 comp rx=0 tx=0).stop 2023-10-16T08:51:59.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 shutdown_connections 2023-10-16T08:51:59.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9741611f0 0x7fc97415f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc97415cbf0 0x7fc9740ae770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 --2- 172.21.15.94:0/2719131001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9740cb3b0 0x7fc9740ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 >> 172.21.15.94:0/2719131001 conn(0x7fc9740b0030 msgr2=0x7fc97406c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:59.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 shutdown_connections 2023-10-16T08:51:59.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.137+0000 7fc97970f640 1 -- 172.21.15.94:0/2719131001 wait complete. 2023-10-16T08:51:59.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:51:59.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.360+0000 7fb156390640 1 Processor -- start 2023-10-16T08:51:59.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.361+0000 7fb156390640 1 -- start start 2023-10-16T08:51:59.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.362+0000 7fb156390640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 0x7fb15015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.362+0000 7fb156390640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb150160990 con 0x7fb15015d8b0 2023-10-16T08:51:59.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.362+0000 7fb156390640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500ccff0 con 0x7fb15006a4f0 2023-10-16T08:51:59.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.362+0000 7fb156390640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ce1b0 con 0x7fb15015cf90 2023-10-16T08:51:59.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.362+0000 7fb14f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb15015d8b0 0x7fb150069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48256/0 (socket says 172.21.15.94:48256) 2023-10-16T08:51:59.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.362+0000 7fb14f7fe640 1 -- 172.21.15.94:0/3516388125 learned_addr learned my addr 172.21.15.94:0/3516388125 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:51:59.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14ffff640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 0x7fb15015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6894686 0 0) 0x7fb150160990 con 0x7fb15015d8b0 2023-10-16T08:51:59.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138003520 con 0x7fb15015d8b0 2023-10-16T08:51:59.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1818147521 0 0) 0x7fb138003520 con 0x7fb15015d8b0 2023-10-16T08:51:59.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 msgr2=0x7fb15015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:59.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 0x7fb15015d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 >> v1:172.21.15.130:6789/0 conn(0x7fb15006a4f0 legacy=0x7fb150160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500ccd10 con 0x7fb15015d8b0 2023-10-16T08:51:59.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fb144001670 con 0x7fb15015d8b0 2023-10-16T08:51:59.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 >> v1:172.21.15.94:6789/0 conn(0x7fb15015d8b0 legacy=0x7fb150069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1380039a0 0x7fb138003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 0x7fb1380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb138004d00 0x7fb138005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ce1b0 con 0x7fb1380039a0 2023-10-16T08:51:59.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800bab0 con 0x7fb138004d00 2023-10-16T08:51:59.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.363+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800bc70 con 0x7fb15015cf90 2023-10-16T08:51:59.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb14ffff640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1380039a0 0x7fb138003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb15492d640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb138004d00 0x7fb138005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb14ffff640 1 -- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 msgr2=0x7fb1380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:59.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb14ffff640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb15015cf90 0x7fb1380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb14ffff640 1 -- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb138004d00 msgr2=0x7fb138005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:59.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb14ffff640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb138004d00 0x7fb138005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb14ffff640 1 -- 172.21.15.94:0/3516388125 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138003520 con 0x7fb1380039a0 2023-10-16T08:51:59.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.364+0000 7fb15492d640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb138004d00 0x7fb138005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:59.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.365+0000 7fb14ffff640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1380039a0 0x7fb138003dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb140009ac0 tx=0x7fb1380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b1dce2c973611e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:59.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.365+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14002c630 con 0x7fb1380039a0 2023-10-16T08:51:59.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.365+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14002c790 con 0x7fb1380039a0 2023-10-16T08:51:59.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.365+0000 7fb14effd640 1 -- 172.21.15.94:0/3516388125 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14002cb20 con 0x7fb1380039a0 2023-10-16T08:51:59.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb156390640 1 -- 172.21.15.94:0/3516388125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1380039a0 msgr2=0x7fb138003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb156390640 1 --2- 172.21.15.94:0/3516388125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1380039a0 0x7fb138003dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb140009ac0 tx=0x7fb1380057f0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb15492d640 1 -- 172.21.15.94:0/3516388125 reap_dead start 2023-10-16T08:51:59.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb156390640 1 -- 172.21.15.94:0/3516388125 shutdown_connections 2023-10-16T08:51:59.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb156390640 1 -- 172.21.15.94:0/3516388125 >> 172.21.15.94:0/3516388125 conn(0x7fb1500cc080 msgr2=0x7fb1500cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:59.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb156390640 1 -- 172.21.15.94:0/3516388125 shutdown_connections 2023-10-16T08:51:59.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.366+0000 7fb156390640 1 -- 172.21.15.94:0/3516388125 wait complete. 2023-10-16T08:51:59.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.368+0000 7fb156390640 1 Processor -- start 2023-10-16T08:51:59.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.368+0000 7fb156390640 1 -- start start 2023-10-16T08:51:59.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb156390640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1380039a0 0x7fb1500ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb156390640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1501f2f70 0x7fb1500adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb156390640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 0x7fb1500b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb156390640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ae400 con 0x7fb1500b1260 2023-10-16T08:51:59.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb156390640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500b1ce0 con 0x7fb1501f2f70 2023-10-16T08:51:59.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb156390640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500c3320 con 0x7fb1380039a0 2023-10-16T08:51:59.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb15492d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 0x7fb1500b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb15492d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 0x7fb1500b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52100/0 (socket says 172.21.15.94:52100) 2023-10-16T08:51:59.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb15492d640 1 -- 172.21.15.94:0/1234672673 learned_addr learned my addr 172.21.15.94:0/1234672673 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:59.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb14ffff640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1380039a0 0x7fb1500ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.369+0000 7fb14f7fe640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1501f2f70 0x7fb1500adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb15492d640 1 -- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1380039a0 msgr2=0x7fb1500ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb15492d640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1380039a0 0x7fb1500ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb15492d640 1 -- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1501f2f70 msgr2=0x7fb1500adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb15492d640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1501f2f70 0x7fb1500adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb15492d640 1 -- 172.21.15.94:0/1234672673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500c3600 con 0x7fb1500b1260 2023-10-16T08:51:59.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb15492d640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 0x7fb1500b16f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ceb30 tx=0x7fb14800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:59.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148006d50 con 0x7fb1500b1260 2023-10-16T08:51:59.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148003970 con 0x7fb1500b1260 2023-10-16T08:51:59.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148003d60 con 0x7fb1500b1260 2023-10-16T08:51:59.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1500c38e0 con 0x7fb1500b1260 2023-10-16T08:51:59.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.370+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1500af3a0 con 0x7fb1500b1260 2023-10-16T08:51:59.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.372+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1500c3180 con 0x7fb1500b1260 2023-10-16T08:51:59.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.372+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb148005070 con 0x7fb1500b1260 2023-10-16T08:51:59.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.373+0000 7fb14cff9640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb13c06aea0 0x7fb13c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.373+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1480897f0 con 0x7fb1500b1260 2023-10-16T08:51:59.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.374+0000 7fb14ffff640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb13c06aea0 0x7fb13c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.374+0000 7fb14ffff640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb13c06aea0 0x7fb13c06d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb140036000 tx=0x7fb140030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:59.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.377+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1500c3180 con 0x7fb1500b1260 2023-10-16T08:51:59.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.559+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1500c3180 con 0x7fb1500b1260 2023-10-16T08:51:59.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.560+0000 7fb14cff9640 1 -- 172.21.15.94:0/1234672673 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1500c3180 con 0x7fb1500b1260 2023-10-16T08:51:59.562 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:51:59.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.562+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb13c06aea0 msgr2=0x7fb13c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.562+0000 7fb156390640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb13c06aea0 0x7fb13c06d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb140036000 tx=0x7fb140030000 comp rx=0 tx=0).stop 2023-10-16T08:51:59.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.562+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 msgr2=0x7fb1500b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.562+0000 7fb156390640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 0x7fb1500b16f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ceb30 tx=0x7fb14800dc00 comp rx=0 tx=0).stop 2023-10-16T08:51:59.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 shutdown_connections 2023-10-16T08:51:59.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1500b1260 0x7fb1500b16f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb13c06aea0 0x7fb13c06d360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1501f2f70 0x7fb1500adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 --2- 172.21.15.94:0/1234672673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1380039a0 0x7fb1500ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 >> 172.21.15.94:0/1234672673 conn(0x7fb1500cc080 msgr2=0x7fb1500cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:59.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 shutdown_connections 2023-10-16T08:51:59.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.563+0000 7fb156390640 1 -- 172.21.15.94:0/1234672673 wait complete. 2023-10-16T08:51:59.582 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:51:59.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.788+0000 7f9aab290640 1 Processor -- start 2023-10-16T08:51:59.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.788+0000 7f9aab290640 1 -- start start 2023-10-16T08:51:59.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aab290640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9aa415a8d0 0x7f9aa40cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aab290640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9aa40ca660 0x7f9aa40cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aab290640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa415acb0 con 0x7f9aa406ff40 2023-10-16T08:51:59.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aab290640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa40c1c60 con 0x7f9aa40ca660 2023-10-16T08:51:59.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aab290640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa415e350 con 0x7f9aa415a8d0 2023-10-16T08:51:59.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aa9a8d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9aa40ca660 0x7f9aa40cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aa9a8d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9aa40ca660 0x7f9aa40cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52106/0 (socket says 172.21.15.94:52106) 2023-10-16T08:51:59.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aa9a8d640 1 -- 172.21.15.94:0/1856802459 learned_addr learned my addr 172.21.15.94:0/1856802459 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:59.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.790+0000 7f9aaaa8f640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9aa406ff40 0x7f9aa406bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48260/0 (socket says 172.21.15.94:48260) 2023-10-16T08:51:59.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aaa28e640 1 --2- 172.21.15.94:0/1856802459 >> v2:172.21.15.130:3300/0 conn(0x7f9aa415a8d0 0x7f9aa40cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aa9a8d640 1 -- 172.21.15.94:0/1856802459 >> v2:172.21.15.130:3300/0 conn(0x7f9aa415a8d0 msgr2=0x7f9aa40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:51:59.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aa9a8d640 1 --2- 172.21.15.94:0/1856802459 >> v2:172.21.15.130:3300/0 conn(0x7f9aa415a8d0 0x7f9aa40cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aa9a8d640 1 -- 172.21.15.94:0/1856802459 >> v1:172.21.15.94:6789/0 conn(0x7f9aa406ff40 legacy=0x7f9aa406bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aa9a8d640 1 -- 172.21.15.94:0/1856802459 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa415e630 con 0x7f9aa40ca660 2023-10-16T08:51:59.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aaa28e640 1 --2- 172.21.15.94:0/1856802459 >> v2:172.21.15.130:3300/0 conn(0x7f9aa415a8d0 0x7f9aa40cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:51:59.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.791+0000 7f9aa928c640 1 -- 172.21.15.94:0/1856802459 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972464087 0 0) 0x7f9a9c001490 con 0x7f9aa406ff40 2023-10-16T08:51:59.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.792+0000 7f9aa9a8d640 1 --2- 172.21.15.94:0/1856802459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa40ca660 0x7f9aa40cb080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9aa406fef0 tx=0x7f9a9402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09c7f712277729b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:59.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.792+0000 7f9aa928c640 1 -- 172.21.15.94:0/1856802459 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94030870 con 0x7f9aa40ca660 2023-10-16T08:51:59.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.792+0000 7f9aa928c640 1 -- 172.21.15.94:0/1856802459 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a940309d0 con 0x7f9aa40ca660 2023-10-16T08:51:59.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.792+0000 7f9aa928c640 1 -- 172.21.15.94:0/1856802459 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94030d60 con 0x7f9aa40ca660 2023-10-16T08:51:59.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.792+0000 7f9aab290640 1 -- 172.21.15.94:0/1856802459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa40ca660 msgr2=0x7f9aa40cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.792+0000 7f9aab290640 1 --2- 172.21.15.94:0/1856802459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa40ca660 0x7f9aa40cb080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9aa406fef0 tx=0x7f9a9402b9b0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.793+0000 7f9aab290640 1 -- 172.21.15.94:0/1856802459 shutdown_connections 2023-10-16T08:51:59.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.793+0000 7f9aab290640 1 --2- 172.21.15.94:0/1856802459 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa40ca660 0x7f9aa40cb080 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.793+0000 7f9aab290640 1 --2- 172.21.15.94:0/1856802459 >> v2:172.21.15.130:3300/0 conn(0x7f9aa415a8d0 0x7f9aa40cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.793+0000 7f9aab290640 1 -- 172.21.15.94:0/1856802459 >> 172.21.15.94:0/1856802459 conn(0x7f9aa406a470 msgr2=0x7f9aa40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:51:59.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.793+0000 7f9aab290640 1 -- 172.21.15.94:0/1856802459 shutdown_connections 2023-10-16T08:51:59.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.793+0000 7f9aab290640 1 -- 172.21.15.94:0/1856802459 wait complete. 2023-10-16T08:51:59.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.794+0000 7f9aab290640 1 Processor -- start 2023-10-16T08:51:59.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 -- start start 2023-10-16T08:51:59.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 0x7f9aa40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aa40ca660 0x7f9aa41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aa415a8d0 0x7f9aa4156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa415b8d0 con 0x7f9aa406ff40 2023-10-16T08:51:59.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40ac660 con 0x7f9aa40ca660 2023-10-16T08:51:59.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.795+0000 7f9aab290640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40abdc0 con 0x7f9aa415a8d0 2023-10-16T08:51:59.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 0x7f9aa40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 0x7f9aa40b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52112/0 (socket says 172.21.15.94:52112) 2023-10-16T08:51:59.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 -- 172.21.15.94:0/2042568651 learned_addr learned my addr 172.21.15.94:0/2042568651 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:51:59.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 -- 172.21.15.94:0/2042568651 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aa415a8d0 msgr2=0x7f9aa4156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aa415a8d0 0x7f9aa4156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 -- 172.21.15.94:0/2042568651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aa40ca660 msgr2=0x7f9aa41568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:51:59.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aa40ca660 0x7f9aa41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:51:59.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 -- 172.21.15.94:0/2042568651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a940094d0 con 0x7f9aa406ff40 2023-10-16T08:51:59.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.796+0000 7f9aaa28e640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 0x7f9aa40b33d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000c7f0 tx=0x7f9aa000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:59.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.797+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0004220 con 0x7f9aa406ff40 2023-10-16T08:51:59.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.797+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0004380 con 0x7f9aa406ff40 2023-10-16T08:51:59.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.797+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa40ac0a0 con 0x7f9aa406ff40 2023-10-16T08:51:59.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.797+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0005bb0 con 0x7f9aa406ff40 2023-10-16T08:51:59.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.797+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa415bb00 con 0x7f9aa406ff40 2023-10-16T08:51:59.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.798+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa415bcf0 con 0x7f9aa406ff40 2023-10-16T08:51:59.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.799+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9aa0006030 con 0x7f9aa406ff40 2023-10-16T08:51:59.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.800+0000 7f9a9affd640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9a8806ae70 0x7f9a8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:51:59.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.800+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9aa0089ea0 con 0x7f9aa406ff40 2023-10-16T08:51:59.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.800+0000 7f9aa9a8d640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9a8806ae70 0x7f9a8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:51:59.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.801+0000 7f9aa9a8d640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9a8806ae70 0x7f9a8806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a94036000 tx=0x7f9a9403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:51:59.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:51:59.805+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9aa0054bc0 con 0x7f9aa406ff40 2023-10-16T08:52:00.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.033+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aa404e9b0 con 0x7f9aa406ff40 2023-10-16T08:52:00.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.034+0000 7f9a9affd640 1 -- 172.21.15.94:0/2042568651 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f9aa00581e0 con 0x7f9aa406ff40 2023-10-16T08:52:00.037 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:00.037 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:52:00.037 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:52:00.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.037+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9a8806ae70 msgr2=0x7f9a8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.037+0000 7f9aab290640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9a8806ae70 0x7f9a8806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a94036000 tx=0x7f9a9403b040 comp rx=0 tx=0).stop 2023-10-16T08:52:00.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.037+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 msgr2=0x7f9aa40b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.037+0000 7f9aab290640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 0x7f9aa40b33d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000c7f0 tx=0x7f9aa000ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 shutdown_connections 2023-10-16T08:52:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aa415a8d0 0x7f9aa4156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9a8806ae70 0x7f9a8806d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aa40ca660 0x7f9aa41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 --2- 172.21.15.94:0/2042568651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9aa406ff40 0x7f9aa40b33d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 >> 172.21.15.94:0/2042568651 conn(0x7f9aa406a470 msgr2=0x7f9aa40ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:00.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 shutdown_connections 2023-10-16T08:52:00.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.038+0000 7f9aab290640 1 -- 172.21.15.94:0/2042568651 wait complete. 2023-10-16T08:52:00.058 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.272+0000 7f86513a9640 1 Processor -- start 2023-10-16T08:52:00.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.272+0000 7f86513a9640 1 -- start start 2023-10-16T08:52:00.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.273+0000 7f86513a9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f864c0b0720 0x7f864c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f86513a9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c15ce60 0x7f864c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f86513a9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c161620 con 0x7f864c15ca80 2023-10-16T08:52:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f86513a9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0cafa0 con 0x7f864c0b0720 2023-10-16T08:52:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f86513a9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0cb280 con 0x7f864c15ce60 2023-10-16T08:52:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f864c0b0720 0x7f864c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f864c0b0720 0x7f864c0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52124/0 (socket says 172.21.15.94:52124) 2023-10-16T08:52:00.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 -- 172.21.15.94:0/723739549 learned_addr learned my addr 172.21.15.94:0/723739549 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:00.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864b7fe640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c15ce60 0x7f864c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 -- 172.21.15.94:0/723739549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c15ce60 msgr2=0x7f864c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:00.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c15ce60 0x7f864c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 -- 172.21.15.94:0/723739549 >> v1:172.21.15.94:6789/0 conn(0x7f864c15ca80 legacy=0x7f864c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864a7fc640 1 -- 172.21.15.94:0/723739549 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0cb560 con 0x7f864c0b0720 2023-10-16T08:52:00.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.274+0000 7f864b7fe640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c15ce60 0x7f864c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:00.280 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f864a7fc640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c0b0720 0x7f864c0cddf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8640009870 tx=0x7f864002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f53c1976a47e4ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:00.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f8649ffb640 1 -- 172.21.15.94:0/723739549 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640030840 con 0x7f864c0b0720 2023-10-16T08:52:00.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f8649ffb640 1 -- 172.21.15.94:0/723739549 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86400309a0 con 0x7f864c0b0720 2023-10-16T08:52:00.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f8649ffb640 1 -- 172.21.15.94:0/723739549 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640030d30 con 0x7f864c0b0720 2023-10-16T08:52:00.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f86513a9640 1 -- 172.21.15.94:0/723739549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c0b0720 msgr2=0x7f864c0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f86513a9640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c0b0720 0x7f864c0cddf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8640009870 tx=0x7f864002b980 comp rx=0 tx=0).stop 2023-10-16T08:52:00.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f86513a9640 1 -- 172.21.15.94:0/723739549 shutdown_connections 2023-10-16T08:52:00.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f86513a9640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c15ce60 0x7f864c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f86513a9640 1 --2- 172.21.15.94:0/723739549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c0b0720 0x7f864c0cddf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.276+0000 7f86513a9640 1 -- 172.21.15.94:0/723739549 >> 172.21.15.94:0/723739549 conn(0x7f864c06c1c0 msgr2=0x7f864c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:00.283 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.277+0000 7f86513a9640 1 -- 172.21.15.94:0/723739549 shutdown_connections 2023-10-16T08:52:00.283 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.277+0000 7f86513a9640 1 -- 172.21.15.94:0/723739549 wait complete. 2023-10-16T08:52:00.283 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.278+0000 7f86513a9640 1 Processor -- start 2023-10-16T08:52:00.283 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.278+0000 7f86513a9640 1 -- start start 2023-10-16T08:52:00.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.279+0000 7f86513a9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c0b0720 0x7f864c15f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.279+0000 7f86513a9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 0x7f864c14efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.279+0000 7f86513a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864c15ce60 0x7f864c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.279+0000 7f86513a9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15fc50 con 0x7f864c15ca80 2023-10-16T08:52:00.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.279+0000 7f86513a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0b3010 con 0x7f864c15ce60 2023-10-16T08:52:00.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.279+0000 7f86513a9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15f690 con 0x7f864c0b0720 2023-10-16T08:52:00.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 0x7f864c14efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 0x7f864c14efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52140/0 (socket says 172.21.15.94:52140) 2023-10-16T08:52:00.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 -- 172.21.15.94:0/1280377849 learned_addr learned my addr 172.21.15.94:0/1280377849 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:00.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864affd640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c0b0720 0x7f864c15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864b7fe640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864c15ce60 0x7f864c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 -- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c0b0720 msgr2=0x7f864c15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c0b0720 0x7f864c15f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 -- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864c15ce60 msgr2=0x7f864c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864c15ce60 0x7f864c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 -- 172.21.15.94:0/1280377849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400094d0 con 0x7f864c15ca80 2023-10-16T08:52:00.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864b7fe640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864c15ce60 0x7f864c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:00.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.280+0000 7f864a7fc640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 0x7f864c14efd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8640000c00 tx=0x7f8640004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:00.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.281+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640030810 con 0x7f864c15ca80 2023-10-16T08:52:00.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.281+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640039d90 con 0x7f864c15ca80 2023-10-16T08:52:00.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.281+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640043670 con 0x7f864c15ca80 2023-10-16T08:52:00.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.281+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c15f970 con 0x7f864c15ca80 2023-10-16T08:52:00.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.281+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0c20c0 con 0x7f864c15ca80 2023-10-16T08:52:00.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.282+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c0b2b00 con 0x7f864c15ca80 2023-10-16T08:52:00.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.283+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f864004c3b0 con 0x7f864c15ca80 2023-10-16T08:52:00.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.284+0000 7f86337fe640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f863806aec0 0x7f863806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.284+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86400ac090 con 0x7f864c15ca80 2023-10-16T08:52:00.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.285+0000 7f864affd640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f863806aec0 0x7f863806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.285+0000 7f864affd640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f863806aec0 0x7f863806d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f864c0afe10 tx=0x7f863c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:00.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.289+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f864c0b2b00 con 0x7f864c15ca80 2023-10-16T08:52:00.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.479+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f864c0b2b00 con 0x7f864c15ca80 2023-10-16T08:52:00.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.480+0000 7f86337fe640 1 -- 172.21.15.94:0/1280377849 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f864c0b2b00 con 0x7f864c15ca80 2023-10-16T08:52:00.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:00.483 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":26,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:51:24.120033+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:00.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f863806aec0 msgr2=0x7f863806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f863806aec0 0x7f863806d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f864c0afe10 tx=0x7f863c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:00.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 msgr2=0x7f864c14efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 0x7f864c14efd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8640000c00 tx=0x7f8640004730 comp rx=0 tx=0).stop 2023-10-16T08:52:00.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 shutdown_connections 2023-10-16T08:52:00.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f863806aec0 0x7f863806d380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864c15ce60 0x7f864c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f864c15ca80 0x7f864c14efd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 --2- 172.21.15.94:0/1280377849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864c0b0720 0x7f864c15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 >> 172.21.15.94:0/1280377849 conn(0x7f864c06c1c0 msgr2=0x7f864c0ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 shutdown_connections 2023-10-16T08:52:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.483+0000 7f86513a9640 1 -- 172.21.15.94:0/1280377849 wait complete. 2023-10-16T08:52:00.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:52:00.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.712+0000 7f33556d1640 1 Processor -- start 2023-10-16T08:52:00.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.713+0000 7f33556d1640 1 -- start start 2023-10-16T08:52:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.714+0000 7f33556d1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f335015c9d0 0x7f33500cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.714+0000 7f33556d1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f33500d16a0 0x7f33500cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.714+0000 7f33556d1640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500b2f90 con 0x7f33500ce4d0 2023-10-16T08:52:00.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.714+0000 7f33556d1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500d0320 con 0x7f33500d16a0 2023-10-16T08:52:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.714+0000 7f33556d1640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500d0600 con 0x7f335015c9d0 2023-10-16T08:52:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f33500d16a0 0x7f33500cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f33500d16a0 0x7f33500cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52146/0 (socket says 172.21.15.94:52146) 2023-10-16T08:52:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 -- 172.21.15.94:0/360818192 learned_addr learned my addr 172.21.15.94:0/360818192 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:00.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334ffff640 1 --2- 172.21.15.94:0/360818192 >> v2:172.21.15.130:3300/0 conn(0x7f335015c9d0 0x7f33500cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 -- 172.21.15.94:0/360818192 >> v2:172.21.15.130:3300/0 conn(0x7f335015c9d0 msgr2=0x7f33500cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 --2- 172.21.15.94:0/360818192 >> v2:172.21.15.130:3300/0 conn(0x7f335015c9d0 0x7f33500cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 -- 172.21.15.94:0/360818192 >> v1:172.21.15.130:6789/0 conn(0x7f33500ce4d0 legacy=0x7f3350160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:00.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.715+0000 7f334f7fe640 1 -- 172.21.15.94:0/360818192 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500d08e0 con 0x7f33500d16a0 2023-10-16T08:52:00.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.716+0000 7f334f7fe640 1 --2- 172.21.15.94:0/360818192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33500d16a0 0x7f33500cf140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f33500d26b0 tx=0x7f333802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf96da423354ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:00.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.716+0000 7f334effd640 1 -- 172.21.15.94:0/360818192 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338031870 con 0x7f33500d16a0 2023-10-16T08:52:00.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.716+0000 7f334effd640 1 -- 172.21.15.94:0/360818192 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380319d0 con 0x7f33500d16a0 2023-10-16T08:52:00.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.716+0000 7f334effd640 1 -- 172.21.15.94:0/360818192 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338031d60 con 0x7f33500d16a0 2023-10-16T08:52:00.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 -- 172.21.15.94:0/360818192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33500d16a0 msgr2=0x7f33500cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 --2- 172.21.15.94:0/360818192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33500d16a0 0x7f33500cf140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f33500d26b0 tx=0x7f333802b910 comp rx=0 tx=0).stop 2023-10-16T08:52:00.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 -- 172.21.15.94:0/360818192 shutdown_connections 2023-10-16T08:52:00.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 --2- 172.21.15.94:0/360818192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f33500d16a0 0x7f33500cf140 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 --2- 172.21.15.94:0/360818192 >> v2:172.21.15.130:3300/0 conn(0x7f335015c9d0 0x7f33500cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 -- 172.21.15.94:0/360818192 >> 172.21.15.94:0/360818192 conn(0x7f335009bad0 msgr2=0x7f33500d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:00.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 -- 172.21.15.94:0/360818192 shutdown_connections 2023-10-16T08:52:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.717+0000 7f33556d1640 1 -- 172.21.15.94:0/360818192 wait complete. 2023-10-16T08:52:00.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.719+0000 7f33556d1640 1 Processor -- start 2023-10-16T08:52:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.719+0000 7f33556d1640 1 -- start start 2023-10-16T08:52:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f33556d1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33500ce4d0 0x7f335015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f33556d1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33500d16a0 0x7f33500b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f33556d1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 0x7f33500afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f33556d1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350160140 con 0x7f335015c9d0 2023-10-16T08:52:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f33556d1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335015eb60 con 0x7f33500ce4d0 2023-10-16T08:52:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f33556d1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335015ee40 con 0x7f33500d16a0 2023-10-16T08:52:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f3354ed0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 0x7f33500afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.720+0000 7f3354ed0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 0x7f33500afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52162/0 (socket says 172.21.15.94:52162) 2023-10-16T08:52:00.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 -- 172.21.15.94:0/949107784 learned_addr learned my addr 172.21.15.94:0/949107784 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:00.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f334ffff640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33500ce4d0 0x7f335015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f334f7fe640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33500d16a0 0x7f33500b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 -- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33500d16a0 msgr2=0x7f33500b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33500d16a0 0x7f33500b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 -- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33500ce4d0 msgr2=0x7f335015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33500ce4d0 0x7f335015fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 -- 172.21.15.94:0/949107784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380094d0 con 0x7f335015c9d0 2023-10-16T08:52:00.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f3354ed0640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 0x7f33500afcd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f334800c780 tx=0x7f334800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:00.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.721+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348004b60 con 0x7f335015c9d0 2023-10-16T08:52:00.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.722+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334800ce90 con 0x7f335015c9d0 2023-10-16T08:52:00.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.722+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335015f120 con 0x7f335015c9d0 2023-10-16T08:52:00.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.722+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334800a850 con 0x7f335015c9d0 2023-10-16T08:52:00.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.722+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335015f6e0 con 0x7f335015c9d0 2023-10-16T08:52:00.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.723+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335015f8d0 con 0x7f335015c9d0 2023-10-16T08:52:00.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.724+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f334800a9b0 con 0x7f335015c9d0 2023-10-16T08:52:00.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.725+0000 7f334cff9640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f333006ae70 0x7f333006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:00.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.725+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3348089a60 con 0x7f335015c9d0 2023-10-16T08:52:00.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.725+0000 7f334ffff640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f333006ae70 0x7f333006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:00.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.726+0000 7f334ffff640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f333006ae70 0x7f333006d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3340006fd0 tx=0x7f3340008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:00.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.729+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3348054820 con 0x7f335015c9d0 2023-10-16T08:52:00.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.960+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f335004e9b0 con 0x7f335015c9d0 2023-10-16T08:52:00.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.961+0000 7f334cff9640 1 -- 172.21.15.94:0/949107784 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f3348057e40 con 0x7f335015c9d0 2023-10-16T08:52:00.963 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:52:00.963 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:52:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f333006ae70 msgr2=0x7f333006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f333006ae70 0x7f333006d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3340006fd0 tx=0x7f3340008040 comp rx=0 tx=0).stop 2023-10-16T08:52:00.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 msgr2=0x7f33500afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 0x7f33500afcd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f334800c780 tx=0x7f334800cc40 comp rx=0 tx=0).stop 2023-10-16T08:52:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 shutdown_connections 2023-10-16T08:52:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f335015c9d0 0x7f33500afcd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33500d16a0 0x7f33500b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f333006ae70 0x7f333006d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 --2- 172.21.15.94:0/949107784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33500ce4d0 0x7f335015fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 >> 172.21.15.94:0/949107784 conn(0x7f335009bad0 msgr2=0x7f33500b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 shutdown_connections 2023-10-16T08:52:00.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:00.963+0000 7f33556d1640 1 -- 172.21.15.94:0/949107784 wait complete. 2023-10-16T08:52:01.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T08:51:18.896750+0000', 'modified': '2023-10-16T08:51:46.124847+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6835/3616835354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 3616835354}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 3616835354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T08:52:01.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T08:52:01.386 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T08:52:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.607+0000 7f378aada640 1 Processor -- start 2023-10-16T08:52:01.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.607+0000 7f378aada640 1 -- start start 2023-10-16T08:52:01.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.608+0000 7f378aada640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f37840b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.608+0000 7f378aada640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37840ced10 0x7f378406c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.608+0000 7f378aada640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840c8a10 con 0x7f37840b2e90 2023-10-16T08:52:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.608+0000 7f378aada640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3784159b40 con 0x7f37840ced10 2023-10-16T08:52:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.608+0000 7f378aada640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378415d1a0 con 0x7f37840ad970 2023-10-16T08:52:01.612 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37840ced10 0x7f378406c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.613 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37840ced10 0x7f378406c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52164/0 (socket says 172.21.15.94:52164) 2023-10-16T08:52:01.613 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 -- 172.21.15.94:0/3459940302 learned_addr learned my addr 172.21.15.94:0/3459940302 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:01.613 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f3789ad8640 1 --2- 172.21.15.94:0/3459940302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f37840b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.613 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 -- 172.21.15.94:0/3459940302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 msgr2=0x7f37840b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 --2- 172.21.15.94:0/3459940302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f37840b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 -- 172.21.15.94:0/3459940302 >> v1:172.21.15.130:6789/0 conn(0x7f37840b2e90 legacy=0x7f37840ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.609+0000 7f378a2d9640 1 -- 172.21.15.94:0/3459940302 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378415d3f0 con 0x7f37840ced10 2023-10-16T08:52:01.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.610+0000 7f378a2d9640 1 --2- 172.21.15.94:0/3459940302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840ced10 0x7f378406c050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f377c009e50 tx=0x7f377c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b5f5f3b976626f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f3788ad6640 1 -- 172.21.15.94:0/3459940302 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c02c9e0 con 0x7f37840ced10 2023-10-16T08:52:01.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f3788ad6640 1 -- 172.21.15.94:0/3459940302 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c02cb40 con 0x7f37840ced10 2023-10-16T08:52:01.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f3788ad6640 1 -- 172.21.15.94:0/3459940302 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0343f0 con 0x7f37840ced10 2023-10-16T08:52:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 -- 172.21.15.94:0/3459940302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840ced10 msgr2=0x7f378406c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 --2- 172.21.15.94:0/3459940302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840ced10 0x7f378406c050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f377c009e50 tx=0x7f377c02be40 comp rx=0 tx=0).stop 2023-10-16T08:52:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 -- 172.21.15.94:0/3459940302 shutdown_connections 2023-10-16T08:52:01.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 --2- 172.21.15.94:0/3459940302 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840ced10 0x7f378406c050 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 --2- 172.21.15.94:0/3459940302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f37840b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 -- 172.21.15.94:0/3459940302 >> 172.21.15.94:0/3459940302 conn(0x7f3784069fc0 msgr2=0x7f378406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.611+0000 7f378aada640 1 -- 172.21.15.94:0/3459940302 shutdown_connections 2023-10-16T08:52:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.612+0000 7f378aada640 1 -- 172.21.15.94:0/3459940302 wait complete. 2023-10-16T08:52:01.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.613+0000 7f378aada640 1 Processor -- start 2023-10-16T08:52:01.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.613+0000 7f378aada640 1 -- start start 2023-10-16T08:52:01.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.614+0000 7f378aada640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f378415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.614+0000 7f378aada640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 0x7f37840c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.614+0000 7f378aada640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37840ced10 0x7f37841591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.614+0000 7f378aada640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378415b3a0 con 0x7f37840b2e90 2023-10-16T08:52:01.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.614+0000 7f378aada640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378415b680 con 0x7f37840ced10 2023-10-16T08:52:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.614+0000 7f378aada640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378415b960 con 0x7f37840ad970 2023-10-16T08:52:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 0x7f37840c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 0x7f37840c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52172/0 (socket says 172.21.15.94:52172) 2023-10-16T08:52:01.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 -- 172.21.15.94:0/2913345086 learned_addr learned my addr 172.21.15.94:0/2913345086 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f3789ad8640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f378415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f378a2d9640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37840ced10 0x7f37841591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 -- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 msgr2=0x7f378415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f378415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 -- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37840ced10 msgr2=0x7f37841591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37840ced10 0x7f37841591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.615+0000 7f37892d7640 1 -- 172.21.15.94:0/2913345086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c009b30 con 0x7f37840b2e90 2023-10-16T08:52:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.616+0000 7f37892d7640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 0x7f37840c4860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f377400b3f0 tx=0x7f377400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.616+0000 7f377a7fc640 1 -- 172.21.15.94:0/2913345086 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774011830 con 0x7f37840b2e90 2023-10-16T08:52:01.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.616+0000 7f377a7fc640 1 -- 172.21.15.94:0/2913345086 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774011990 con 0x7f37840b2e90 2023-10-16T08:52:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.616+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378415bc40 con 0x7f37840b2e90 2023-10-16T08:52:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.616+0000 7f377a7fc640 1 -- 172.21.15.94:0/2913345086 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774011d40 con 0x7f37840b2e90 2023-10-16T08:52:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.616+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784159720 con 0x7f37840b2e90 2023-10-16T08:52:01.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.618+0000 7f377a7fc640 1 -- 172.21.15.94:0/2913345086 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f377401a400 con 0x7f37840b2e90 2023-10-16T08:52:01.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.619+0000 7f377a7fc640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376806ae70 0x7f376806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.619+0000 7f377a7fc640 1 -- 172.21.15.94:0/2913345086 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3774089920 con 0x7f37840b2e90 2023-10-16T08:52:01.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.619+0000 7f3789ad8640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376806ae70 0x7f376806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.620+0000 7f378e9ac740 1 Processor -- start 2023-10-16T08:52:01.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.620+0000 7f3789ad8640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376806ae70 0x7f376806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f378000b9f0 tx=0x7f3780008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.620+0000 7f378e9ac740 1 -- start start 2023-10-16T08:52:01.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x5622775b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 0x5622775e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775b75b0 0x5622775e7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f378e9ac740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622774d77a0 con 0x5622775e4550 2023-10-16T08:52:01.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x562277529740 con 0x5622775b75b0 2023-10-16T08:52:01.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x562277526e30 con 0x5622775e4170 2023-10-16T08:52:01.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f37892d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 0x5622775e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f37892d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 0x5622775e6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52184/0 (socket says 172.21.15.94:52184) 2023-10-16T08:52:01.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f37892d7640 1 -- 172.21.15.94:0/1161422610 learned_addr learned my addr 172.21.15.94:0/1161422610 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:01.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.621+0000 7f3789ad8640 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x5622775b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37892d7640 1 -- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 msgr2=0x5622775b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f378a2d9640 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775b75b0 0x5622775e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37892d7640 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x5622775b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37892d7640 1 -- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775b75b0 msgr2=0x5622775e7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37892d7640 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775b75b0 0x5622775e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37892d7640 1 -- 172.21.15.94:0/1161422610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622774e6910 con 0x5622775e4550 2023-10-16T08:52:01.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f3789ad8640 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x5622775b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:01.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37892d7640 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 0x5622775e6f00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3774087960 tx=0x7f37740589f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9329ab9d5cdf9686 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37677fe640 1 -- 172.21.15.94:0/1161422610 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377406f070 con 0x5622775e4550 2023-10-16T08:52:01.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37677fe640 1 -- 172.21.15.94:0/1161422610 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377405c170 con 0x5622775e4550 2023-10-16T08:52:01.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.622+0000 7f37677fe640 1 -- 172.21.15.94:0/1161422610 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774060530 con 0x5622775e4550 2023-10-16T08:52:01.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 -- 172.21.15.94:0/1161422610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 msgr2=0x5622775e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 0x5622775e6f00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3774087960 tx=0x7f37740589f0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 -- 172.21.15.94:0/1161422610 shutdown_connections 2023-10-16T08:52:01.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775b75b0 0x5622775e7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4550 0x5622775e6f00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1161422610 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x5622775b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 -- 172.21.15.94:0/1161422610 >> 172.21.15.94:0/1161422610 conn(0x5622775b9380 msgr2=0x562277601f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:01.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 -- 172.21.15.94:0/1161422610 shutdown_connections 2023-10-16T08:52:01.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.623+0000 7f378e9ac740 1 -- 172.21.15.94:0/1161422610 wait complete. 2023-10-16T08:52:01.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.624+0000 7f378e9ac740 1 -- start start 2023-10-16T08:52:01.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.624+0000 7f378e9ac740 1 Processor -- start 2023-10-16T08:52:01.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4170 0x562277602af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4550 0x5622775e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x562277522720 con 0x5622775ea120 2023-10-16T08:52:01.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622774c0970 con 0x5622775e4170 2023-10-16T08:52:01.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x5622774c0610 con 0x5622775e4550 2023-10-16T08:52:01.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378e9ac740 10 client.0 _ll_register_callbacks cb 0x5622774e29d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T08:52:01.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378a2d9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378a2d9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775faaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52198/0 (socket says 172.21.15.94:52198) 2023-10-16T08:52:01.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.625+0000 7f378a2d9640 1 -- 172.21.15.94:0/4080250053 learned_addr learned my addr 172.21.15.94:0/4080250053 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:01.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f3789ad8640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4170 0x562277602af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f37892d7640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4550 0x5622775e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378a2d9640 1 -- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4550 msgr2=0x5622775e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378a2d9640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4550 0x5622775e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378a2d9640 1 -- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4170 msgr2=0x562277602af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378a2d9640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4170 0x562277602af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378a2d9640 1 -- 172.21.15.94:0/4080250053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784159720 con 0x5622775ea120 2023-10-16T08:52:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378a2d9640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775faaf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f70 tx=0x7f377c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636cd6a5ef4e6a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f3764ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-10-16T08:52:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f3764ff9640 1 -- 172.21.15.94:0/4080250053 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c034900 con 0x5622775ea120 2023-10-16T08:52:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f3764ff9640 1 -- 172.21.15.94:0/4080250053 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f377c034a60 con 0x5622775ea120 2023-10-16T08:52:01.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.626+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562277549160 con 0x5622775ea120 2023-10-16T08:52:01.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f3764ff9640 1 -- 172.21.15.94:0/4080250053 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f377c034c20 con 0x5622775ea120 2023-10-16T08:52:01.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 10 client.4872 fetch_fsmap learned FSMap version 8 2023-10-16T08:52:01.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x562277520da0 con 0x5622775ea120 2023-10-16T08:52:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f3764ff9640 1 -- 172.21.15.94:0/4080250053 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562277549160 con 0x5622775ea120 2023-10-16T08:52:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f3764ff9640 1 -- 172.21.15.94:0/4080250053 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f377c047480 con 0x5622775ea120 2023-10-16T08:52:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 10 client.4872 fetch_fsmap finished waiting for FSMap version 8 2023-10-16T08:52:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 10 client.4872 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T08:52:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 20 client.4872 populate_metadata read hostname 'smithi094' 2023-10-16T08:52:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x5622775e8440 0x56227761f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 4 client.4872 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T08:52:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.627+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 --> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622774f4cc0 con 0x5622775e8440 2023-10-16T08:52:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.628+0000 7f3789ad8640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x5622775e8440 0x56227761f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.629+0000 7f3789ad8640 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x5622775e8440 0x56227761f4a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9eddc60d689d0e3 server_cookie=79b3314460041061 in_seq=0 out_seq=0 2023-10-16T08:52:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.629+0000 7f3764ff9640 10 client.4872 ms_handle_connect on v2:172.21.15.130:6834/3616835354 2023-10-16T08:52:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.630+0000 7f3764ff9640 1 -- 172.21.15.94:0/4080250053 <== mds.0 v2:172.21.15.130:6834/3616835354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5622774f4cc0 con 0x5622775e8440 2023-10-16T08:52:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.630+0000 7f3764ff9640 10 client.4872 handle_command_reply: tid=0 2023-10-16T08:52:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.630+0000 7f378e9ac740 1 client.4872 shutdown 2023-10-16T08:52:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.630+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 msgr2=0x5622775faaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.630+0000 7f378e9ac740 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775faaf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f70 tx=0x7f377c004ab0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 shutdown_connections 2023-10-16T08:52:01.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x5622775e8440 0x56227761f4a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775faaf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4550 0x5622775e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 --2- 172.21.15.94:0/4080250053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4170 0x562277602af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f3764ff9640 0 client.4872 ms_handle_reset on v2:172.21.15.130:6834/3616835354 2023-10-16T08:52:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 >> 172.21.15.94:0/4080250053 conn(0x5622775b75b0 msgr2=0x5622775baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 shutdown_connections 2023-10-16T08:52:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 1 -- 172.21.15.94:0/4080250053 wait complete. 2023-10-16T08:52:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.631+0000 7f378e9ac740 20 client.4872 trim_cache size 0 max 16384 2023-10-16T08:52:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.647+0000 7f378e9ac740 1 Processor -- start 2023-10-16T08:52:01.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.647+0000 7f378e9ac740 1 -- start start 2023-10-16T08:52:01.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x562277604520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277623a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378e9ac740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x562277286f20 con 0x5622775ea120 2023-10-16T08:52:01.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x562277623fd0 con 0x5622775e4550 2023-10-16T08:52:01.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x5622775e9a40 con 0x5622775e4170 2023-10-16T08:52:01.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378a2d9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378a2d9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52200/0 (socket says 172.21.15.94:52200) 2023-10-16T08:52:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.648+0000 7f378a2d9640 1 -- 172.21.15.94:0/762124541 learned_addr learned my addr 172.21.15.94:0/762124541 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f37892d7640 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277623a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f378a2d9640 1 -- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 msgr2=0x562277604520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f378a2d9640 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x562277604520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f378a2d9640 1 -- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 msgr2=0x562277623a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f378a2d9640 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277623a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f378a2d9640 1 -- 172.21.15.94:0/762124541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622774bfb80 con 0x5622775ea120 2023-10-16T08:52:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f378a2d9640 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775b60f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f40 tx=0x7f377c040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14feb5d268e698b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f3767fff640 1 -- 172.21.15.94:0/762124541 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c02c4c0 con 0x5622775ea120 2023-10-16T08:52:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f3767fff640 1 -- 172.21.15.94:0/762124541 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c042070 con 0x5622775ea120 2023-10-16T08:52:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.649+0000 7f3767fff640 1 -- 172.21.15.94:0/762124541 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c047a10 con 0x5622775ea120 2023-10-16T08:52:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 -- 172.21.15.94:0/762124541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 msgr2=0x5622775b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775b60f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f40 tx=0x7f377c040070 comp rx=0 tx=0).stop 2023-10-16T08:52:01.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 -- 172.21.15.94:0/762124541 shutdown_connections 2023-10-16T08:52:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775ea120 0x5622775b60f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277623a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 --2- 172.21.15.94:0/762124541 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775e4170 0x562277604520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 -- 172.21.15.94:0/762124541 >> 172.21.15.94:0/762124541 conn(0x5622775b75b0 msgr2=0x5622775eae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 -- 172.21.15.94:0/762124541 shutdown_connections 2023-10-16T08:52:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.650+0000 7f378e9ac740 1 -- 172.21.15.94:0/762124541 wait complete. 2023-10-16T08:52:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.651+0000 7f378e9ac740 1 -- start start 2023-10-16T08:52:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.651+0000 7f378e9ac740 1 Processor -- start 2023-10-16T08:52:01.663 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 0x562277666ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277605410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775ea120 0x562277605950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622775df870 con 0x5622775e4170 2023-10-16T08:52:01.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x562277602370 con 0x5622775e4550 2023-10-16T08:52:01.664 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x56227766a230 con 0x5622775ea120 2023-10-16T08:52:01.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f378e9ac740 10 client.0 _ll_register_callbacks cb 0x7f378406b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T08:52:01.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 0x562277666ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 0x562277666ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52202/0 (socket says 172.21.15.94:52202) 2023-10-16T08:52:01.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 -- 172.21.15.94:0/1190992106 learned_addr learned my addr 172.21.15.94:0/1190992106 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 -- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775ea120 msgr2=0x562277605950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775ea120 0x562277605950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 -- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 msgr2=0x562277605410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:01.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277605410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.652+0000 7f3789ad8640 1 -- 172.21.15.94:0/1190992106 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562277520da0 con 0x5622775e4170 2023-10-16T08:52:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f3789ad8640 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 0x562277666ce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f378000f5b0 tx=0x7f37800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1302951ad10c3ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f3764ff9640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-10-16T08:52:01.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f3764ff9640 1 -- 172.21.15.94:0/1190992106 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780027150 con 0x5622775e4170 2023-10-16T08:52:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f3764ff9640 1 -- 172.21.15.94:0/1190992106 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37800272b0 con 0x5622775e4170 2023-10-16T08:52:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f377405c170 con 0x5622775e4170 2023-10-16T08:52:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f3764ff9640 1 -- 172.21.15.94:0/1190992106 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3780027470 con 0x5622775e4170 2023-10-16T08:52:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f378e9ac740 10 client.4878 fetch_fsmap learned FSMap version 8 2023-10-16T08:52:01.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5622774e5170 con 0x5622775e4170 2023-10-16T08:52:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.653+0000 7f3764ff9640 1 -- 172.21.15.94:0/1190992106 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377405c170 con 0x5622775e4170 2023-10-16T08:52:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f3764ff9640 1 -- 172.21.15.94:0/1190992106 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f3780021040 con 0x5622775e4170 2023-10-16T08:52:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f378e9ac740 10 client.4878 fetch_fsmap finished waiting for FSMap version 8 2023-10-16T08:52:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f378e9ac740 10 client.4878 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T08:52:01.669 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f378e9ac740 20 client.4878 populate_metadata read hostname 'smithi094' 2023-10-16T08:52:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x56227766d4a0 0x56227761b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f378e9ac740 4 client.4878 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T08:52:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 --> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56227751b700 con 0x56227766d4a0 2023-10-16T08:52:01.670 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.654+0000 7f37892d7640 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x56227766d4a0 0x56227761b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.655+0000 7f37892d7640 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x56227766d4a0 0x56227761b1f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cec147beabb283a server_cookie=83b680a7f6997b36 in_seq=0 out_seq=0 2023-10-16T08:52:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.655+0000 7f3764ff9640 10 client.4878 ms_handle_connect on v2:172.21.15.130:6834/3616835354 2023-10-16T08:52:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.655+0000 7f3764ff9640 1 -- 172.21.15.94:0/1190992106 <== mds.0 v2:172.21.15.130:6834/3616835354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56227751b700 con 0x56227766d4a0 2023-10-16T08:52:01.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.655+0000 7f3764ff9640 10 client.4878 handle_command_reply: tid=0 2023-10-16T08:52:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.655+0000 7f378e9ac740 1 client.4878 shutdown 2023-10-16T08:52:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 msgr2=0x562277666ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 0x562277666ce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f378000f5b0 tx=0x7f37800046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 shutdown_connections 2023-10-16T08:52:01.673 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:6834/3616835354,v1:172.21.15.130:6835/3616835354] conn(0x56227766d4a0 0x56227761b1f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5622775ea120 0x562277605950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5622775e4550 0x562277605410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f3764ff9640 0 client.4878 ms_handle_reset on v2:172.21.15.130:6834/3616835354 2023-10-16T08:52:01.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 --2- 172.21.15.94:0/1190992106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5622775e4170 0x562277666ce0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 >> 172.21.15.94:0/1190992106 conn(0x5622775b75b0 msgr2=0x5622776146e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 shutdown_connections 2023-10-16T08:52:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 1 -- 172.21.15.94:0/1190992106 wait complete. 2023-10-16T08:52:01.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378e9ac740 20 client.4878 trim_cache size 0 max 16384 2023-10-16T08:52:01.676 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:52:01.676 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "d7b7598f-7f16-4780-92e5-7e8a731f0195", 2023-10-16T08:52:01.676 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2023-10-16T08:52:01.676 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4293, 2023-10-16T08:52:01.676 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2023-10-16T08:52:01.677 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2023-10-16T08:52:01.677 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2023-10-16T08:52:01.677 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 42.202592889000002, 2023-10-16T08:52:01.677 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 8, 2023-10-16T08:52:01.678 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 27, 2023-10-16T08:52:01.678 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 26, 2023-10-16T08:52:01.678 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 47.238210809000002 2023-10-16T08:52:01.678 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:52:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.656+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376806ae70 msgr2=0x7f376806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376806ae70 0x7f376806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f378000b9f0 tx=0x7f3780008040 comp rx=0 tx=0).stop 2023-10-16T08:52:01.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 msgr2=0x7f37840c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 0x7f37840c4860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f377400b3f0 tx=0x7f377400b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 shutdown_connections 2023-10-16T08:52:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f376806ae70 0x7f376806d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37840ced10 0x7f37841591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37840b2e90 0x7f37840c4860 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 --2- 172.21.15.94:0/2913345086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37840ad970 0x7f378415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 >> 172.21.15.94:0/2913345086 conn(0x7f3784069fc0 msgr2=0x7f37840ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 shutdown_connections 2023-10-16T08:52:01.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:01.657+0000 7f378aada640 1 -- 172.21.15.94:0/2913345086 wait complete. 2023-10-16T08:52:01.683 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-16T08:52:01.693 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-16T08:52:01.694 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-16T08:52:01.694 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-16T08:52:01.694 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T08:52:01.695 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:01.695 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-16T08:52:01.695 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T08:52:01.695 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:01.696 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-16T08:52:01.696 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T08:52:01.696 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:01.697 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-16T08:52:01.697 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T08:52:01.697 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:01.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:01.698 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-16T08:52:01.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:01.760 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-10-16T08:52:01.848 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-10-16T08:52:01.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T08:52:01.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:01.852 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-16T08:52:01.910 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-16T08:52:01.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:01.911 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T08:52:01.960 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:52:01.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:52:02.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:02.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2023-10-16T08:52:02.160 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-16T08:52:02.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T08:52:02.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.350+0000 7fad1a755640 1 Processor -- start 2023-10-16T08:52:02.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.350+0000 7fad1a755640 1 -- start start 2023-10-16T08:52:02.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.352+0000 7fad1a755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 0x7fad140701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.352+0000 7fad1a755640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad140707f0 con 0x7fad1415ad00 2023-10-16T08:52:02.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.352+0000 7fad1a755640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad14070ad0 con 0x7fad1415f040 2023-10-16T08:52:02.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.352+0000 7fad1a755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1415b1d0 con 0x7fad140b0010 2023-10-16T08:52:02.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.352+0000 7fad137fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fad1415ad00 0x7fad140b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:48278/0 (socket says 172.21.15.94:48278) 2023-10-16T08:52:02.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.352+0000 7fad137fe640 1 -- 172.21.15.94:0/3212408756 learned_addr learned my addr 172.21.15.94:0/3212408756 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:02.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad13fff640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 0x7fad140701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127416676 0 0) 0x7fad140707f0 con 0x7fad1415ad00 2023-10-16T08:52:02.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad00003520 con 0x7fad1415ad00 2023-10-16T08:52:02.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3087211932 0 0) 0x7fad00003520 con 0x7fad1415ad00 2023-10-16T08:52:02.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 msgr2=0x7fad140701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:02.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 0x7fad140701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 >> v1:172.21.15.130:6789/0 conn(0x7fad1415f040 legacy=0x7fad1415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1415b4b0 con 0x7fad1415ad00 2023-10-16T08:52:02.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7facfc001670 con 0x7fad1415ad00 2023-10-16T08:52:02.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 >> v1:172.21.15.94:6789/0 conn(0x7fad1415ad00 legacy=0x7fad140b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 0x7fad00003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad00003f90 0x7fad000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00004d00 0x7fad00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1415b1d0 con 0x7fad00003f90 2023-10-16T08:52:02.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0000bae0 con 0x7fad00004d00 2023-10-16T08:52:02.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.353+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0000bca0 con 0x7fad140b0010 2023-10-16T08:52:02.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad137fe640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad00003f90 0x7fad000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad13fff640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 0x7fad00003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad18cf2640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00004d00 0x7fad00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad137fe640 1 -- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 msgr2=0x7fad00003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:02.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad137fe640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140b0010 0x7fad00003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad137fe640 1 -- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00004d00 msgr2=0x7fad00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:02.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad137fe640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00004d00 0x7fad00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.354+0000 7fad137fe640 1 -- 172.21.15.94:0/3212408756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00003520 con 0x7fad00003f90 2023-10-16T08:52:02.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.355+0000 7fad137fe640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad00003f90 0x7fad000047c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c210 tx=0x7fad000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df9b58ef21915ec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:02.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.355+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc005ad0 con 0x7fad00003f90 2023-10-16T08:52:02.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.355+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc005c30 con 0x7fad00003f90 2023-10-16T08:52:02.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.355+0000 7fad12ffd640 1 -- 172.21.15.94:0/3212408756 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc02ca00 con 0x7fad00003f90 2023-10-16T08:52:02.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad1a755640 1 -- 172.21.15.94:0/3212408756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad00003f90 msgr2=0x7fad000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad1a755640 1 --2- 172.21.15.94:0/3212408756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad00003f90 0x7fad000047c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c210 tx=0x7fad000057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad18cf2640 1 -- 172.21.15.94:0/3212408756 reap_dead start 2023-10-16T08:52:02.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad1a755640 1 -- 172.21.15.94:0/3212408756 shutdown_connections 2023-10-16T08:52:02.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad1a755640 1 -- 172.21.15.94:0/3212408756 >> 172.21.15.94:0/3212408756 conn(0x7fad1406c1c0 msgr2=0x7fad1406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:02.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad1a755640 1 -- 172.21.15.94:0/3212408756 shutdown_connections 2023-10-16T08:52:02.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.356+0000 7fad1a755640 1 -- 172.21.15.94:0/3212408756 wait complete. 2023-10-16T08:52:02.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.358+0000 7fad1a755640 1 Processor -- start 2023-10-16T08:52:02.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.358+0000 7fad1a755640 1 -- start start 2023-10-16T08:52:02.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad1a755640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00003f90 0x7fad14157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad1a755640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 0x7fad1415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad1a755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140c81b0 0x7fad1415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad1a755640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140c5b80 con 0x7fad140c7d30 2023-10-16T08:52:02.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad1a755640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140c3ce0 con 0x7fad00003f90 2023-10-16T08:52:02.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad1a755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140c3f50 con 0x7fad140c81b0 2023-10-16T08:52:02.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 0x7fad1415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 0x7fad1415e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:52206/0 (socket says 172.21.15.94:52206) 2023-10-16T08:52:02.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad137fe640 1 -- 172.21.15.94:0/2103624165 learned_addr learned my addr 172.21.15.94:0/2103624165 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:02.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad18cf2640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140c81b0 0x7fad1415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.359+0000 7fad137fe640 1 -- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140c81b0 msgr2=0x7fad1415e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad137fe640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140c81b0 0x7fad1415e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad137fe640 1 -- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00003f90 msgr2=0x7fad14157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad137fe640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00003f90 0x7fad14157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad137fe640 1 -- 172.21.15.94:0/2103624165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140c4230 con 0x7fad140c7d30 2023-10-16T08:52:02.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad137fe640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 0x7fad1415e1e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c270 tx=0x7facfc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:02.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc03c040 con 0x7fad140c7d30 2023-10-16T08:52:02.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc02cc10 con 0x7fad140c7d30 2023-10-16T08:52:02.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad140c4510 con 0x7fad140c7d30 2023-10-16T08:52:02.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc007070 con 0x7fad140c7d30 2023-10-16T08:52:02.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.360+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad140c4ad0 con 0x7fad140c7d30 2023-10-16T08:52:02.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.361+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad14073ef0 con 0x7fad140c7d30 2023-10-16T08:52:02.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.362+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7facfc032070 con 0x7fad140c7d30 2023-10-16T08:52:02.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.363+0000 7fad10ff9640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7facf406ae70 0x7facf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:02.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.363+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7facfc0aae10 con 0x7fad140c7d30 2023-10-16T08:52:02.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.363+0000 7fad13fff640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7facf406ae70 0x7facf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:02.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.364+0000 7fad13fff640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7facf406ae70 0x7facf406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad141f12e0 tx=0x7fad04009750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:02.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.367+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7facfc0ae030 con 0x7fad140c7d30 2023-10-16T08:52:02.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.595+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad140afb00 con 0x7fad140c7d30 2023-10-16T08:52:02.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.596+0000 7fad10ff9640 1 -- 172.21.15.94:0/2103624165 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7facfc046070 con 0x7fad140c7d30 2023-10-16T08:52:02.598 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T08:52:02.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7facf406ae70 msgr2=0x7facf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7facf406ae70 0x7facf406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad141f12e0 tx=0x7fad04009750 comp rx=0 tx=0).stop 2023-10-16T08:52:02.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 msgr2=0x7fad1415e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:02.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 0x7fad1415e1e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c270 tx=0x7facfc001a00 comp rx=0 tx=0).stop 2023-10-16T08:52:02.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 shutdown_connections 2023-10-16T08:52:02.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad140c81b0 0x7fad1415e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad140c7d30 0x7fad1415e1e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7facf406ae70 0x7facf406d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 --2- 172.21.15.94:0/2103624165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad00003f90 0x7fad14157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:02.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.598+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 >> 172.21.15.94:0/2103624165 conn(0x7fad1406c1c0 msgr2=0x7fad140cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:02.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.599+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 shutdown_connections 2023-10-16T08:52:02.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:02.599+0000 7fad1a755640 1 -- 172.21.15.94:0/2103624165 wait complete. 2023-10-16T08:52:02.619 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T08:52:02.619 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T08:52:02.619 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2023-10-16T08:52:02.620 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T08:52:02.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:02.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T08:52:02.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T08:52:02.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T08:52:02.621 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T08:52:02.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:02.622 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2023-10-16T08:52:02.674 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:02.674 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:02.674 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:02.675 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:02.675 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:02.675 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:02.675 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:02.675 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:02.676 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2023-10-16T08:52:02.676 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:02.676 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:02.676 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2023-10-16T08:52:02.676 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:02.677 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:02.677 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T08:52:02.677 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:02.677 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T08:52:02.677 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42355sec preferred_lft 42355sec 2023-10-16T08:52:02.678 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2023-10-16T08:52:02.678 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:02.679 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T08:52:02.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:02.680 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:02.680 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:02.680 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2023-10-16T08:52:02.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2023-10-16T08:52:02.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2023-10-16T08:52:02.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T08:52:02.682 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:02.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:02.900 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T08:52:02.977 INFO:teuthology.orchestra.run.smithi094.stdout:1 2023-10-16T08:52:02.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:02.981 DEBUG:teuthology.orchestra.run.smithi094:> route 2023-10-16T08:52:03.033 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2023-10-16T08:52:03.033 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T08:52:03.033 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T08:52:03.034 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T08:52:03.034 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T08:52:03.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:03.035 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:03.035 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:03.035 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T08:52:03.035 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T08:52:03.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T08:52:03.036 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:03.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:03.210 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-16T08:52:03.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:03.265 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2023-10-16T08:52:03.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:03.319 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:03.320 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:03.320 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:03.320 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T08:52:03.320 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:03.464 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T08:52:03.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:03.465 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:03.465 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:03.466 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T08:52:03.466 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T08:52:03.466 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T08:52:03.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T08:52:03.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T08:52:03.467 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:03.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:03.727 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:03.727 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:03.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2023-10-16T08:52:03.728 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T08:52:03.728 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:03.893 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-16T08:52:03.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:03.894 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:03.945 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T08:52:03.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:03.946 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:03.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:52:04.091 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:04.142 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:52:04.143 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:52:04.143 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:52:04.143 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:52:04.143 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:52:04.143 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:52:04.144 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:52:04.144 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:52:04.144 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:52:04.144 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:52:04.144 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:52:04.145 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:04.145 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:52:04.145 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:52:04.145 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:52:04.145 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:52:04.146 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:04.146 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:04.146 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:52:04.147 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:04.147 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:04.147 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:04.147 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:52:04.147 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:52:04.148 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:52:04.148 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:52:04.148 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:52:04.148 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:52:04.148 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:52:04.149 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:04.149 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:04.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:04.150 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:52:04.190 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T08:52:04.190 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-16T08:52:04.242 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:52:04.322 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:04.363 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:52:04.363 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:52:04.364 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:52:04.364 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:52:04.364 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:52:04.364 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:52:04.364 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:52:04.365 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:52:04.365 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:52:04.365 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:52:04.365 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:52:04.366 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:04.366 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:52:04.366 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:52:04.366 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:52:04.366 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:52:04.367 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:04.367 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:04.367 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:52:04.367 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:04.367 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:04.368 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:04.368 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:52:04.368 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:52:04.369 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:52:04.369 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:52:04.369 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:52:04.369 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:52:04.369 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:52:04.370 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:04.370 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:04.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:04.371 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:52:04.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2023-10-16T08:52:04.426+0000 7f3db400d480 -1 init, newargv = 0x559ca403ecc0 newargc=15 2023-10-16T08:52:04.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[96013]: starting ceph client 2023-10-16T08:52:04.441 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[96013]: starting fuse 2023-10-16T08:52:04.456 INFO:teuthology.orchestra.run.smithi094.stdout:39 2023-10-16T08:52:04.457 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-16T08:52:04.457 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2023-10-16T08:52:04.457 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2023-10-16T08:52:04.458 DEBUG:teuthology.orchestra.run.smithi094:> import re 2023-10-16T08:52:04.458 DEBUG:teuthology.orchestra.run.smithi094:> import os 2023-10-16T08:52:04.458 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2023-10-16T08:52:04.459 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:04.459 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2023-10-16T08:52:04.459 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-16T08:52:04.460 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2023-10-16T08:52:04.460 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-16T08:52:04.460 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:04.460 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2023-10-16T08:52:04.461 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2023-10-16T08:52:04.461 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2023-10-16T08:52:04.461 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2023-10-16T08:52:04.462 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:04.462 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2023-10-16T08:52:04.462 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T08:52:04.462 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T08:52:04.463 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T08:52:04.463 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2023-10-16T08:52:04.463 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2023-10-16T08:52:04.464 DEBUG:teuthology.orchestra.run.smithi094:> return f 2023-10-16T08:52:04.464 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T08:52:04.464 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:04.464 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2023-10-16T08:52:04.465 DEBUG:teuthology.orchestra.run.smithi094:> ' 2023-10-16T08:52:04.653 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.96013.asok 2023-10-16T08:52:04.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T08:52:04.667 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96013.asok 2023-10-16T08:52:04.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:04.668 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96013.asok status 2023-10-16T08:52:04.882 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:52:04.883 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2023-10-16T08:52:04.883 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T08:52:04.883 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T08:52:04.883 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2023-10-16T08:52:04.884 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2023-10-16T08:52:04.884 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-16T08:52:04.884 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "96013", 2023-10-16T08:52:04.884 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2023-10-16T08:52:04.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:04.885 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2023-10-16T08:52:04.885 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2023-10-16T08:52:04.885 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4893, 2023-10-16T08:52:04.885 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2023-10-16T08:52:04.885 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2023-10-16T08:52:04.886 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2023-10-16T08:52:04.886 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4893 2023-10-16T08:52:04.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:04.886 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:52:04.886 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:52:04.887 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:52:04.887 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1876713610 2023-10-16T08:52:04.887 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:52:04.887 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:04.887 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:52:04.888 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:52:04.888 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:52:04.888 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1876713610 2023-10-16T08:52:04.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:04.888 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4893 192.168.0.1:0/1876713610", 2023-10-16T08:52:04.888 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/1876713610", 2023-10-16T08:52:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2023-10-16T08:52:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 8, 2023-10-16T08:52:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 28, 2023-10-16T08:52:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2023-10-16T08:52:04.889 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2023-10-16T08:52:04.890 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2023-10-16T08:52:04.890 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:52:04.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T08:52:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.099+0000 7fc81b59e640 1 Processor -- start 2023-10-16T08:52:05.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.099+0000 7fc81b59e640 1 -- start start 2023-10-16T08:52:05.102 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.100+0000 7fc81b59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 0x7fc81c15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.100+0000 7fc81b59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc81c0cb400 0x7fc81c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81b59e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0c8e40 con 0x7fc81c0c8930 2023-10-16T08:52:05.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81b59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0c9090 con 0x7fc81c0cb400 2023-10-16T08:52:05.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81b59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c9370 con 0x7fc81c070400 2023-10-16T08:52:05.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc819d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc81c0c8930 0x7fc81c0cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55764/0 (socket says 172.21.15.94:55764) 2023-10-16T08:52:05.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc819d9b640 1 -- 172.21.15.94:0/1543809637 learned_addr learned my addr 172.21.15.94:0/1543809637 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81a59c640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 0x7fc81c15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236395167 0 0) 0x7fc81c0c8e40 con 0x7fc81c0c8930 2023-10-16T08:52:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81ad9d640 1 --2- 172.21.15.94:0/1543809637 >> v2:172.21.15.130:3300/0 conn(0x7fc81c0cb400 0x7fc81c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.101+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc804003520 con 0x7fc81c0c8930 2023-10-16T08:52:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787625680 0 0) 0x7fc804003520 con 0x7fc81c0c8930 2023-10-16T08:52:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 msgr2=0x7fc81c15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 0x7fc81c15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 >> v2:172.21.15.130:3300/0 conn(0x7fc81c0cb400 msgr2=0x7fc81c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:05.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 --2- 172.21.15.94:0/1543809637 >> v2:172.21.15.130:3300/0 conn(0x7fc81c0cb400 0x7fc81c0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0c9650 con 0x7fc81c0c8930 2023-10-16T08:52:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fc810001670 con 0x7fc81c0c8930 2023-10-16T08:52:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81ad9d640 1 --2- 172.21.15.94:0/1543809637 >> v2:172.21.15.130:3300/0 conn(0x7fc81c0cb400 0x7fc81c0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 >> v1:172.21.15.94:6789/0 conn(0x7fc81c0c8930 legacy=0x7fc81c0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc804003a50 0x7fc804003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 0x7fc804005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c9090 con 0x7fc8040047c0 2023-10-16T08:52:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c9370 con 0x7fc804003a50 2023-10-16T08:52:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80400bab0 con 0x7fc81c070400 2023-10-16T08:52:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc819d9b640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81ad9d640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 0x7fc804005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc819d9b640 1 -- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 msgr2=0x7fc804005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.103+0000 7fc819d9b640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c070400 0x7fc804005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.102+0000 7fc81a59c640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc804003a50 0x7fc804003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.103+0000 7fc819d9b640 1 -- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc804003a50 msgr2=0x7fc804003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.103+0000 7fc819d9b640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc804003a50 0x7fc804003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.103+0000 7fc819d9b640 1 -- 172.21.15.94:0/1543809637 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804003520 con 0x7fc8040047c0 2023-10-16T08:52:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.103+0000 7fc81a59c640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc804003a50 0x7fc804003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc819d9b640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc810001050 tx=0x7fc8040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140ebbb8d65244b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810005ad0 con 0x7fc8040047c0 2023-10-16T08:52:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810005c30 con 0x7fc8040047c0 2023-10-16T08:52:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81959a640 1 -- 172.21.15.94:0/1543809637 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81002c790 con 0x7fc8040047c0 2023-10-16T08:52:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81b59e640 1 -- 172.21.15.94:0/1543809637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8040047c0 msgr2=0x7fc804004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1543809637 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc810001050 tx=0x7fc8040057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81ad9d640 1 -- 172.21.15.94:0/1543809637 reap_dead start 2023-10-16T08:52:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81b59e640 1 -- 172.21.15.94:0/1543809637 shutdown_connections 2023-10-16T08:52:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.104+0000 7fc81b59e640 1 -- 172.21.15.94:0/1543809637 >> 172.21.15.94:0/1543809637 conn(0x7fc81c06a470 msgr2=0x7fc81c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.105+0000 7fc81b59e640 1 -- 172.21.15.94:0/1543809637 shutdown_connections 2023-10-16T08:52:05.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.105+0000 7fc81b59e640 1 -- 172.21.15.94:0/1543809637 wait complete. 2023-10-16T08:52:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.106+0000 7fc81b59e640 1 Processor -- start 2023-10-16T08:52:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.106+0000 7fc81b59e640 1 -- start start 2023-10-16T08:52:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.107+0000 7fc81b59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8040047c0 0x7fc81c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.107+0000 7fc81b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c150830 0x7fc81c0c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.107+0000 7fc81b59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 0x7fc81c15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.107+0000 7fc81b59e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c15a820 con 0x7fc81c159e60 2023-10-16T08:52:05.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.107+0000 7fc81b59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c152240 con 0x7fc81c150830 2023-10-16T08:52:05.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.107+0000 7fc81b59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c2350 con 0x7fc8040047c0 2023-10-16T08:52:05.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 0x7fc81c15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 0x7fc81c15a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51564/0 (socket says 172.21.15.94:51564) 2023-10-16T08:52:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 -- 172.21.15.94:0/1946406872 learned_addr learned my addr 172.21.15.94:0/1946406872 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81a59c640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8040047c0 0x7fc81c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc819d9b640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c150830 0x7fc81c0c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 -- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8040047c0 msgr2=0x7fc81c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8040047c0 0x7fc81c0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 -- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c150830 msgr2=0x7fc81c0c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c150830 0x7fc81c0c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 -- 172.21.15.94:0/1946406872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0c25d0 con 0x7fc81c159e60 2023-10-16T08:52:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.108+0000 7fc81ad9d640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 0x7fc81c15a2e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8140042e0 tx=0x7fc8140047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.109+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814007d60 con 0x7fc81c159e60 2023-10-16T08:52:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.109+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814014400 con 0x7fc81c159e60 2023-10-16T08:52:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.109+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140147b0 con 0x7fc81c159e60 2023-10-16T08:52:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.109+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0c28b0 con 0x7fc81c159e60 2023-10-16T08:52:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.109+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c0c2e70 con 0x7fc81c159e60 2023-10-16T08:52:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.110+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c1523d0 con 0x7fc81c159e60 2023-10-16T08:52:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.111+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc81401d3b0 con 0x7fc81c159e60 2023-10-16T08:52:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.112+0000 7fc80affd640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc7fc06ae70 0x7fc7fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.112+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc814089870 con 0x7fc81c159e60 2023-10-16T08:52:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.112+0000 7fc81a59c640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc7fc06ae70 0x7fc7fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.112+0000 7fc81a59c640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc7fc06ae70 0x7fc7fc06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0099c0 tx=0x7fc80c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.120+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc81c1523d0 con 0x7fc81c159e60 2023-10-16T08:52:05.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.349+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc81c1523d0 con 0x7fc81c159e60 2023-10-16T08:52:05.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.350+0000 7fc80affd640 1 -- 172.21.15.94:0/1946406872 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc81c1523d0 con 0x7fc81c159e60 2023-10-16T08:52:05.352 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T08:52:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.352+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc7fc06ae70 msgr2=0x7fc7fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.352+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc7fc06ae70 0x7fc7fc06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0099c0 tx=0x7fc80c008040 comp rx=0 tx=0).stop 2023-10-16T08:52:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.352+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 msgr2=0x7fc81c15a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.352+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 0x7fc81c15a2e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8140042e0 tx=0x7fc8140047a0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 shutdown_connections 2023-10-16T08:52:05.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c159e60 0x7fc81c15a2e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc7fc06ae70 0x7fc7fc06d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c150830 0x7fc81c0c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 --2- 172.21.15.94:0/1946406872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8040047c0 0x7fc81c0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:05.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 >> 172.21.15.94:0/1946406872 conn(0x7fc81c06a470 msgr2=0x7fc81c1596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:05.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 shutdown_connections 2023-10-16T08:52:05.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:05.353+0000 7fc81b59e640 1 -- 172.21.15.94:0/1946406872 wait complete. 2023-10-16T08:52:05.371 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T08:52:05.371 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T08:52:05.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2023-10-16T08:52:05.372 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T08:52:05.372 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:05.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T08:52:05.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T08:52:05.374 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T08:52:05.374 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T08:52:05.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.375 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2023-10-16T08:52:05.418 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:05.419 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:05.419 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2023-10-16T08:52:05.420 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:05.420 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2023-10-16T08:52:05.421 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:05.421 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T08:52:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:05.421 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T08:52:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42352sec preferred_lft 42352sec 2023-10-16T08:52:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2023-10-16T08:52:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:05.422 INFO:teuthology.orchestra.run.smithi094.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:52:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether f6:a7:fe:81:04:60 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T08:52:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::a044:9dff:fecb:5544/64 scope link 2023-10-16T08:52:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:05.424 INFO:teuthology.orchestra.run.smithi094.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T08:52:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether f6:a7:fe:81:04:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::f4a7:feff:fe81:460/64 scope link 2023-10-16T08:52:05.424 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:05.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.425 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T08:52:05.547 INFO:teuthology.orchestra.run.smithi094.stdout:1 2023-10-16T08:52:05.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.551 DEBUG:teuthology.orchestra.run.smithi094:> route 2023-10-16T08:52:05.598 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2023-10-16T08:52:05.598 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T08:52:05.599 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T08:52:05.599 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T08:52:05.599 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T08:52:05.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.600 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:05.600 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:05.600 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T08:52:05.601 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T08:52:05.601 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T08:52:05.601 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:05.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.763 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-16T08:52:05.813 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T08:52:05.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.814 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2023-10-16T08:52:05.870 INFO:teuthology.orchestra.run.smithi094.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-16T08:52:05.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:05.872 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:05.872 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:05.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:52:05.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-16T08:52:05.873 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:06.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:06.014 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T08:52:06.104 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:06.104 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:06.104 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:06.105 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.105 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:06.105 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.105 INFO:teuthology.orchestra.run.smithi094.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:52:06.105 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:c9:63:56:7c:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T08:52:06.106 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T08:52:06.106 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.106 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c9:63ff:fe56:7c14/64 scope link 2023-10-16T08:52:06.106 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:06.108 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T08:52:06.205 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:06.205 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.206 INFO:teuthology.orchestra.run.smithi094.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:52:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 02:c9:63:56:7c:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T08:52:06.207 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T08:52:06.207 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.207 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::c9:63ff:fe56:7c14/64 scope link 2023-10-16T08:52:06.207 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:06.209 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-16T08:52:06.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:06.209 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:06.210 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:06.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-16T08:52:06.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T08:52:06.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T08:52:06.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T08:52:06.211 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T08:52:06.211 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:06.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:06.482 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:52:06.483 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:52:06.483 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.1 up 2023-10-16T08:52:06.483 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T08:52:06.484 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:52:06.652 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-16T08:52:06.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:06.653 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:06.705 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T08:52:06.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:06.706 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:06.759 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:52:06.854 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:06.914 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:52:06.915 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:52:06.915 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:52:06.915 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:52:06.915 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:52:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:52:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:52:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:52:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:52:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:52:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:52:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:52:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:52:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:52:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:52:06.918 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:06.918 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:06.918 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:52:06.918 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:06.918 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:06.919 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:06.919 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:52:06.919 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:52:06.919 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:52:06.919 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:52:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:52:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:52:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:52:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:06.921 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:52:06.921 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:52:06.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:06.922 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:52:06.977 INFO:teuthology.orchestra.run.smithi094.stdout:39 2023-10-16T08:52:06.978 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-10-16T08:52:06.978 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-16T08:52:06.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:52:07.062 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:07.104 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:52:07.105 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:52:07.105 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:52:07.105 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:52:07.105 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:52:07.106 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:52:07.106 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:52:07.106 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:52:07.106 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:52:07.107 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:52:07.107 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:52:07.107 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:07.107 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:52:07.108 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:52:07.108 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:52:07.108 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:52:07.108 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:07.108 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:07.108 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:52:07.109 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:07.109 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:07.109 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:07.109 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:52:07.110 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:52:07.110 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:52:07.110 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:52:07.110 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:52:07.110 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:52:07.111 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:52:07.111 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:07.111 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:52:07.111 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:07.111 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:52:07.112 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:52:07.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:07.113 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:52:07.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi094.stderr:2023-10-16T08:52:07.172+0000 7f848fa0c480 -1 init, newargv = 0x55a87ac73d90 newargc=15 2023-10-16T08:52:07.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi094.stderr:ceph-fuse[96518]: starting ceph client 2023-10-16T08:52:07.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi094.stderr:ceph-fuse[96518]: starting fuse 2023-10-16T08:52:07.200 INFO:teuthology.orchestra.run.smithi094.stdout:39 2023-10-16T08:52:07.201 INFO:teuthology.orchestra.run.smithi094.stdout:42 2023-10-16T08:52:07.201 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-10-16T08:52:07.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2023-10-16T08:52:07.202 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2023-10-16T08:52:07.202 DEBUG:teuthology.orchestra.run.smithi094:> import re 2023-10-16T08:52:07.203 DEBUG:teuthology.orchestra.run.smithi094:> import os 2023-10-16T08:52:07.203 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2023-10-16T08:52:07.204 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:07.204 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2023-10-16T08:52:07.205 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-16T08:52:07.205 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2023-10-16T08:52:07.206 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-16T08:52:07.206 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:07.207 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2023-10-16T08:52:07.207 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2023-10-16T08:52:07.208 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2023-10-16T08:52:07.208 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2023-10-16T08:52:07.209 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:07.209 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2023-10-16T08:52:07.209 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T08:52:07.209 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T08:52:07.210 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T08:52:07.210 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2023-10-16T08:52:07.211 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2023-10-16T08:52:07.211 DEBUG:teuthology.orchestra.run.smithi094:> return f 2023-10-16T08:52:07.211 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T08:52:07.212 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:52:07.212 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.2")) 2023-10-16T08:52:07.212 DEBUG:teuthology.orchestra.run.smithi094:> ' 2023-10-16T08:52:07.406 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.2.96518.asok 2023-10-16T08:52:07.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T08:52:07.422 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.96518.asok 2023-10-16T08:52:07.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:07.423 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.96518.asok status 2023-10-16T08:52:07.662 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:52:07.662 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2023-10-16T08:52:07.663 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T08:52:07.663 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T08:52:07.663 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "2", 2023-10-16T08:52:07.663 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2023-10-16T08:52:07.663 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-16T08:52:07.664 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "96518", 2023-10-16T08:52:07.664 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2023-10-16T08:52:07.664 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:07.664 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2023-10-16T08:52:07.665 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2023-10-16T08:52:07.665 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4908, 2023-10-16T08:52:07.665 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2023-10-16T08:52:07.665 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2023-10-16T08:52:07.665 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2023-10-16T08:52:07.665 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4908 2023-10-16T08:52:07.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:07.666 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:52:07.666 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:52:07.666 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.2:0", 2023-10-16T08:52:07.666 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3221554287 2023-10-16T08:52:07.667 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:52:07.667 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:07.667 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:52:07.667 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:52:07.668 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.2:0", 2023-10-16T08:52:07.668 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 3221554287 2023-10-16T08:52:07.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:52:07.668 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4908 192.168.0.2:0/3221554287", 2023-10-16T08:52:07.668 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.2:0/3221554287", 2023-10-16T08:52:07.669 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2023-10-16T08:52:07.669 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 8, 2023-10-16T08:52:07.669 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 28, 2023-10-16T08:52:07.669 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2023-10-16T08:52:07.669 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2023-10-16T08:52:07.670 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2023-10-16T08:52:07.670 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:52:07.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T08:52:07.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.894+0000 7f9e2d739640 1 Processor -- start 2023-10-16T08:52:07.897 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.894+0000 7f9e2d739640 1 -- start start 2023-10-16T08:52:07.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e2d739640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e280c9e00 0x7f9e280c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:07.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e2d739640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:07.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e2d739640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e28071e40 con 0x7f9e28071630 2023-10-16T08:52:07.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e2d739640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280cde00 con 0x7f9e280c9e00 2023-10-16T08:52:07.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e2d739640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28072120 con 0x7f9e280ca1e0 2023-10-16T08:52:07.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e26ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e280c9e00 0x7f9e280c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:07.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e26ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e280c9e00 0x7f9e280c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51568/0 (socket says 172.21.15.94:51568) 2023-10-16T08:52:07.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e26ffd640 1 -- 172.21.15.94:0/937260065 learned_addr learned my addr 172.21.15.94:0/937260065 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:07.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.897+0000 7f9e267fc640 1 --2- 172.21.15.94:0/937260065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:07.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.898+0000 7f9e26ffd640 1 -- 172.21.15.94:0/937260065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 msgr2=0x7f9e280710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:07.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.898+0000 7f9e26ffd640 1 --2- 172.21.15.94:0/937260065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:07.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.898+0000 7f9e26ffd640 1 -- 172.21.15.94:0/937260065 >> v1:172.21.15.130:6789/0 conn(0x7f9e28071630 legacy=0x7f9e280cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:07.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.898+0000 7f9e26ffd640 1 -- 172.21.15.94:0/937260065 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28072400 con 0x7f9e280c9e00 2023-10-16T08:52:07.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.899+0000 7f9e26ffd640 1 --2- 172.21.15.94:0/937260065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280c20e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009870 tx=0x7f9e1802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fd011194b0f7ef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:07.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.899+0000 7f9e25ffb640 1 -- 172.21.15.94:0/937260065 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18031640 con 0x7f9e280c9e00 2023-10-16T08:52:07.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e25ffb640 1 -- 172.21.15.94:0/937260065 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e180317a0 con 0x7f9e280c9e00 2023-10-16T08:52:07.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e25ffb640 1 -- 172.21.15.94:0/937260065 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18031b30 con 0x7f9e280c9e00 2023-10-16T08:52:07.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 -- 172.21.15.94:0/937260065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 msgr2=0x7f9e280c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:07.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 --2- 172.21.15.94:0/937260065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280c20e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009870 tx=0x7f9e1802b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:07.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 -- 172.21.15.94:0/937260065 shutdown_connections 2023-10-16T08:52:07.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 --2- 172.21.15.94:0/937260065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:07.913 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 --2- 172.21.15.94:0/937260065 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280c20e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:07.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 -- 172.21.15.94:0/937260065 >> 172.21.15.94:0/937260065 conn(0x7f9e2806c1c0 msgr2=0x7f9e2806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:07.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 -- 172.21.15.94:0/937260065 shutdown_connections 2023-10-16T08:52:07.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.900+0000 7f9e2d739640 1 -- 172.21.15.94:0/937260065 wait complete. 2023-10-16T08:52:07.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.902+0000 7f9e2d739640 1 Processor -- start 2023-10-16T08:52:07.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.902+0000 7f9e2d739640 1 -- start start 2023-10-16T08:52:07.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.903+0000 7f9e2d739640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e28071630 0x7f9e28151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:07.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.903+0000 7f9e2d739640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:07.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.903+0000 7f9e2d739640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:07.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.903+0000 7f9e2d739640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280b1b20 con 0x7f9e280c9e00 2023-10-16T08:52:07.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.903+0000 7f9e2d739640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280b0f10 con 0x7f9e28071630 2023-10-16T08:52:07.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.903+0000 7f9e2d739640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280b11f0 con 0x7f9e280ca1e0 2023-10-16T08:52:07.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:07.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51576/0 (socket says 172.21.15.94:51576) 2023-10-16T08:52:07.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 -- 172.21.15.94:0/178679756 learned_addr learned my addr 172.21.15.94:0/178679756 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:07.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e26ffd640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e28071630 0x7f9e28151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:07.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e277fe640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:07.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 -- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 msgr2=0x7f9e280ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:07.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:07.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 -- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e28071630 msgr2=0x7f9e28151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:07.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e28071630 0x7f9e28151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:07.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 -- 172.21.15.94:0/178679756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180094d0 con 0x7f9e280c9e00 2023-10-16T08:52:07.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.904+0000 7f9e267fc640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280b2b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d800 tx=0x7f9e1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:07.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.905+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00b6c0 con 0x7f9e280c9e00 2023-10-16T08:52:07.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.905+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00b820 con 0x7f9e280c9e00 2023-10-16T08:52:07.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.905+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e280b14d0 con 0x7f9e280c9e00 2023-10-16T08:52:07.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.905+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00bbb0 con 0x7f9e280c9e00 2023-10-16T08:52:07.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.905+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e28151880 con 0x7f9e280c9e00 2023-10-16T08:52:07.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.906+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e28073ef0 con 0x7f9e280c9e00 2023-10-16T08:52:07.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.907+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e1c00bd10 con 0x7f9e280c9e00 2023-10-16T08:52:07.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.908+0000 7f9e0f7fe640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9e1406aea0 0x7f9e1406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:07.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.908+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e1c089f20 con 0x7f9e280c9e00 2023-10-16T08:52:07.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.908+0000 7f9e26ffd640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9e1406aea0 0x7f9e1406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:07.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.909+0000 7f9e26ffd640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9e1406aea0 0x7f9e1406d360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e18036000 tx=0x7f9e1803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:07.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:07.913+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e1c054c00 con 0x7f9e280c9e00 2023-10-16T08:52:08.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.140+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e281562b0 con 0x7f9e280c9e00 2023-10-16T08:52:08.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.141+0000 7f9e0f7fe640 1 -- 172.21.15.94:0/178679756 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9e1c058220 con 0x7f9e280c9e00 2023-10-16T08:52:08.143 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T08:52:08.145 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.143+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9e1406aea0 msgr2=0x7f9e1406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:08.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.143+0000 7f9e2d739640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9e1406aea0 0x7f9e1406d360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e18036000 tx=0x7f9e1803c040 comp rx=0 tx=0).stop 2023-10-16T08:52:08.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.143+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 msgr2=0x7f9e280b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:08.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.143+0000 7f9e2d739640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280b2b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00d800 tx=0x7f9e1c00dcc0 comp rx=0 tx=0).stop 2023-10-16T08:52:08.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 shutdown_connections 2023-10-16T08:52:08.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e280ca1e0 0x7f9e280ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:08.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e280c9e00 0x7f9e280b2b50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:08.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9e1406aea0 0x7f9e1406d360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:08.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 --2- 172.21.15.94:0/178679756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e28071630 0x7f9e28151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:08.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 >> 172.21.15.94:0/178679756 conn(0x7f9e2806c1c0 msgr2=0x7f9e280aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:08.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 shutdown_connections 2023-10-16T08:52:08.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:08.144+0000 7f9e2d739640 1 -- 172.21.15.94:0/178679756 wait complete. 2023-10-16T08:52:08.166 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T08:52:08.166 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T08:52:08.166 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-10-16T08:52:08.167 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T08:52:08.167 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:08.167 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T08:52:08.167 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T08:52:08.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T08:52:08.168 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T08:52:08.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:08.169 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-10-16T08:52:08.229 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:08.229 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:08.229 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:08.229 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:08.230 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:08.230 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:08.230 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:08.230 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:08.231 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-10-16T08:52:08.231 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:08.231 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:08.231 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-10-16T08:52:08.231 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:08.232 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:08.232 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T08:52:08.232 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:08.232 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T08:52:08.233 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-10-16T08:52:08.233 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-10-16T08:52:08.233 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:08.233 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T08:52:08.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:08.234 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:08.234 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:08.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2023-10-16T08:52:08.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2023-10-16T08:52:08.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2023-10-16T08:52:08.236 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T08:52:08.236 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:08.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:08.708 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T08:52:08.786 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-16T08:52:08.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:08.789 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-10-16T08:52:08.844 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-10-16T08:52:08.844 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T08:52:08.844 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T08:52:08.844 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T08:52:08.845 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T08:52:08.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:08.845 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:08.846 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:08.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T08:52:08.846 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T08:52:08.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T08:52:08.847 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:09.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:09.584 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-16T08:52:09.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:09.641 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-10-16T08:52:09.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:09.693 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:09.693 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:09.693 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:09.694 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T08:52:09.694 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:09.838 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T08:52:09.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:09.839 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:09.839 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:09.840 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T08:52:09.840 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T08:52:09.840 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T08:52:09.841 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T08:52:09.841 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T08:52:09.841 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:10.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:10.127 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:10.127 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:10.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-10-16T08:52:10.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T08:52:10.128 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:10.287 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-16T08:52:10.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:10.288 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:10.335 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T08:52:10.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:10.336 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:10.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-16T08:52:10.528 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:10.582 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2023-10-16T08:52:10.582 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2023-10-16T08:52:10.583 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2023-10-16T08:52:10.583 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2023-10-16T08:52:10.583 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2023-10-16T08:52:10.583 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2023-10-16T08:52:10.583 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2023-10-16T08:52:10.584 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2023-10-16T08:52:10.584 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2023-10-16T08:52:10.584 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2023-10-16T08:52:10.584 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2023-10-16T08:52:10.584 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:10.585 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2023-10-16T08:52:10.585 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2023-10-16T08:52:10.585 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2023-10-16T08:52:10.585 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2023-10-16T08:52:10.585 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:10.586 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2023-10-16T08:52:10.586 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:10.586 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:10.586 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:10.586 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:10.587 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2023-10-16T08:52:10.587 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2023-10-16T08:52:10.587 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T08:52:10.587 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T08:52:10.587 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T08:52:10.588 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T08:52:10.588 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2023-10-16T08:52:10.588 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:10.588 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:10.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:10.590 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-16T08:52:10.637 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T08:52:10.638 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-16T08:52:10.643 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-16T08:52:10.719 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:10.760 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2023-10-16T08:52:10.760 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2023-10-16T08:52:10.761 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2023-10-16T08:52:10.761 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2023-10-16T08:52:10.761 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2023-10-16T08:52:10.761 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2023-10-16T08:52:10.761 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2023-10-16T08:52:10.762 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2023-10-16T08:52:10.762 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2023-10-16T08:52:10.762 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2023-10-16T08:52:10.762 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2023-10-16T08:52:10.762 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:10.763 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2023-10-16T08:52:10.763 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2023-10-16T08:52:10.763 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2023-10-16T08:52:10.763 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2023-10-16T08:52:10.763 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:10.764 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2023-10-16T08:52:10.764 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:10.764 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:10.764 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:10.764 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:10.765 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2023-10-16T08:52:10.765 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2023-10-16T08:52:10.765 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T08:52:10.765 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T08:52:10.765 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T08:52:10.766 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T08:52:10.766 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2023-10-16T08:52:10.766 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:10.766 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:10.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:10.768 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-16T08:52:10.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:2023-10-16T08:52:10.827+0000 7fa40ac3f480 -1 init, newargv = 0x5599c6fa8dc0 newargc=15 2023-10-16T08:52:10.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:ceph-fuse[92589]: starting ceph client 2023-10-16T08:52:10.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:ceph-fuse[92589]: starting fuse 2023-10-16T08:52:10.856 INFO:teuthology.orchestra.run.smithi130.stdout:39 2023-10-16T08:52:10.857 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-16T08:52:10.857 DEBUG:teuthology.orchestra.run.smithi130:> sudo stdin-killer -- python3 -c ' 2023-10-16T08:52:10.857 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2023-10-16T08:52:10.858 DEBUG:teuthology.orchestra.run.smithi130:> import re 2023-10-16T08:52:10.858 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-10-16T08:52:10.859 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-10-16T08:52:10.859 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:10.859 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2023-10-16T08:52:10.859 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-16T08:52:10.860 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2023-10-16T08:52:10.860 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-16T08:52:10.860 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:10.861 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2023-10-16T08:52:10.861 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2023-10-16T08:52:10.861 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2023-10-16T08:52:10.861 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2023-10-16T08:52:10.862 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:10.862 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2023-10-16T08:52:10.862 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T08:52:10.863 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T08:52:10.863 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T08:52:10.864 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2023-10-16T08:52:10.864 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2023-10-16T08:52:10.864 DEBUG:teuthology.orchestra.run.smithi130:> return f 2023-10-16T08:52:10.865 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T08:52:10.865 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:10.865 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.1")) 2023-10-16T08:52:10.865 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-10-16T08:52:11.063 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.1.92589.asok 2023-10-16T08:52:11.067 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:52:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T08:52:11.081 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.92589.asok 2023-10-16T08:52:11.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:11.082 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.92589.asok status 2023-10-16T08:52:11.325 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-10-16T08:52:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2023-10-16T08:52:11.325 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T08:52:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T08:52:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "1", 2023-10-16T08:52:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2023-10-16T08:52:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-16T08:52:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "92589", 2023-10-16T08:52:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2023-10-16T08:52:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2023-10-16T08:52:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2023-10-16T08:52:11.327 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4472, 2023-10-16T08:52:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2023-10-16T08:52:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2023-10-16T08:52:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2023-10-16T08:52:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4472 2023-10-16T08:52:11.328 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-16T08:52:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-16T08:52:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:52:11.329 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3569150904 2023-10-16T08:52:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-10-16T08:52:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-16T08:52:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-16T08:52:11.330 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:52:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3569150904 2023-10-16T08:52:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4472 192.168.0.1:0/3569150904", 2023-10-16T08:52:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "192.168.0.1:0/3569150904", 2023-10-16T08:52:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2023-10-16T08:52:11.331 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 8, 2023-10-16T08:52:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 28, 2023-10-16T08:52:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2023-10-16T08:52:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2023-10-16T08:52:11.332 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2023-10-16T08:52:11.332 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-10-16T08:52:11.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T08:52:11.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.558+0000 7fe61a86f640 1 Processor -- start 2023-10-16T08:52:11.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.558+0000 7fe61a86f640 1 -- start start 2023-10-16T08:52:11.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.559+0000 7fe61a86f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe614158f70 0x7fe6140cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:11.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.559+0000 7fe61a86f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe6140ca190 0x7fe6140b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:11.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.559+0000 7fe61a86f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe614070e20 con 0x7fe6140cb8a0 2023-10-16T08:52:11.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.559+0000 7fe61a86f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe614070af0 con 0x7fe6140ca190 2023-10-16T08:52:11.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.559+0000 7fe61a86f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140ad8d0 con 0x7fe614158f70 2023-10-16T08:52:11.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe618e0c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe6140cb8a0 0x7fe6140712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55772/0 (socket says 172.21.15.94:55772) 2023-10-16T08:52:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe618e0c640 1 -- 172.21.15.94:0/3299205007 learned_addr learned my addr 172.21.15.94:0/3299205007 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe6137fe640 1 --2- 172.21.15.94:0/3299205007 >> v2:172.21.15.94:3300/0 conn(0x7fe6140ca190 0x7fe6140b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe613fff640 1 --2- 172.21.15.94:0/3299205007 >> v2:172.21.15.130:3300/0 conn(0x7fe614158f70 0x7fe6140cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe6137fe640 1 -- 172.21.15.94:0/3299205007 >> v2:172.21.15.130:3300/0 conn(0x7fe614158f70 msgr2=0x7fe6140cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe6137fe640 1 --2- 172.21.15.94:0/3299205007 >> v2:172.21.15.130:3300/0 conn(0x7fe614158f70 0x7fe6140cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe6137fe640 1 -- 172.21.15.94:0/3299205007 >> v1:172.21.15.94:6789/0 conn(0x7fe6140cb8a0 legacy=0x7fe6140712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:11.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe6137fe640 1 -- 172.21.15.94:0/3299205007 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140adbb0 con 0x7fe6140ca190 2023-10-16T08:52:11.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.560+0000 7fe612ffd640 1 -- 172.21.15.94:0/3299205007 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888829450 0 0) 0x7fe614070e20 con 0x7fe6140cb8a0 2023-10-16T08:52:11.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.561+0000 7fe6137fe640 1 --2- 172.21.15.94:0/3299205007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6140ca190 0x7fe6140b0010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe61406fcf0 tx=0x7fe60802cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc92a1764b05c27f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:11.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe612ffd640 1 -- 172.21.15.94:0/3299205007 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60802db50 con 0x7fe6140ca190 2023-10-16T08:52:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe612ffd640 1 -- 172.21.15.94:0/3299205007 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60802dcb0 con 0x7fe6140ca190 2023-10-16T08:52:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe612ffd640 1 -- 172.21.15.94:0/3299205007 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608035660 con 0x7fe6140ca190 2023-10-16T08:52:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 -- 172.21.15.94:0/3299205007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6140ca190 msgr2=0x7fe6140b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 --2- 172.21.15.94:0/3299205007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6140ca190 0x7fe6140b0010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe61406fcf0 tx=0x7fe60802cda0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 -- 172.21.15.94:0/3299205007 shutdown_connections 2023-10-16T08:52:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 --2- 172.21.15.94:0/3299205007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6140ca190 0x7fe6140b0010 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 --2- 172.21.15.94:0/3299205007 >> v2:172.21.15.130:3300/0 conn(0x7fe614158f70 0x7fe6140cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 -- 172.21.15.94:0/3299205007 >> 172.21.15.94:0/3299205007 conn(0x7fe61406c1c0 msgr2=0x7fe61406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 -- 172.21.15.94:0/3299205007 shutdown_connections 2023-10-16T08:52:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.562+0000 7fe61a86f640 1 -- 172.21.15.94:0/3299205007 wait complete. 2023-10-16T08:52:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.564+0000 7fe61a86f640 1 Processor -- start 2023-10-16T08:52:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.564+0000 7fe61a86f640 1 -- start start 2023-10-16T08:52:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe61a86f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6140cb8a0 0x7fe61414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:11.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe61a86f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 0x7fe6140c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:11.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe61a86f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6140c5d60 0x7fe6141543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:11.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe61a86f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140b23d0 con 0x7fe614158f70 2023-10-16T08:52:11.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe61a86f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140c6350 con 0x7fe6140c5d60 2023-10-16T08:52:11.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe61a86f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140aff90 con 0x7fe6140cb8a0 2023-10-16T08:52:11.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe6137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 0x7fe6140c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:11.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe6137fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 0x7fe6140c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:51582/0 (socket says 172.21.15.94:51582) 2023-10-16T08:52:11.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.565+0000 7fe6137fe640 1 -- 172.21.15.94:0/2174251183 learned_addr learned my addr 172.21.15.94:0/2174251183 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:11.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe6137fe640 1 -- 172.21.15.94:0/2174251183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6140cb8a0 msgr2=0x7fe61414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:11.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe6137fe640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6140cb8a0 0x7fe61414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe6137fe640 1 -- 172.21.15.94:0/2174251183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6140c5d60 msgr2=0x7fe6141543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:11.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe6137fe640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6140c5d60 0x7fe6141543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe6137fe640 1 -- 172.21.15.94:0/2174251183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60800a5a0 con 0x7fe614158f70 2023-10-16T08:52:11.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe6137fe640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 0x7fe6140c5820 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe608000c00 tx=0x7fe6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:11.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60803e610 con 0x7fe614158f70 2023-10-16T08:52:11.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60803e790 con 0x7fe614158f70 2023-10-16T08:52:11.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60803eb40 con 0x7fe614158f70 2023-10-16T08:52:11.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.566+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6140b1a30 con 0x7fe614158f70 2023-10-16T08:52:11.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.567+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6140b1ff0 con 0x7fe614158f70 2023-10-16T08:52:11.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.568+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614073ef0 con 0x7fe614158f70 2023-10-16T08:52:11.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.569+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe60803c040 con 0x7fe614158f70 2023-10-16T08:52:11.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.569+0000 7fe610ff9640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe60006aea0 0x7fe60006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:11.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.570+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6080abbd0 con 0x7fe614158f70 2023-10-16T08:52:11.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.570+0000 7fe613fff640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe60006aea0 0x7fe60006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:11.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.570+0000 7fe613fff640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe60006aea0 0x7fe60006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe604006fd0 tx=0x7fe604008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:11.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.574+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe608076820 con 0x7fe614158f70 2023-10-16T08:52:11.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.808+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6140b2510 con 0x7fe614158f70 2023-10-16T08:52:11.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.809+0000 7fe610ff9640 1 -- 172.21.15.94:0/2174251183 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe6140b2510 con 0x7fe614158f70 2023-10-16T08:52:11.811 INFO:teuthology.orchestra.run.smithi094.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T08:52:11.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe60006aea0 msgr2=0x7fe60006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:11.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe60006aea0 0x7fe60006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe604006fd0 tx=0x7fe604008040 comp rx=0 tx=0).stop 2023-10-16T08:52:11.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 msgr2=0x7fe6140c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:11.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 0x7fe6140c5820 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe608000c00 tx=0x7fe6080046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 shutdown_connections 2023-10-16T08:52:11.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe60006aea0 0x7fe60006d360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6140c5d60 0x7fe6141543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe614158f70 0x7fe6140c5820 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 --2- 172.21.15.94:0/2174251183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6140cb8a0 0x7fe61414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:11.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 >> 172.21.15.94:0/2174251183 conn(0x7fe61406c1c0 msgr2=0x7fe6140cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:11.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 shutdown_connections 2023-10-16T08:52:11.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:11.811+0000 7fe61a86f640 1 -- 172.21.15.94:0/2174251183 wait complete. 2023-10-16T08:52:11.834 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T08:52:11.834 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T08:52:11.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-10-16T08:52:11.835 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-16T08:52:11.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:11.835 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T08:52:11.836 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T08:52:11.836 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T08:52:11.836 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-16T08:52:11.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:11.837 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-10-16T08:52:11.899 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:11.899 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:11.900 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:11.900 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:11.900 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:11.900 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:11.900 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:11.901 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:11.901 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-10-16T08:52:11.901 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:11.901 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:11.901 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-10-16T08:52:11.902 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:52:11.902 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:11.902 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T08:52:11.902 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:11.903 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T08:52:11.903 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-10-16T08:52:11.903 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-10-16T08:52:11.903 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:11.904 INFO:teuthology.orchestra.run.smithi130.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:52:11.904 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 46:9b:71:e6:c4:61 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:52:11.904 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T08:52:11.904 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:11.904 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::f0f5:91ff:feaf:926b/64 scope link 2023-10-16T08:52:11.904 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:11.905 INFO:teuthology.orchestra.run.smithi130.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T08:52:11.905 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 46:9b:71:e6:c4:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:11.905 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::449b:71ff:fee6:c461/64 scope link 2023-10-16T08:52:11.905 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:11.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:11.907 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T08:52:12.000 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-16T08:52:12.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.005 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-10-16T08:52:12.058 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-10-16T08:52:12.058 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T08:52:12.058 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T08:52:12.059 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T08:52:12.059 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T08:52:12.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.060 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:12.060 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:12.060 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T08:52:12.061 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T08:52:12.062 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T08:52:12.062 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:12.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.243 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-16T08:52:12.294 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T08:52:12.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.295 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-10-16T08:52:12.348 INFO:teuthology.orchestra.run.smithi130.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-16T08:52:12.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.351 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:12.351 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:12.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T08:52:12.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-16T08:52:12.353 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:12.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T08:52:12.583 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:12.583 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:12.584 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:12.584 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.584 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:12.584 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.585 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:52:12.585 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 8a:87:b6:92:42:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T08:52:12.585 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T08:52:12.585 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.585 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::8887:b6ff:fe92:42d3/64 scope link 2023-10-16T08:52:12.586 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T08:52:12.680 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:52:12.680 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:52:12.681 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:52:12.681 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.681 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-16T08:52:12.682 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.682 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:52:12.682 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 8a:87:b6:92:42:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T08:52:12.683 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T08:52:12.683 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.683 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::8887:b6ff:fe92:42d3/64 scope link 2023-10-16T08:52:12.683 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:52:12.685 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-16T08:52:12.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.686 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:12.687 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:12.687 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-16T08:52:12.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T08:52:12.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-16T08:52:12.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-16T08:52:12.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-16T08:52:12.689 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:12.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:12.951 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-16T08:52:12.952 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-16T08:52:12.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.1 up 2023-10-16T08:52:12.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T08:52:12.953 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-16T08:52:13.120 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-16T08:52:13.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:13.121 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:13.170 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-16T08:52:13.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:52:13.171 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:13.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-16T08:52:13.324 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:13.380 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2023-10-16T08:52:13.380 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2023-10-16T08:52:13.380 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2023-10-16T08:52:13.380 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2023-10-16T08:52:13.381 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2023-10-16T08:52:13.381 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2023-10-16T08:52:13.381 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2023-10-16T08:52:13.381 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2023-10-16T08:52:13.381 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2023-10-16T08:52:13.382 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2023-10-16T08:52:13.382 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2023-10-16T08:52:13.382 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:13.382 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2023-10-16T08:52:13.382 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2023-10-16T08:52:13.383 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2023-10-16T08:52:13.383 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2023-10-16T08:52:13.383 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:13.383 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2023-10-16T08:52:13.383 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:13.384 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:13.384 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:13.384 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:13.384 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2023-10-16T08:52:13.385 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2023-10-16T08:52:13.385 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T08:52:13.385 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T08:52:13.385 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T08:52:13.385 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T08:52:13.386 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2023-10-16T08:52:13.386 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:13.386 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:13.386 INFO:teuthology.orchestra.run.smithi130.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:13.386 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T08:52:13.387 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T08:52:13.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:13.388 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-16T08:52:13.441 INFO:teuthology.orchestra.run.smithi130.stdout:39 2023-10-16T08:52:13.442 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-10-16T08:52:13.442 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-16T08:52:13.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-16T08:52:13.524 DEBUG:teuthology.orchestra.run.smithi130:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:52:13.565 INFO:teuthology.orchestra.run.smithi130.stdout:/proc 2023-10-16T08:52:13.566 INFO:teuthology.orchestra.run.smithi130.stdout:/sys 2023-10-16T08:52:13.566 INFO:teuthology.orchestra.run.smithi130.stdout:/dev 2023-10-16T08:52:13.566 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/security 2023-10-16T08:52:13.566 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/shm 2023-10-16T08:52:13.566 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/pts 2023-10-16T08:52:13.567 INFO:teuthology.orchestra.run.smithi130.stdout:/run 2023-10-16T08:52:13.567 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/cgroup 2023-10-16T08:52:13.567 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/pstore 2023-10-16T08:52:13.567 INFO:teuthology.orchestra.run.smithi130.stdout:/ 2023-10-16T08:52:13.567 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/selinux 2023-10-16T08:52:13.568 INFO:teuthology.orchestra.run.smithi130.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:52:13.568 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/mqueue 2023-10-16T08:52:13.568 INFO:teuthology.orchestra.run.smithi130.stdout:/dev/hugepages 2023-10-16T08:52:13.568 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/debug 2023-10-16T08:52:13.568 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/tracing 2023-10-16T08:52:13.569 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/fs/fuse/connections 2023-10-16T08:52:13.569 INFO:teuthology.orchestra.run.smithi130.stdout:/sys/kernel/config 2023-10-16T08:52:13.569 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:52:13.569 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:52:13.569 INFO:teuthology.orchestra.run.smithi130.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:52:13.570 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:52:13.570 INFO:teuthology.orchestra.run.smithi130.stdout:/run/user/1000 2023-10-16T08:52:13.570 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph 2023-10-16T08:52:13.571 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T08:52:13.571 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T08:52:13.571 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T08:52:13.571 INFO:teuthology.orchestra.run.smithi130.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T08:52:13.571 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns 2023-10-16T08:52:13.572 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:13.572 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T08:52:13.572 INFO:teuthology.orchestra.run.smithi130.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:13.572 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T08:52:13.572 INFO:teuthology.orchestra.run.smithi130.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T08:52:13.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:13.574 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-16T08:52:13.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:2023-10-16T08:52:13.636+0000 7f4593834480 -1 init, newargv = 0x558d8a610c30 newargc=15 2023-10-16T08:52:13.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:ceph-fuse[93041]: starting ceph client 2023-10-16T08:52:13.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:ceph-fuse[93041]: starting fuse 2023-10-16T08:52:13.661 INFO:teuthology.orchestra.run.smithi130.stdout:39 2023-10-16T08:52:13.662 INFO:teuthology.orchestra.run.smithi130.stdout:42 2023-10-16T08:52:13.662 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-10-16T08:52:13.662 DEBUG:teuthology.orchestra.run.smithi130:> sudo stdin-killer -- python3 -c ' 2023-10-16T08:52:13.663 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2023-10-16T08:52:13.663 DEBUG:teuthology.orchestra.run.smithi130:> import re 2023-10-16T08:52:13.663 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-10-16T08:52:13.664 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-10-16T08:52:13.664 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:13.664 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2023-10-16T08:52:13.664 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-16T08:52:13.665 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2023-10-16T08:52:13.665 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-16T08:52:13.665 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:13.666 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2023-10-16T08:52:13.666 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2023-10-16T08:52:13.666 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2023-10-16T08:52:13.666 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2023-10-16T08:52:13.667 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:13.667 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2023-10-16T08:52:13.667 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T08:52:13.667 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T08:52:13.668 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T08:52:13.668 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2023-10-16T08:52:13.668 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2023-10-16T08:52:13.668 DEBUG:teuthology.orchestra.run.smithi130:> return f 2023-10-16T08:52:13.669 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T08:52:13.669 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-16T08:52:13.669 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.3")) 2023-10-16T08:52:13.669 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-10-16T08:52:13.865 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.3.93041.asok 2023-10-16T08:52:13.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-16T08:52:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T08:52:13.882 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.93041.asok 2023-10-16T08:52:13.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:13.883 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.93041.asok status 2023-10-16T08:52:14.118 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-10-16T08:52:14.118 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2023-10-16T08:52:14.118 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T08:52:14.118 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T08:52:14.119 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "3", 2023-10-16T08:52:14.119 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2023-10-16T08:52:14.119 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-16T08:52:14.119 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "93041", 2023-10-16T08:52:14.119 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2023-10-16T08:52:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2023-10-16T08:52:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2023-10-16T08:52:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4475, 2023-10-16T08:52:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2023-10-16T08:52:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2023-10-16T08:52:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2023-10-16T08:52:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4475 2023-10-16T08:52:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-16T08:52:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-16T08:52:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.2:0", 2023-10-16T08:52:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2344877220 2023-10-16T08:52:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-10-16T08:52:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-16T08:52:14.123 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-16T08:52:14.123 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.2:0", 2023-10-16T08:52:14.123 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2344877220 2023-10-16T08:52:14.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-16T08:52:14.123 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4475 192.168.0.2:0/2344877220", 2023-10-16T08:52:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "192.168.0.2:0/2344877220", 2023-10-16T08:52:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2023-10-16T08:52:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 8, 2023-10-16T08:52:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 28, 2023-10-16T08:52:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2023-10-16T08:52:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2023-10-16T08:52:14.125 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2023-10-16T08:52:14.125 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-10-16T08:52:14.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.133 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2023-10-16T08:52:14.133 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:14.193 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2023-10-16T08:52:14.194 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:14.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.194 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:14.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.288 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2023-10-16T08:52:14.288 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:14.342 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2023-10-16T08:52:14.343 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:14.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.344 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:14.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.441 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2023-10-16T08:52:14.442 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:14.500 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2023-10-16T08:52:14.501 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:14.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.501 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:14.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.589 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2023-10-16T08:52:14.590 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:14.643 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2023-10-16T08:52:14.644 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:14.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:14.644 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:14.734 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T08:52:14.750 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.976+0000 7f82af59e640 1 Processor -- start 2023-10-16T08:52:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.976+0000 7f82af59e640 1 -- start start 2023-10-16T08:52:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82af59e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f82b00cdd60 0x7f82b015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82af59e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0154110 con 0x7f82b00cd980 2023-10-16T08:52:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82af59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b015d1f0 con 0x7f82b015def0 2023-10-16T08:52:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82af59e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b015a4c0 con 0x7f82b00cdd60 2023-10-16T08:52:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82a7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f82b00cdd60 0x7f82b015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:14.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82ae59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f82b00cd980 0x7f82b0159c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58648/0 (socket says 172.21.15.94:58648) 2023-10-16T08:52:14.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82ae59c640 1 -- 172.21.15.94:0/1821842272 learned_addr learned my addr 172.21.15.94:0/1821842272 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82a7fff640 1 -- 172.21.15.94:0/1821842272 >> v1:172.21.15.130:6789/0 conn(0x7f82b015def0 legacy=0x7f82b006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82a7fff640 1 -- 172.21.15.94:0/1821842272 >> v1:172.21.15.94:6789/0 conn(0x7f82b00cd980 legacy=0x7f82b0159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.978+0000 7f82a7fff640 1 -- 172.21.15.94:0/1821842272 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b015a7a0 con 0x7f82b00cdd60 2023-10-16T08:52:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.980+0000 7f82a7fff640 1 --2- 172.21.15.94:0/1821842272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b015d9b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f82980097a0 tx=0x7f829802dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26603b22563db39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.980+0000 7f82add9b640 1 -- 172.21.15.94:0/1821842272 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829802f8a0 con 0x7f82b00cdd60 2023-10-16T08:52:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.980+0000 7f82add9b640 1 -- 172.21.15.94:0/1821842272 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829802fa00 con 0x7f82b00cdd60 2023-10-16T08:52:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.980+0000 7f82add9b640 1 -- 172.21.15.94:0/1821842272 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829802fd90 con 0x7f82b00cdd60 2023-10-16T08:52:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 -- 172.21.15.94:0/1821842272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 msgr2=0x7f82b015d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 --2- 172.21.15.94:0/1821842272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b015d9b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f82980097a0 tx=0x7f829802dae0 comp rx=0 tx=0).stop 2023-10-16T08:52:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 -- 172.21.15.94:0/1821842272 shutdown_connections 2023-10-16T08:52:14.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 --2- 172.21.15.94:0/1821842272 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b015d9b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:14.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 -- 172.21.15.94:0/1821842272 >> 172.21.15.94:0/1821842272 conn(0x7f82b006a470 msgr2=0x7f82b00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:14.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 -- 172.21.15.94:0/1821842272 shutdown_connections 2023-10-16T08:52:14.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.981+0000 7f82af59e640 1 -- 172.21.15.94:0/1821842272 wait complete. 2023-10-16T08:52:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.983+0000 7f82af59e640 1 Processor -- start 2023-10-16T08:52:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.983+0000 7f82af59e640 1 -- start start 2023-10-16T08:52:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.984+0000 7f82af59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82b00cd980 0x7f82b014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.984+0000 7f82af59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b00aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:14.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.984+0000 7f82af59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b01508a0 0x7f82b00af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:14.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.984+0000 7f82af59e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b01f3540 con 0x7f82b00cdd60 2023-10-16T08:52:14.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.984+0000 7f82af59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b01f2930 con 0x7f82b01508a0 2023-10-16T08:52:14.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.984+0000 7f82af59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b01f2c10 con 0x7f82b00cd980 2023-10-16T08:52:14.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b00aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:14.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b00aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42382/0 (socket says 172.21.15.94:42382) 2023-10-16T08:52:14.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 -- 172.21.15.94:0/2935692053 learned_addr learned my addr 172.21.15.94:0/2935692053 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:14.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82ae59c640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82b00cd980 0x7f82b014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:14.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82aed9d640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b01508a0 0x7f82b00af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:14.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 -- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82b00cd980 msgr2=0x7f82b014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:14.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82b00cd980 0x7f82b014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:14.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 -- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b01508a0 msgr2=0x7f82b00af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:14.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b01508a0 0x7f82b00af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:14.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 -- 172.21.15.94:0/2935692053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298009400 con 0x7f82b00cdd60 2023-10-16T08:52:14.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82aed9d640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b01508a0 0x7f82b00af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.985+0000 7f82a7fff640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b00aeba0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f82980098c0 tx=0x7f82980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.986+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298030bc0 con 0x7f82b00cdd60 2023-10-16T08:52:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.986+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298030d40 con 0x7f82b00cdd60 2023-10-16T08:52:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.986+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b01f2ef0 con 0x7f82b00cdd60 2023-10-16T08:52:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.986+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298042650 con 0x7f82b00cdd60 2023-10-16T08:52:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.986+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b01f2410 con 0x7f82b00cdd60 2023-10-16T08:52:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.987+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b004e9b0 con 0x7f82b00cdd60 2023-10-16T08:52:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.988+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8298039400 con 0x7f82b00cdd60 2023-10-16T08:52:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.989+0000 7f82a6ffd640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f829006ae70 0x7f829006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.989+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f82980ab7c0 con 0x7f82b00cdd60 2023-10-16T08:52:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.989+0000 7f82ae59c640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f829006ae70 0x7f829006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.990+0000 7f82ae59c640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f829006ae70 0x7f829006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82a00010e0 tx=0x7f82a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:14.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:14.993+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8298076410 con 0x7f82b00cdd60 2023-10-16T08:52:15.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.183+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82b01f3680 con 0x7f82b00cdd60 2023-10-16T08:52:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.187+0000 7f82a6ffd640 1 -- 172.21.15.94:0/2935692053 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f8298079a30 con 0x7f82b00cdd60 2023-10-16T08:52:15.189 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:15.190 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:15.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f829006ae70 msgr2=0x7f829006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f829006ae70 0x7f829006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82a00010e0 tx=0x7f82a0009040 comp rx=0 tx=0).stop 2023-10-16T08:52:15.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 msgr2=0x7f82b00aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b00aeba0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f82980098c0 tx=0x7f82980046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 shutdown_connections 2023-10-16T08:52:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f829006ae70 0x7f829006d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b01508a0 0x7f82b00af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82b00cdd60 0x7f82b00aeba0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 --2- 172.21.15.94:0/2935692053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82b00cd980 0x7f82b014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 >> 172.21.15.94:0/2935692053 conn(0x7f82b006a470 msgr2=0x7f82b006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:15.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 shutdown_connections 2023-10-16T08:52:15.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.190+0000 7f82af59e640 1 -- 172.21.15.94:0/2935692053 wait complete. 2023-10-16T08:52:15.209 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:15.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:15.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.413+0000 7fe6b9221640 1 Processor -- start 2023-10-16T08:52:15.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.413+0000 7fe6b9221640 1 -- start start 2023-10-16T08:52:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.414+0000 7fe6b9221640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6b40cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.414+0000 7fe6b9221640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b40cb180 con 0x7fe6b415c580 2023-10-16T08:52:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.414+0000 7fe6b9221640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b40cf440 con 0x7fe6b40c9260 2023-10-16T08:52:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.414+0000 7fe6b9221640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40cac40 con 0x7fe6b40cdbb0 2023-10-16T08:52:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.414+0000 7fe6b2d9d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe6b415c580 0x7fe6b40c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58656/0 (socket says 172.21.15.94:58656) 2023-10-16T08:52:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b2d9d640 1 -- 172.21.15.94:0/699227221 learned_addr learned my addr 172.21.15.94:0/699227221 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:15.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b359e640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6b40cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119530206 0 0) 0x7fe6b40cb180 con 0x7fe6b415c580 2023-10-16T08:52:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6a0003520 con 0x7fe6b415c580 2023-10-16T08:52:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 920489931 0 0) 0x7fe6a0003520 con 0x7fe6b415c580 2023-10-16T08:52:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 msgr2=0x7fe6b40cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6b40cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 >> v1:172.21.15.130:6789/0 conn(0x7fe6b40c9260 legacy=0x7fe6b415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40ceec0 con 0x7fe6b415c580 2023-10-16T08:52:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fe6a4001670 con 0x7fe6b415c580 2023-10-16T08:52:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b359e640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6b40cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 >> v1:172.21.15.94:6789/0 conn(0x7fe6b415c580 legacy=0x7fe6b40c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a00039a0 0x7fe6a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.415+0000 7fe6b259c640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a0004d00 0x7fe6a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40cac40 con 0x7fe6a0004d00 2023-10-16T08:52:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a000cc20 con 0x7fe6a00039a0 2023-10-16T08:52:15.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a000cde0 con 0x7fe6b40cdbb0 2023-10-16T08:52:15.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b359e640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a0004d00 0x7fe6a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b2d9d640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a00039a0 0x7fe6a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6abfff640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b359e640 1 -- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 msgr2=0x7fe6a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:15.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b359e640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b359e640 1 -- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a00039a0 msgr2=0x7fe6a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b359e640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a00039a0 0x7fe6a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6b359e640 1 -- 172.21.15.94:0/699227221 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0003520 con 0x7fe6a0004d00 2023-10-16T08:52:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.416+0000 7fe6abfff640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40cdbb0 0x7fe6a00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.417+0000 7fe6b359e640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a0004d00 0x7fe6a0005180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0073e0 tx=0x7fe6a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fda2aa838ea012 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac02cd30 con 0x7fe6a0004d00 2023-10-16T08:52:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac02ce90 con 0x7fe6a0004d00 2023-10-16T08:52:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b259c640 1 -- 172.21.15.94:0/699227221 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac034640 con 0x7fe6a0004d00 2023-10-16T08:52:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b9221640 1 -- 172.21.15.94:0/699227221 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a0004d00 msgr2=0x7fe6a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b9221640 1 --2- 172.21.15.94:0/699227221 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6a0004d00 0x7fe6a0005180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0073e0 tx=0x7fe6a00057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b359e640 1 -- 172.21.15.94:0/699227221 reap_dead start 2023-10-16T08:52:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b9221640 1 -- 172.21.15.94:0/699227221 shutdown_connections 2023-10-16T08:52:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b9221640 1 -- 172.21.15.94:0/699227221 >> 172.21.15.94:0/699227221 conn(0x7fe6b40b0030 msgr2=0x7fe6b40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b9221640 1 -- 172.21.15.94:0/699227221 shutdown_connections 2023-10-16T08:52:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.418+0000 7fe6b9221640 1 -- 172.21.15.94:0/699227221 wait complete. 2023-10-16T08:52:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.420+0000 7fe6b9221640 1 Processor -- start 2023-10-16T08:52:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.420+0000 7fe6b9221640 1 -- start start 2023-10-16T08:52:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b9221640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a0004d00 0x7fe6b40b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b9221640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40b3ee0 0x7fe6b41f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b9221640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 0x7fe6b40c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b9221640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40b1b30 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b9221640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b41f6270 con 0x7fe6a0004d00 2023-10-16T08:52:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b9221640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c7f90 con 0x7fe6b40b3ee0 2023-10-16T08:52:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 0x7fe6b40c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b359e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 0x7fe6b40c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42412/0 (socket says 172.21.15.94:42412) 2023-10-16T08:52:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.421+0000 7fe6b359e640 1 -- 172.21.15.94:0/3936801596 learned_addr learned my addr 172.21.15.94:0/3936801596 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b2d9d640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a0004d00 0x7fe6b40b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6abfff640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40b3ee0 0x7fe6b41f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b359e640 1 -- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40b3ee0 msgr2=0x7fe6b41f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b359e640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40b3ee0 0x7fe6b41f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b359e640 1 -- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a0004d00 msgr2=0x7fe6b40b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b359e640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a0004d00 0x7fe6b40b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b359e640 1 -- 172.21.15.94:0/3936801596 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40b1d10 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b2d9d640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a0004d00 0x7fe6b40b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:15.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6abfff640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40b3ee0 0x7fe6b41f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:15.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6b359e640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 0x7fe6b40c3c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac007500 tx=0x7fe6ac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:15.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac003990 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.422+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac003af0 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.423+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac003e60 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.423+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b40b1ff0 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.423+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b41529b0 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.424+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b40b2510 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.425+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe6ac03b070 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.425+0000 7fe6ab7fe640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe69406ae90 0x7fe69406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.426+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6ac0ab4a0 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.426+0000 7fe6b2d9d640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe69406ae90 0x7fe69406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.426+0000 7fe6b2d9d640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe69406ae90 0x7fe69406d350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4001eb0 tx=0x7fe6a4001da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:15.436 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.430+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6ac076340 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.623+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6b41527a0 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.624+0000 7fe6ab7fe640 1 -- 172.21.15.94:0/3936801596 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6ac079960 con 0x7fe6b41f5dc0 2023-10-16T08:52:15.626 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe69406ae90 msgr2=0x7fe69406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe69406ae90 0x7fe69406d350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4001eb0 tx=0x7fe6a4001da0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 msgr2=0x7fe6b40c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 0x7fe6b40c3c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac007500 tx=0x7fe6ac004ab0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 shutdown_connections 2023-10-16T08:52:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe6b41f5dc0 0x7fe6b40c3c00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6b40b3ee0 0x7fe6b41f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe69406ae90 0x7fe69406d350 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 --2- 172.21.15.94:0/3936801596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6a0004d00 0x7fe6b40b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 >> 172.21.15.94:0/3936801596 conn(0x7fe6b40b0030 msgr2=0x7fe6b415d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 shutdown_connections 2023-10-16T08:52:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.626+0000 7fe6b9221640 1 -- 172.21.15.94:0/3936801596 wait complete. 2023-10-16T08:52:15.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:15.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.849+0000 7f81cd29b640 1 Processor -- start 2023-10-16T08:52:15.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.849+0000 7f81cd29b640 1 -- start start 2023-10-16T08:52:15.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.850+0000 7f81cd29b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81c80d30b0 0x7f81c80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.850+0000 7f81cd29b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 0x7f81c80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.850+0000 7f81cd29b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80cdca0 con 0x7f81c815ca80 2023-10-16T08:52:15.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.850+0000 7f81cd29b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80d0e80 con 0x7f81c80d30b0 2023-10-16T08:52:15.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.850+0000 7f81cd29b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80d1160 con 0x7f81c80cd890 2023-10-16T08:52:15.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.851+0000 7f81c67fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81c80d30b0 0x7f81c80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.851+0000 7f81c77fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 0x7f81c80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.851+0000 7f81c77fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 0x7f81c80b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:46404/0 (socket says 172.21.15.94:46404) 2023-10-16T08:52:15.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.851+0000 7f81c77fe640 1 -- 172.21.15.94:0/4168622143 learned_addr learned my addr 172.21.15.94:0/4168622143 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:15.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.852+0000 7f81c77fe640 1 -- 172.21.15.94:0/4168622143 >> v2:172.21.15.130:3300/0 conn(0x7f81c80d30b0 msgr2=0x7f81c80cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:15.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.852+0000 7f81c77fe640 1 --2- 172.21.15.94:0/4168622143 >> v2:172.21.15.130:3300/0 conn(0x7f81c80d30b0 0x7f81c80cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.852+0000 7f81c77fe640 1 -- 172.21.15.94:0/4168622143 >> v1:172.21.15.130:6789/0 conn(0x7f81c815ca80 legacy=0x7f81c80d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.852+0000 7f81c77fe640 1 -- 172.21.15.94:0/4168622143 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80d1440 con 0x7f81c80cd890 2023-10-16T08:52:15.856 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.852+0000 7f81c67fc640 1 --2- 172.21.15.94:0/4168622143 >> v2:172.21.15.130:3300/0 conn(0x7f81c80d30b0 0x7f81c80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:52:15.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.853+0000 7f81c77fe640 1 --2- 172.21.15.94:0/4168622143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 0x7f81c80b5da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d20f57f6928ed8a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:15.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81c5ffb640 1 -- 172.21.15.94:0/4168622143 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0030840 con 0x7f81c80cd890 2023-10-16T08:52:15.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81c5ffb640 1 -- 172.21.15.94:0/4168622143 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00309a0 con 0x7f81c80cd890 2023-10-16T08:52:15.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81c5ffb640 1 -- 172.21.15.94:0/4168622143 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0030d30 con 0x7f81c80cd890 2023-10-16T08:52:15.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 -- 172.21.15.94:0/4168622143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 msgr2=0x7f81c80b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 --2- 172.21.15.94:0/4168622143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 0x7f81c80b5da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c002b980 comp rx=0 tx=0).stop 2023-10-16T08:52:15.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 -- 172.21.15.94:0/4168622143 shutdown_connections 2023-10-16T08:52:15.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 --2- 172.21.15.94:0/4168622143 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c80cd890 0x7f81c80b5da0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 --2- 172.21.15.94:0/4168622143 >> v2:172.21.15.130:3300/0 conn(0x7f81c80d30b0 0x7f81c80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 -- 172.21.15.94:0/4168622143 >> 172.21.15.94:0/4168622143 conn(0x7f81c8071900 msgr2=0x7f81c8071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:15.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 -- 172.21.15.94:0/4168622143 shutdown_connections 2023-10-16T08:52:15.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.854+0000 7f81cd29b640 1 -- 172.21.15.94:0/4168622143 wait complete. 2023-10-16T08:52:15.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.856+0000 7f81cd29b640 1 Processor -- start 2023-10-16T08:52:15.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.856+0000 7f81cd29b640 1 -- start start 2023-10-16T08:52:15.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81cd29b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80cd890 0x7f81c81f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81cd29b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 0x7f81c8148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81cd29b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c815ca80 0x7f81c80cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81cd29b640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c81f2c00 con 0x7f81c80d30b0 2023-10-16T08:52:15.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81cd29b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80cca40 con 0x7f81c80cd890 2023-10-16T08:52:15.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81cd29b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80cc760 con 0x7f81c815ca80 2023-10-16T08:52:15.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.857+0000 7f81c67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 0x7f81c8148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 0x7f81c8148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42414/0 (socket says 172.21.15.94:42414) 2023-10-16T08:52:15.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 -- 172.21.15.94:0/2585675357 learned_addr learned my addr 172.21.15.94:0/2585675357 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:15.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c6ffd640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80cd890 0x7f81c81f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 -- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c815ca80 msgr2=0x7f81c80cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c815ca80 0x7f81c80cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 -- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80cd890 msgr2=0x7f81c81f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:15.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80cd890 0x7f81c81f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:15.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 -- 172.21.15.94:0/2585675357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009400 con 0x7f81c80d30b0 2023-10-16T08:52:15.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c6ffd640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80cd890 0x7f81c81f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:15.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81c67fc640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 0x7f81c8148d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f81b000ebe0 tx=0x7f81b000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:15.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0009760 con 0x7f81c80d30b0 2023-10-16T08:52:15.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000cc30 con 0x7f81c80d30b0 2023-10-16T08:52:15.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000eee0 con 0x7f81c80d30b0 2023-10-16T08:52:15.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.858+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00094d0 con 0x7f81c80d30b0 2023-10-16T08:52:15.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.859+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c81f2820 con 0x7f81c80d30b0 2023-10-16T08:52:15.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.860+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c8067180 con 0x7f81c80d30b0 2023-10-16T08:52:15.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.861+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81b0013470 con 0x7f81c80d30b0 2023-10-16T08:52:15.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.861+0000 7f81bf7fe640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f81a806ae70 0x7f81a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:15.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.862+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81b0089cf0 con 0x7f81c80d30b0 2023-10-16T08:52:15.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.862+0000 7f81c6ffd640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f81a806ae70 0x7f81a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:15.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.862+0000 7f81c6ffd640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f81a806ae70 0x7f81a806d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f81b80012e0 tx=0x7f81b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:15.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:15.866+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81b00549d0 con 0x7f81c80d30b0 2023-10-16T08:52:16.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.057+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81c80b5eb0 con 0x7f81c80d30b0 2023-10-16T08:52:16.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.058+0000 7f81bf7fe640 1 -- 172.21.15.94:0/2585675357 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81b0017020 con 0x7f81c80d30b0 2023-10-16T08:52:16.060 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:16.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f81a806ae70 msgr2=0x7f81a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f81a806ae70 0x7f81a806d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f81b80012e0 tx=0x7f81b8009040 comp rx=0 tx=0).stop 2023-10-16T08:52:16.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 msgr2=0x7f81c8148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 0x7f81c8148d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f81b000ebe0 tx=0x7f81b000c520 comp rx=0 tx=0).stop 2023-10-16T08:52:16.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 shutdown_connections 2023-10-16T08:52:16.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81c815ca80 0x7f81c80cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81c80d30b0 0x7f81c8148d20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f81a806ae70 0x7f81a806d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 --2- 172.21.15.94:0/2585675357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81c80cd890 0x7f81c81f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 >> 172.21.15.94:0/2585675357 conn(0x7f81c8071900 msgr2=0x7f81c8072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:16.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 shutdown_connections 2023-10-16T08:52:16.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.060+0000 7f81cd29b640 1 -- 172.21.15.94:0/2585675357 wait complete. 2023-10-16T08:52:16.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.284+0000 7f08e29d0640 1 Processor -- start 2023-10-16T08:52:16.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.285+0000 7f08e29d0640 1 -- start start 2023-10-16T08:52:16.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08e29d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f08dc070a30 0x7f08dc0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.288 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08e29d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc0ca550 0x7f08dc0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08e29d0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc0cf040 con 0x7f08dc15a830 2023-10-16T08:52:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08e29d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc0ca9e0 con 0x7f08dc070a30 2023-10-16T08:52:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08e29d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0ce430 con 0x7f08dc0ca550 2023-10-16T08:52:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08d3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f08dc070a30 0x7f08dc0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08d3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f08dc070a30 0x7f08dc0cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42424/0 (socket says 172.21.15.94:42424) 2023-10-16T08:52:16.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.286+0000 7f08d3fff640 1 -- 172.21.15.94:0/342434746 learned_addr learned my addr 172.21.15.94:0/342434746 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.287+0000 7f08e0f6d640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc0ca550 0x7f08dc0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.287+0000 7f08d3fff640 1 -- 172.21.15.94:0/342434746 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc0ca550 msgr2=0x7f08dc0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.287+0000 7f08d3fff640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc0ca550 0x7f08dc0c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.287+0000 7f08d3fff640 1 -- 172.21.15.94:0/342434746 >> v1:172.21.15.130:6789/0 conn(0x7f08dc15a830 legacy=0x7f08dc070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.287+0000 7f08d3fff640 1 -- 172.21.15.94:0/342434746 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0ce710 con 0x7f08dc070a30 2023-10-16T08:52:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.287+0000 7f08e0f6d640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc0ca550 0x7f08dc0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.288+0000 7f08d3fff640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc070a30 0x7f08dc0cb640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009870 tx=0x7f08c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e954af55c83730b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.288+0000 7f08db7fe640 1 -- 172.21.15.94:0/342434746 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4031640 con 0x7f08dc070a30 2023-10-16T08:52:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.288+0000 7f08db7fe640 1 -- 172.21.15.94:0/342434746 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c40317a0 con 0x7f08dc070a30 2023-10-16T08:52:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.288+0000 7f08db7fe640 1 -- 172.21.15.94:0/342434746 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4031b30 con 0x7f08dc070a30 2023-10-16T08:52:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 -- 172.21.15.94:0/342434746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc070a30 msgr2=0x7f08dc0cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc070a30 0x7f08dc0cb640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009870 tx=0x7f08c402b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 -- 172.21.15.94:0/342434746 shutdown_connections 2023-10-16T08:52:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc0ca550 0x7f08dc0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 --2- 172.21.15.94:0/342434746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc070a30 0x7f08dc0cb640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 -- 172.21.15.94:0/342434746 >> 172.21.15.94:0/342434746 conn(0x7f08dc0b0030 msgr2=0x7f08dc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 -- 172.21.15.94:0/342434746 shutdown_connections 2023-10-16T08:52:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.289+0000 7f08e29d0640 1 -- 172.21.15.94:0/342434746 wait complete. 2023-10-16T08:52:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.291+0000 7f08e29d0640 1 Processor -- start 2023-10-16T08:52:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.291+0000 7f08e29d0640 1 -- start start 2023-10-16T08:52:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08e29d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc070a30 0x7f08dc0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08e29d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 0x7f08dc158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08e29d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08dc15a830 0x7f08dc158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08e29d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc1592c0 con 0x7f08dc0ca550 2023-10-16T08:52:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08e29d0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0c8100 con 0x7f08dc15a830 2023-10-16T08:52:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08e29d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0c6b20 con 0x7f08dc070a30 2023-10-16T08:52:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 0x7f08dc158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 0x7f08dc158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42440/0 (socket says 172.21.15.94:42440) 2023-10-16T08:52:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.292+0000 7f08d3fff640 1 -- 172.21.15.94:0/1772646241 learned_addr learned my addr 172.21.15.94:0/1772646241 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08dbfff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc070a30 0x7f08dc0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d3fff640 1 -- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc070a30 msgr2=0x7f08dc0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d3fff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc070a30 0x7f08dc0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d3fff640 1 -- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08dc15a830 msgr2=0x7f08dc158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d3fff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08dc15a830 0x7f08dc158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d3fff640 1 -- 172.21.15.94:0/1772646241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40094d0 con 0x7f08dc0ca550 2023-10-16T08:52:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08dbfff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc070a30 0x7f08dc0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d3fff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 0x7f08dc158840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f08c4000c00 tx=0x7f08c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c403ac60 con 0x7f08dc0ca550 2023-10-16T08:52:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c403ade0 con 0x7f08dc0ca550 2023-10-16T08:52:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4044630 con 0x7f08dc0ca550 2023-10-16T08:52:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08dc0c6e00 con 0x7f08dc0ca550 2023-10-16T08:52:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.293+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc0c73c0 con 0x7f08dc0ca550 2023-10-16T08:52:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.294+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc0cdd90 con 0x7f08dc0ca550 2023-10-16T08:52:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.295+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f08c402f050 con 0x7f08dc0ca550 2023-10-16T08:52:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.296+0000 7f08d97fa640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f08bc06ae70 0x7f08bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.296+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08c40abb50 con 0x7f08dc0ca550 2023-10-16T08:52:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.296+0000 7f08dbfff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f08bc06ae70 0x7f08bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.297+0000 7f08dbfff640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f08bc06ae70 0x7f08bc06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08dc1f5960 tx=0x7f08cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.301+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08c4076830 con 0x7f08dc0ca550 2023-10-16T08:52:16.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.492+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08dc073ef0 con 0x7f08dc0ca550 2023-10-16T08:52:16.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.493+0000 7f08d97fa640 1 -- 172.21.15.94:0/1772646241 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08c40350a0 con 0x7f08dc0ca550 2023-10-16T08:52:16.495 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:16.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f08bc06ae70 msgr2=0x7f08bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f08bc06ae70 0x7f08bc06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08dc1f5960 tx=0x7f08cc008040 comp rx=0 tx=0).stop 2023-10-16T08:52:16.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 msgr2=0x7f08dc158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 0x7f08dc158840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f08c4000c00 tx=0x7f08c40046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 shutdown_connections 2023-10-16T08:52:16.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f08bc06ae70 0x7f08bc06d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08dc15a830 0x7f08dc158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f08dc0ca550 0x7f08dc158840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 --2- 172.21.15.94:0/1772646241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08dc070a30 0x7f08dc0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 >> 172.21.15.94:0/1772646241 conn(0x7f08dc0b0030 msgr2=0x7f08dc0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:16.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 shutdown_connections 2023-10-16T08:52:16.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.496+0000 7f08e29d0640 1 -- 172.21.15.94:0/1772646241 wait complete. 2023-10-16T08:52:16.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:16.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.735+0000 7f906cd2c640 1 Processor -- start 2023-10-16T08:52:16.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.736+0000 7f906cd2c640 1 -- start start 2023-10-16T08:52:16.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.737+0000 7f906cd2c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f906815a830 0x7f90680cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.737+0000 7f906cd2c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90680ca550 0x7f9068070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.737+0000 7f906cd2c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90680cf040 con 0x7f9068070860 2023-10-16T08:52:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.737+0000 7f906cd2c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9068070cf0 con 0x7f906815a830 2023-10-16T08:52:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.737+0000 7f906cd2c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90680ca9e0 con 0x7f90680ca550 2023-10-16T08:52:16.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f906815a830 0x7f90680cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f906815a830 0x7f90680cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42454/0 (socket says 172.21.15.94:42454) 2023-10-16T08:52:16.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 -- 172.21.15.94:0/2797797073 learned_addr learned my addr 172.21.15.94:0/2797797073 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f9065d9b640 1 --2- 172.21.15.94:0/2797797073 >> v2:172.21.15.130:3300/0 conn(0x7f90680ca550 0x7f9068070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 -- 172.21.15.94:0/2797797073 >> v2:172.21.15.130:3300/0 conn(0x7f90680ca550 msgr2=0x7f9068070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 --2- 172.21.15.94:0/2797797073 >> v2:172.21.15.130:3300/0 conn(0x7f90680ca550 0x7f9068070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 -- 172.21.15.94:0/2797797073 >> v1:172.21.15.130:6789/0 conn(0x7f9068070860 legacy=0x7f906815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f906659c640 1 -- 172.21.15.94:0/2797797073 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680ce430 con 0x7f906815a830 2023-10-16T08:52:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.738+0000 7f9065d9b640 1 --2- 172.21.15.94:0/2797797073 >> v2:172.21.15.130:3300/0 conn(0x7f90680ca550 0x7f9068070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.739+0000 7f906659c640 1 --2- 172.21.15.94:0/2797797073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906815a830 0x7f90680cb640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f90680b0b40 tx=0x7f905802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97851ef76b560102 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906559a640 1 -- 172.21.15.94:0/2797797073 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905802ca80 con 0x7f906815a830 2023-10-16T08:52:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906559a640 1 -- 172.21.15.94:0/2797797073 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905802cbe0 con 0x7f906815a830 2023-10-16T08:52:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906559a640 1 -- 172.21.15.94:0/2797797073 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580343f0 con 0x7f906815a830 2023-10-16T08:52:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 -- 172.21.15.94:0/2797797073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906815a830 msgr2=0x7f90680cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 --2- 172.21.15.94:0/2797797073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906815a830 0x7f90680cb640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f90680b0b40 tx=0x7f905802bee0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 -- 172.21.15.94:0/2797797073 shutdown_connections 2023-10-16T08:52:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 --2- 172.21.15.94:0/2797797073 >> v2:172.21.15.130:3300/0 conn(0x7f90680ca550 0x7f9068070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 --2- 172.21.15.94:0/2797797073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f906815a830 0x7f90680cb640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 -- 172.21.15.94:0/2797797073 >> 172.21.15.94:0/2797797073 conn(0x7f90680b0030 msgr2=0x7f90680b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 -- 172.21.15.94:0/2797797073 shutdown_connections 2023-10-16T08:52:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.740+0000 7f906cd2c640 1 -- 172.21.15.94:0/2797797073 wait complete. 2023-10-16T08:52:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.742+0000 7f906cd2c640 1 Processor -- start 2023-10-16T08:52:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.742+0000 7f906cd2c640 1 -- start start 2023-10-16T08:52:16.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f906cd2c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9068070860 0x7f906815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f906cd2c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 0x7f9068146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f906cd2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f906815a830 0x7f90681469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f906cd2c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9068146f00 con 0x7f90680ca550 2023-10-16T08:52:16.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f906cd2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680c9fb0 con 0x7f906815a830 2023-10-16T08:52:16.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f906cd2c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680c99f0 con 0x7f9068070860 2023-10-16T08:52:16.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.743+0000 7f9065d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 0x7f9068146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 0x7f9068146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42468/0 (socket says 172.21.15.94:42468) 2023-10-16T08:52:16.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 -- 172.21.15.94:0/433816161 learned_addr learned my addr 172.21.15.94:0/433816161 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:16.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f906659c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9068070860 0x7f906815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 -- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9068070860 msgr2=0x7f906815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9068070860 0x7f906815e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 -- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f906815a830 msgr2=0x7f90681469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9066d9d640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f906815a830 0x7f90681469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f906815a830 0x7f90681469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 -- 172.21.15.94:0/433816161 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058009b30 con 0x7f90680ca550 2023-10-16T08:52:16.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.744+0000 7f9065d9b640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 0x7f9068146480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f905000c7f0 tx=0x7f905000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:16.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.745+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050007a30 con 0x7f90680ca550 2023-10-16T08:52:16.753 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.745+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050007b90 con 0x7f90680ca550 2023-10-16T08:52:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.745+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000ce40 con 0x7f90680ca550 2023-10-16T08:52:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.745+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90680c9cd0 con 0x7f90680ca550 2023-10-16T08:52:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.745+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906815c070 con 0x7f90680ca550 2023-10-16T08:52:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.746+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9068073ef0 con 0x7f90680ca550 2023-10-16T08:52:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.747+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90500113f0 con 0x7f90680ca550 2023-10-16T08:52:16.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.748+0000 7f905effd640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f904806ae70 0x7f904806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:16.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.748+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9050089b30 con 0x7f90680ca550 2023-10-16T08:52:16.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.749+0000 7f906659c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f904806ae70 0x7f904806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:16.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.749+0000 7f906659c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f904806ae70 0x7f904806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9058035000 tx=0x7f9058030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:16.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.753+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9050054810 con 0x7f90680ca550 2023-10-16T08:52:16.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.943+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90680b1b30 con 0x7f90680ca550 2023-10-16T08:52:16.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.944+0000 7f905effd640 1 -- 172.21.15.94:0/433816161 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f905001f0a0 con 0x7f90680ca550 2023-10-16T08:52:16.946 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:16.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f904806ae70 msgr2=0x7f904806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f904806ae70 0x7f904806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9058035000 tx=0x7f9058030000 comp rx=0 tx=0).stop 2023-10-16T08:52:16.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 msgr2=0x7f9068146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:16.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 0x7f9068146480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f905000c7f0 tx=0x7f905000cbf0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 shutdown_connections 2023-10-16T08:52:16.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f904806ae70 0x7f904806d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f906815a830 0x7f90681469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90680ca550 0x7f9068146480 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 --2- 172.21.15.94:0/433816161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9068070860 0x7f906815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:16.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 >> 172.21.15.94:0/433816161 conn(0x7f90680b0030 msgr2=0x7f90680b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:16.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 shutdown_connections 2023-10-16T08:52:16.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:16.946+0000 7f906cd2c640 1 -- 172.21.15.94:0/433816161 wait complete. 2023-10-16T08:52:16.966 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:17.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.166+0000 7f2575167640 1 Processor -- start 2023-10-16T08:52:17.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.166+0000 7f2575167640 1 -- start start 2023-10-16T08:52:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.167+0000 7f2575167640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257015d5e0 0x7f25700cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.167+0000 7f2575167640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2570070890 0x7f25700cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2575167640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700cd590 con 0x7f2570158d70 2023-10-16T08:52:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2575167640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700c8a60 con 0x7f2570070890 2023-10-16T08:52:17.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2575167640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cd7d0 con 0x7f257015d5e0 2023-10-16T08:52:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2570070890 0x7f25700cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2570070890 0x7f25700cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42470/0 (socket says 172.21.15.94:42470) 2023-10-16T08:52:17.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 -- 172.21.15.94:0/2585866396 learned_addr learned my addr 172.21.15.94:0/2585866396 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 -- 172.21.15.94:0/2585866396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257015d5e0 msgr2=0x7f25700cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2567fff640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257015d5e0 0x7f25700cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257015d5e0 0x7f25700cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 -- 172.21.15.94:0/2585866396 >> v1:172.21.15.130:6789/0 conn(0x7f2570158d70 legacy=0x7f25700cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:17.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2574966640 1 -- 172.21.15.94:0/2585866396 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700cdab0 con 0x7f2570070890 2023-10-16T08:52:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.168+0000 7f2567fff640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257015d5e0 0x7f25700cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:17.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.170+0000 7f2574966640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2570070890 0x7f25700cb2c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2568009e50 tx=0x7f256802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a68111182d1925b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:17.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.170+0000 7f256f7fe640 1 -- 172.21.15.94:0/2585866396 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256802ca80 con 0x7f2570070890 2023-10-16T08:52:17.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.170+0000 7f256f7fe640 1 -- 172.21.15.94:0/2585866396 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256802cbe0 con 0x7f2570070890 2023-10-16T08:52:17.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.170+0000 7f256f7fe640 1 -- 172.21.15.94:0/2585866396 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25680343f0 con 0x7f2570070890 2023-10-16T08:52:17.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.170+0000 7f2575167640 1 -- 172.21.15.94:0/2585866396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2570070890 msgr2=0x7f25700cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.170+0000 7f2575167640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2570070890 0x7f25700cb2c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2568009e50 tx=0x7f256802bee0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.171+0000 7f2575167640 1 -- 172.21.15.94:0/2585866396 shutdown_connections 2023-10-16T08:52:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.171+0000 7f2575167640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2570070890 0x7f25700cb2c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.171+0000 7f2575167640 1 --2- 172.21.15.94:0/2585866396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257015d5e0 0x7f25700cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.171+0000 7f2575167640 1 -- 172.21.15.94:0/2585866396 >> 172.21.15.94:0/2585866396 conn(0x7f257006a470 msgr2=0x7f25700afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.171+0000 7f2575167640 1 -- 172.21.15.94:0/2585866396 shutdown_connections 2023-10-16T08:52:17.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.171+0000 7f2575167640 1 -- 172.21.15.94:0/2585866396 wait complete. 2023-10-16T08:52:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.172+0000 7f2575167640 1 Processor -- start 2023-10-16T08:52:17.178 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 -- start start 2023-10-16T08:52:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2570070890 0x7f257014f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2570158d70 0x7f257014c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.179 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 0x7f25700c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257014cc00 con 0x7f257015d5e0 2023-10-16T08:52:17.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700c6b00 con 0x7f2570070890 2023-10-16T08:52:17.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.173+0000 7f2575167640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257014d090 con 0x7f2570158d70 2023-10-16T08:52:17.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 0x7f25700c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 0x7f25700c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42478/0 (socket says 172.21.15.94:42478) 2023-10-16T08:52:17.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 -- 172.21.15.94:0/1603818448 learned_addr learned my addr 172.21.15.94:0/1603818448 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2567fff640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2570158d70 0x7f257014c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f256ffff640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2570070890 0x7f257014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 -- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2570158d70 msgr2=0x7f257014c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2570158d70 0x7f257014c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 -- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2570070890 msgr2=0x7f257014f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2570070890 0x7f257014f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.174+0000 7f2574966640 1 -- 172.21.15.94:0/1603818448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568009b30 con 0x7f257015d5e0 2023-10-16T08:52:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.175+0000 7f2574966640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 0x7f25700c7520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2568009e50 tx=0x7f2568004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.175+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256803e450 con 0x7f257015d5e0 2023-10-16T08:52:17.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.175+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256803e5d0 con 0x7f257015d5e0 2023-10-16T08:52:17.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.175+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256803e980 con 0x7f257015d5e0 2023-10-16T08:52:17.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.175+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25700c5ef0 con 0x7f257015d5e0 2023-10-16T08:52:17.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.175+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25700c64b0 con 0x7f257015d5e0 2023-10-16T08:52:17.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.176+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257014e6e0 con 0x7f257015d5e0 2023-10-16T08:52:17.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.177+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f256802cd50 con 0x7f257015d5e0 2023-10-16T08:52:17.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.178+0000 7f256d7fa640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f255006ae70 0x7f255006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.178+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f25680ac480 con 0x7f257015d5e0 2023-10-16T08:52:17.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.178+0000 7f256ffff640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f255006ae70 0x7f255006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.179+0000 7f256ffff640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f255006ae70 0x7f255006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2560003e00 tx=0x7f2560009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:17.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.182+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2568077180 con 0x7f257015d5e0 2023-10-16T08:52:17.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.372+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25700cd590 con 0x7f257015d5e0 2023-10-16T08:52:17.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.374+0000 7f256d7fa640 1 -- 172.21.15.94:0/1603818448 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f25700cd590 con 0x7f257015d5e0 2023-10-16T08:52:17.377 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:17.377 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:17.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f255006ae70 msgr2=0x7f255006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f255006ae70 0x7f255006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2560003e00 tx=0x7f2560009040 comp rx=0 tx=0).stop 2023-10-16T08:52:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 msgr2=0x7f25700c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 0x7f25700c7520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2568009e50 tx=0x7f2568004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 shutdown_connections 2023-10-16T08:52:17.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f257015d5e0 0x7f25700c7520 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2570158d70 0x7f257014c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f255006ae70 0x7f255006d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 --2- 172.21.15.94:0/1603818448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2570070890 0x7f257014f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.377+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 >> 172.21.15.94:0/1603818448 conn(0x7f257006a470 msgr2=0x7f257014ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:17.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.378+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 shutdown_connections 2023-10-16T08:52:17.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.378+0000 7f2575167640 1 -- 172.21.15.94:0/1603818448 wait complete. 2023-10-16T08:52:17.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:17.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.615+0000 7f076a127640 1 Processor -- start 2023-10-16T08:52:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.615+0000 7f076a127640 1 -- start start 2023-10-16T08:52:17.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.617+0000 7f076a127640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 0x7f0764159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.617+0000 7f076a127640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640c89d0 con 0x7f0764071f30 2023-10-16T08:52:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.617+0000 7f076a127640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0764071600 con 0x7f07640cdc00 2023-10-16T08:52:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.617+0000 7f076a127640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076415a260 con 0x7f0764071b50 2023-10-16T08:52:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.617+0000 7f0768924640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0764071f30 0x7f0764070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58658/0 (socket says 172.21.15.94:58658) 2023-10-16T08:52:17.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.617+0000 7f0768924640 1 -- 172.21.15.94:0/3998565684 learned_addr learned my addr 172.21.15.94:0/3998565684 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f0769125640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 0x7f0764159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095520048 0 0) 0x7f07640c89d0 con 0x7f0764071f30 2023-10-16T08:52:17.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0750005730 con 0x7f0764071f30 2023-10-16T08:52:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314086609 0 0) 0x7f0750005730 con 0x7f0764071f30 2023-10-16T08:52:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 msgr2=0x7f0764159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 0x7f0764159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 >> v1:172.21.15.130:6789/0 conn(0x7f07640cdc00 legacy=0x7f076406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076415a540 con 0x7f0764071f30 2023-10-16T08:52:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f0754001670 con 0x7f0764071f30 2023-10-16T08:52:17.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 >> v1:172.21.15.94:6789/0 conn(0x7f0764071f30 legacy=0x7f0764070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 0x7f0750005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006130 0x7f07500069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0750006f10 0x7f0750007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076415a260 con 0x7f0750006f10 2023-10-16T08:52:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075000dc70 con 0x7f0750006130 2023-10-16T08:52:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.618+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075000de30 con 0x7f0764071b50 2023-10-16T08:52:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0769926640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0750006f10 0x7f0750007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0768924640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006130 0x7f07500069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0769926640 1 -- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 msgr2=0x7f0750005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:17.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0769926640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0764071b50 0x7f0750005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0769926640 1 -- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006130 msgr2=0x7f07500069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0769926640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006130 0x7f07500069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.619+0000 7f0769926640 1 -- 172.21.15.94:0/3998565684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750005730 con 0x7f0750006f10 2023-10-16T08:52:17.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.620+0000 7f0769926640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0750006f10 0x7f0750007390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f075c001e50 tx=0x7f0750007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b306703f8b4fb5ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:17.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.620+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c003b70 con 0x7f0750006f10 2023-10-16T08:52:17.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.620+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c003cd0 con 0x7f0750006f10 2023-10-16T08:52:17.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.620+0000 7f075bfff640 1 -- 172.21.15.94:0/3998565684 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c005310 con 0x7f0750006f10 2023-10-16T08:52:17.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f076a127640 1 -- 172.21.15.94:0/3998565684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0750006f10 msgr2=0x7f0750007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f076a127640 1 --2- 172.21.15.94:0/3998565684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0750006f10 0x7f0750007390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f075c001e50 tx=0x7f0750007a00 comp rx=0 tx=0).stop 2023-10-16T08:52:17.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f0769926640 1 -- 172.21.15.94:0/3998565684 reap_dead start 2023-10-16T08:52:17.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f076a127640 1 -- 172.21.15.94:0/3998565684 shutdown_connections 2023-10-16T08:52:17.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f076a127640 1 -- 172.21.15.94:0/3998565684 >> 172.21.15.94:0/3998565684 conn(0x7f076406a470 msgr2=0x7f07640afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:17.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f076a127640 1 -- 172.21.15.94:0/3998565684 shutdown_connections 2023-10-16T08:52:17.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.621+0000 7f076a127640 1 -- 172.21.15.94:0/3998565684 wait complete. 2023-10-16T08:52:17.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.623+0000 7f076a127640 1 Processor -- start 2023-10-16T08:52:17.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.623+0000 7f076a127640 1 -- start start 2023-10-16T08:52:17.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f076a127640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006f10 0x7f07640c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f076a127640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f07640c7950 0x7f0764149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f076a127640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 0x7f07640ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f076a127640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640cd0c0 con 0x7f07640cc700 2023-10-16T08:52:17.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f076a127640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07641e5000 con 0x7f0750006f10 2023-10-16T08:52:17.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f076a127640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c6380 con 0x7f07640c7950 2023-10-16T08:52:17.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f0769926640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 0x7f07640ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f0769926640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 0x7f07640ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42498/0 (socket says 172.21.15.94:42498) 2023-10-16T08:52:17.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.624+0000 7f0769926640 1 -- 172.21.15.94:0/4100747920 learned_addr learned my addr 172.21.15.94:0/4100747920 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:17.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0768924640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f07640c7950 0x7f0764149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769125640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006f10 0x7f07640c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769926640 1 -- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f07640c7950 msgr2=0x7f0764149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769926640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f07640c7950 0x7f0764149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769926640 1 -- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006f10 msgr2=0x7f07640c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769926640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006f10 0x7f07640c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769926640 1 -- 172.21.15.94:0/4100747920 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640c6660 con 0x7f07640cc700 2023-10-16T08:52:17.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0769926640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 0x7f07640ccb80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f075c02c060 tx=0x7f075c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:17.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c03e070 con 0x7f07640cc700 2023-10-16T08:52:17.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c003e40 con 0x7f07640cc700 2023-10-16T08:52:17.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c006d90 con 0x7f07640cc700 2023-10-16T08:52:17.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.625+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07640c6940 con 0x7f07640cc700 2023-10-16T08:52:17.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.626+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0764149f90 con 0x7f07640cc700 2023-10-16T08:52:17.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.627+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07641e5190 con 0x7f07640cc700 2023-10-16T08:52:17.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.628+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f075c007030 con 0x7f07640cc700 2023-10-16T08:52:17.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.628+0000 7f0759ffb640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f074806aea0 0x7f074806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.629+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f075c0aac90 con 0x7f07640cc700 2023-10-16T08:52:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.629+0000 7f0769125640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f074806aea0 0x7f074806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.629+0000 7f0769125640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f074806aea0 0x7f074806d360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0760004770 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:17.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.633+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07641e5190 con 0x7f07640cc700 2023-10-16T08:52:17.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.822+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f076404e9b0 con 0x7f07640cc700 2023-10-16T08:52:17.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.823+0000 7f0759ffb640 1 -- 172.21.15.94:0/4100747920 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f075c048070 con 0x7f07640cc700 2023-10-16T08:52:17.826 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:17.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f074806aea0 msgr2=0x7f074806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f074806aea0 0x7f074806d360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0760004770 tx=0x7f0760008040 comp rx=0 tx=0).stop 2023-10-16T08:52:17.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 msgr2=0x7f07640ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:17.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 0x7f07640ccb80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f075c02c060 tx=0x7f075c0014a0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 shutdown_connections 2023-10-16T08:52:17.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07640cc700 0x7f07640ccb80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f07640c7950 0x7f0764149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f074806aea0 0x7f074806d360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 --2- 172.21.15.94:0/4100747920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0750006f10 0x7f07640c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:17.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.825+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 >> 172.21.15.94:0/4100747920 conn(0x7f076406a470 msgr2=0x7f076414b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:17.830 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.826+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 shutdown_connections 2023-10-16T08:52:17.830 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:17.826+0000 7f076a127640 1 -- 172.21.15.94:0/4100747920 wait complete. 2023-10-16T08:52:17.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:18.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.053+0000 7f2561239640 1 Processor -- start 2023-10-16T08:52:18.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.053+0000 7f2561239640 1 -- start start 2023-10-16T08:52:18.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.055+0000 7f2561239640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 0x7f255c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.055+0000 7f2561239640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f255c0c8ea0 0x7f255c0c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.055+0000 7f2561239640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c072480 con 0x7f255c159890 2023-10-16T08:52:18.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.055+0000 7f2561239640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0cd0c0 con 0x7f255c0c8ea0 2023-10-16T08:52:18.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.055+0000 7f2561239640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cc540 con 0x7f255c0ca820 2023-10-16T08:52:18.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 0x7f255c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 0x7f255c071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:46510/0 (socket says 172.21.15.94:46510) 2023-10-16T08:52:18.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 -- 172.21.15.94:0/3932077799 learned_addr learned my addr 172.21.15.94:0/3932077799 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:18.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f255b59e640 1 --2- 172.21.15.94:0/3932077799 >> v2:172.21.15.130:3300/0 conn(0x7f255c0c8ea0 0x7f255c0c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 -- 172.21.15.94:0/3932077799 >> v2:172.21.15.130:3300/0 conn(0x7f255c0c8ea0 msgr2=0x7f255c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:18.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 --2- 172.21.15.94:0/3932077799 >> v2:172.21.15.130:3300/0 conn(0x7f255c0c8ea0 0x7f255c0c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 -- 172.21.15.94:0/3932077799 >> v1:172.21.15.130:6789/0 conn(0x7f255c159890 legacy=0x7f255c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.056+0000 7f2553fff640 1 -- 172.21.15.94:0/3932077799 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0cc820 con 0x7f255c0ca820 2023-10-16T08:52:18.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.058+0000 7f2553fff640 1 --2- 172.21.15.94:0/3932077799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 0x7f255c071f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2544009870 tx=0x7f254402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262e989ee191e3c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.058+0000 7f255a59c640 1 -- 172.21.15.94:0/3932077799 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544030840 con 0x7f255c0ca820 2023-10-16T08:52:18.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.058+0000 7f255a59c640 1 -- 172.21.15.94:0/3932077799 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25440309a0 con 0x7f255c0ca820 2023-10-16T08:52:18.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.058+0000 7f255a59c640 1 -- 172.21.15.94:0/3932077799 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544030d30 con 0x7f255c0ca820 2023-10-16T08:52:18.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 -- 172.21.15.94:0/3932077799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 msgr2=0x7f255c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 --2- 172.21.15.94:0/3932077799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 0x7f255c071f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2544009870 tx=0x7f254402b980 comp rx=0 tx=0).stop 2023-10-16T08:52:18.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 -- 172.21.15.94:0/3932077799 shutdown_connections 2023-10-16T08:52:18.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 --2- 172.21.15.94:0/3932077799 >> v2:172.21.15.130:3300/0 conn(0x7f255c0c8ea0 0x7f255c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 --2- 172.21.15.94:0/3932077799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c0ca820 0x7f255c071f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 -- 172.21.15.94:0/3932077799 >> 172.21.15.94:0/3932077799 conn(0x7f255c0b0030 msgr2=0x7f255c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:18.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 -- 172.21.15.94:0/3932077799 shutdown_connections 2023-10-16T08:52:18.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.059+0000 7f2561239640 1 -- 172.21.15.94:0/3932077799 wait complete. 2023-10-16T08:52:18.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.061+0000 7f2561239640 1 Processor -- start 2023-10-16T08:52:18.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.061+0000 7f2561239640 1 -- start start 2023-10-16T08:52:18.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2561239640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f255c0c8ea0 0x7f255c14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2561239640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 0x7f255c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2561239640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c159890 0x7f255c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.067 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2561239640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0c5750 con 0x7f255c0ca820 2023-10-16T08:52:18.067 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2561239640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0c46c0 con 0x7f255c0c8ea0 2023-10-16T08:52:18.067 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2561239640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0c49a0 con 0x7f255c159890 2023-10-16T08:52:18.067 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2553fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 0x7f255c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.067 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2553fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 0x7f255c0c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42500/0 (socket says 172.21.15.94:42500) 2023-10-16T08:52:18.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.062+0000 7f2553fff640 1 -- 172.21.15.94:0/2730405736 learned_addr learned my addr 172.21.15.94:0/2730405736 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:18.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f255ad9d640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f255c0c8ea0 0x7f255c14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f255b59e640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c159890 0x7f255c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f2553fff640 1 -- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c159890 msgr2=0x7f255c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f2553fff640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c159890 0x7f255c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f2553fff640 1 -- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f255c0c8ea0 msgr2=0x7f255c14e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f2553fff640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f255c0c8ea0 0x7f255c14e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f2553fff640 1 -- 172.21.15.94:0/2730405736 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25440094d0 con 0x7f255c0ca820 2023-10-16T08:52:18.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.063+0000 7f2553fff640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 0x7f255c0c7c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f2544004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.064+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544039a90 con 0x7f255c0ca820 2023-10-16T08:52:18.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.064+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544039bf0 con 0x7f255c0ca820 2023-10-16T08:52:18.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.064+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544043410 con 0x7f255c0ca820 2023-10-16T08:52:18.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.064+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c0c4c80 con 0x7f255c0ca820 2023-10-16T08:52:18.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.064+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c0c42b0 con 0x7f255c0ca820 2023-10-16T08:52:18.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.065+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c073ef0 con 0x7f255c0ca820 2023-10-16T08:52:18.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.066+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f254402f390 con 0x7f255c0ca820 2023-10-16T08:52:18.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.067+0000 7f25537fe640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f253c06ae70 0x7f253c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.067+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f25440aba50 con 0x7f255c0ca820 2023-10-16T08:52:18.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.067+0000 7f255ad9d640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f253c06ae70 0x7f253c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.068+0000 7f255ad9d640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f253c06ae70 0x7f253c06d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f254c000f60 tx=0x7f254c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.072+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25440768f0 con 0x7f255c0ca820 2023-10-16T08:52:18.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.261+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f255c0ceb40 con 0x7f255c0ca820 2023-10-16T08:52:18.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.262+0000 7f25537fe640 1 -- 172.21.15.94:0/2730405736 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2544079f10 con 0x7f255c0ca820 2023-10-16T08:52:18.264 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f253c06ae70 msgr2=0x7f253c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f253c06ae70 0x7f253c06d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f254c000f60 tx=0x7f254c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:18.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 msgr2=0x7f255c0c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 0x7f255c0c7c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f2544004730 comp rx=0 tx=0).stop 2023-10-16T08:52:18.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 shutdown_connections 2023-10-16T08:52:18.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255c159890 0x7f255c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f255c0ca820 0x7f255c0c7c50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f253c06ae70 0x7f253c06d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 --2- 172.21.15.94:0/2730405736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f255c0c8ea0 0x7f255c14e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.264+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 >> 172.21.15.94:0/2730405736 conn(0x7f255c0b0030 msgr2=0x7f255c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.265+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 shutdown_connections 2023-10-16T08:52:18.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.265+0000 7f2561239640 1 -- 172.21.15.94:0/2730405736 wait complete. 2023-10-16T08:52:18.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:18.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.501+0000 7fceb0e7c640 1 Processor -- start 2023-10-16T08:52:18.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.501+0000 7fceb0e7c640 1 -- start start 2023-10-16T08:52:18.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceb0e7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac15cbf0 0x7fceac0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceb0e7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fceac1611f0 0x7fceac0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceb0e7c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fceac15cfd0 0x7fceac15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceb0e7c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0cb720 con 0x7fceac15cfd0 2023-10-16T08:52:18.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceb0e7c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac160730 con 0x7fceac1611f0 2023-10-16T08:52:18.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceb0e7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac15dd60 con 0x7fceac15cbf0 2023-10-16T08:52:18.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceaad9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fceac15cfd0 0x7fceac15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceaad9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fceac15cfd0 0x7fceac15d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42510/0 (socket says 172.21.15.94:42510) 2023-10-16T08:52:18.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceaad9d640 1 -- 172.21.15.94:0/4151776809 learned_addr learned my addr 172.21.15.94:0/4151776809 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:18.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fcea3fff640 1 --2- 172.21.15.94:0/4151776809 >> v2:172.21.15.130:3300/0 conn(0x7fceac1611f0 0x7fceac0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.503+0000 7fceaa59c640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac15cbf0 0x7fceac0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fceaad9d640 1 -- 172.21.15.94:0/4151776809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac15cbf0 msgr2=0x7fceac0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:18.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fceaad9d640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac15cbf0 0x7fceac0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fceaad9d640 1 -- 172.21.15.94:0/4151776809 >> v2:172.21.15.130:3300/0 conn(0x7fceac1611f0 msgr2=0x7fceac0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:18.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fceaad9d640 1 --2- 172.21.15.94:0/4151776809 >> v2:172.21.15.130:3300/0 conn(0x7fceac1611f0 0x7fceac0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fceaad9d640 1 -- 172.21.15.94:0/4151776809 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac1609f0 con 0x7fceac15cfd0 2023-10-16T08:52:18.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fceaa59c640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac15cbf0 0x7fceac0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:18.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.504+0000 7fcea3fff640 1 --2- 172.21.15.94:0/4151776809 >> v2:172.21.15.130:3300/0 conn(0x7fceac1611f0 0x7fceac0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:18.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.505+0000 7fceaad9d640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cfd0 0x7fceac15d460 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fceac0cf5d0 tx=0x7fcea402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bb401205ea1118 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.505+0000 7fcea9d9b640 1 -- 172.21.15.94:0/4151776809 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea402c9f0 con 0x7fceac15cfd0 2023-10-16T08:52:18.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fcea9d9b640 1 -- 172.21.15.94:0/4151776809 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea402cb50 con 0x7fceac15cfd0 2023-10-16T08:52:18.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fcea9d9b640 1 -- 172.21.15.94:0/4151776809 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40343f0 con 0x7fceac15cfd0 2023-10-16T08:52:18.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 -- 172.21.15.94:0/4151776809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cfd0 msgr2=0x7fceac15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cfd0 0x7fceac15d460 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fceac0cf5d0 tx=0x7fcea402be50 comp rx=0 tx=0).stop 2023-10-16T08:52:18.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 -- 172.21.15.94:0/4151776809 shutdown_connections 2023-10-16T08:52:18.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cfd0 0x7fceac15d460 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/4151776809 >> v2:172.21.15.130:3300/0 conn(0x7fceac1611f0 0x7fceac0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/4151776809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac15cbf0 0x7fceac0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 -- 172.21.15.94:0/4151776809 >> 172.21.15.94:0/4151776809 conn(0x7fceac0b0030 msgr2=0x7fceac0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:18.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 -- 172.21.15.94:0/4151776809 shutdown_connections 2023-10-16T08:52:18.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.506+0000 7fceb0e7c640 1 -- 172.21.15.94:0/4151776809 wait complete. 2023-10-16T08:52:18.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.509+0000 7fceb0e7c640 1 Processor -- start 2023-10-16T08:52:18.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.509+0000 7fceb0e7c640 1 -- start start 2023-10-16T08:52:18.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceb0e7c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 0x7fceac149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceb0e7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fceac15cfd0 0x7fceac0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceb0e7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac1611f0 0x7fceac15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceb0e7c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac15c410 con 0x7fceac15cbf0 2023-10-16T08:52:18.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceb0e7c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac158980 con 0x7fceac15cfd0 2023-10-16T08:52:18.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceb0e7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0ae640 con 0x7fceac1611f0 2023-10-16T08:52:18.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceaa59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 0x7fceac149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceaa59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 0x7fceac149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42524/0 (socket says 172.21.15.94:42524) 2023-10-16T08:52:18.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.510+0000 7fceaa59c640 1 -- 172.21.15.94:0/385464647 learned_addr learned my addr 172.21.15.94:0/385464647 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:18.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaad9d640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac1611f0 0x7fceac15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaa59c640 1 -- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac1611f0 msgr2=0x7fceac15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaa59c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac1611f0 0x7fceac15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaa59c640 1 -- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fceac15cfd0 msgr2=0x7fceac0ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaa59c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fceac15cfd0 0x7fceac0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaa59c640 1 -- 172.21.15.94:0/385464647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009b30 con 0x7fceac15cbf0 2023-10-16T08:52:18.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceaa59c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 0x7fceac149270 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00e810 tx=0x7fce9c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c004030 con 0x7fceac15cbf0 2023-10-16T08:52:18.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c004190 con 0x7fceac15cbf0 2023-10-16T08:52:18.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c004520 con 0x7fceac15cbf0 2023-10-16T08:52:18.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac158c20 con 0x7fceac15cbf0 2023-10-16T08:52:18.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.511+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac1591e0 con 0x7fceac15cbf0 2023-10-16T08:52:18.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.512+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac073ef0 con 0x7fceac15cbf0 2023-10-16T08:52:18.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.513+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce9c00c6d0 con 0x7fceac15cbf0 2023-10-16T08:52:18.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.514+0000 7fcea2ffd640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce8c06ae70 0x7fce8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.514+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce9c089540 con 0x7fceac15cbf0 2023-10-16T08:52:18.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.515+0000 7fcea3fff640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce8c06ae70 0x7fce8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.515+0000 7fcea3fff640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce8c06ae70 0x7fce8c06d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce94006e80 tx=0x7fce94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.518+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce9c0542c0 con 0x7fceac15cbf0 2023-10-16T08:52:18.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.707+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fceac0cc1a0 con 0x7fceac15cbf0 2023-10-16T08:52:18.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.708+0000 7fcea2ffd640 1 -- 172.21.15.94:0/385464647 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce9c0578e0 con 0x7fceac15cbf0 2023-10-16T08:52:18.710 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:18.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce8c06ae70 msgr2=0x7fce8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce8c06ae70 0x7fce8c06d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce94006e80 tx=0x7fce94008040 comp rx=0 tx=0).stop 2023-10-16T08:52:18.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 msgr2=0x7fceac149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 0x7fceac149270 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00e810 tx=0x7fce9c00ecd0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 shutdown_connections 2023-10-16T08:52:18.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fceac1611f0 0x7fceac15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce8c06ae70 0x7fce8c06d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fceac15cfd0 0x7fceac0ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 --2- 172.21.15.94:0/385464647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fceac15cbf0 0x7fceac149270 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 >> 172.21.15.94:0/385464647 conn(0x7fceac0b0030 msgr2=0x7fceac0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:18.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 shutdown_connections 2023-10-16T08:52:18.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.710+0000 7fceb0e7c640 1 -- 172.21.15.94:0/385464647 wait complete. 2023-10-16T08:52:18.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:18.948 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.946+0000 7fac86ee5640 1 Processor -- start 2023-10-16T08:52:18.948 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.946+0000 7fac86ee5640 1 -- start start 2023-10-16T08:52:18.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.947+0000 7fac86ee5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.947+0000 7fac86ee5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac800b8400 0x7fac800d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac86ee5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8015cfd0 con 0x7fac800b4410 2023-10-16T08:52:18.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac86ee5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac800d0dc0 con 0x7fac800b8400 2023-10-16T08:52:18.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac86ee5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800d30b0 con 0x7fac8015cbf0 2023-10-16T08:52:18.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac800b8400 0x7fac800d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac800b8400 0x7fac800d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42532/0 (socket says 172.21.15.94:42532) 2023-10-16T08:52:18.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 -- 172.21.15.94:0/3674051660 learned_addr learned my addr 172.21.15.94:0/3674051660 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:18.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac84c81640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 -- 172.21.15.94:0/3674051660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 msgr2=0x7fac800d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:18.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 -- 172.21.15.94:0/3674051660 >> v1:172.21.15.130:6789/0 conn(0x7fac800b4410 legacy=0x7fac800b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:18.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac7ffff640 1 -- 172.21.15.94:0/3674051660 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac800d0700 con 0x7fac800b8400 2023-10-16T08:52:18.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.948+0000 7fac84c81640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:18.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.950+0000 7fac7ffff640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b8400 0x7fac800d11e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7815d34de1f8e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.950+0000 7fac7f7fe640 1 -- 172.21.15.94:0/3674051660 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c031640 con 0x7fac800b8400 2023-10-16T08:52:18.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.950+0000 7fac7f7fe640 1 -- 172.21.15.94:0/3674051660 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c0317a0 con 0x7fac800b8400 2023-10-16T08:52:18.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.950+0000 7fac7f7fe640 1 -- 172.21.15.94:0/3674051660 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c031b30 con 0x7fac800b8400 2023-10-16T08:52:18.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 -- 172.21.15.94:0/3674051660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b8400 msgr2=0x7fac800d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b8400 0x7fac800d11e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c02b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 -- 172.21.15.94:0/3674051660 shutdown_connections 2023-10-16T08:52:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b8400 0x7fac800d11e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 --2- 172.21.15.94:0/3674051660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 -- 172.21.15.94:0/3674051660 >> 172.21.15.94:0/3674051660 conn(0x7fac80071900 msgr2=0x7fac80071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:18.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 -- 172.21.15.94:0/3674051660 shutdown_connections 2023-10-16T08:52:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.951+0000 7fac86ee5640 1 -- 172.21.15.94:0/3674051660 wait complete. 2023-10-16T08:52:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.952+0000 7fac86ee5640 1 Processor -- start 2023-10-16T08:52:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.953+0000 7fac86ee5640 1 -- start start 2023-10-16T08:52:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac86ee5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 0x7fac801f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac86ee5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac800b8400 0x7fac800ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac86ee5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac86ee5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800c9040 con 0x7fac800b4410 2023-10-16T08:52:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac86ee5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800c8430 con 0x7fac800b8400 2023-10-16T08:52:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac86ee5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800c8710 con 0x7fac8015cbf0 2023-10-16T08:52:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 0x7fac801f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 0x7fac801f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42534/0 (socket says 172.21.15.94:42534) 2023-10-16T08:52:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 -- 172.21.15.94:0/629374595 learned_addr learned my addr 172.21.15.94:0/629374595 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 -- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 msgr2=0x7fac800cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 -- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac800b8400 msgr2=0x7fac800ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac7ffff640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac800b8400 0x7fac800ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac800b8400 0x7fac800ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.954+0000 7fac84c81640 1 -- 172.21.15.94:0/629374595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0094d0 con 0x7fac800b4410 2023-10-16T08:52:18.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.955+0000 7fac84c81640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 0x7fac801f2dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac7400c7f0 tx=0x7fac7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.955+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74007820 con 0x7fac800b4410 2023-10-16T08:52:18.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.955+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74007980 con 0x7fac800b4410 2023-10-16T08:52:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.955+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74007cf0 con 0x7fac800b4410 2023-10-16T08:52:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.955+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac800c89f0 con 0x7fac800b4410 2023-10-16T08:52:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.955+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac801f3300 con 0x7fac800b4410 2023-10-16T08:52:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.956+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac80073ef0 con 0x7fac800b4410 2023-10-16T08:52:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.957+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fac740113f0 con 0x7fac800b4410 2023-10-16T08:52:18.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.958+0000 7fac7d7fa640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fac6406aea0 0x7fac6406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.958+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac74089d90 con 0x7fac800b4410 2023-10-16T08:52:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.958+0000 7fac7ffff640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fac6406aea0 0x7fac6406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.959+0000 7fac7ffff640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fac6406aea0 0x7fac6406d360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fac6c036000 tx=0x7fac6c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:18.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:18.962+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac740549e0 con 0x7fac800b4410 2023-10-16T08:52:19.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.150+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac800b61e0 con 0x7fac800b4410 2023-10-16T08:52:19.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.151+0000 7fac7d7fa640 1 -- 172.21.15.94:0/629374595 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac7401f0a0 con 0x7fac800b4410 2023-10-16T08:52:19.153 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:19.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fac6406aea0 msgr2=0x7fac6406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fac6406aea0 0x7fac6406d360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fac6c036000 tx=0x7fac6c03c040 comp rx=0 tx=0).stop 2023-10-16T08:52:19.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 msgr2=0x7fac801f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 0x7fac801f2dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac7400c7f0 tx=0x7fac7400ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 shutdown_connections 2023-10-16T08:52:19.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac8015cbf0 0x7fac800cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fac6406aea0 0x7fac6406d360 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac800b8400 0x7fac800ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 --2- 172.21.15.94:0/629374595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac800b4410 0x7fac801f2dc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 >> 172.21.15.94:0/629374595 conn(0x7fac80071900 msgr2=0x7fac80071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:19.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 shutdown_connections 2023-10-16T08:52:19.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.154+0000 7fac86ee5640 1 -- 172.21.15.94:0/629374595 wait complete. 2023-10-16T08:52:19.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:19.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.380+0000 7f3120626640 1 Processor -- start 2023-10-16T08:52:19.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.380+0000 7f3120626640 1 -- start start 2023-10-16T08:52:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.381+0000 7f3120626640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f3120626640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311815ad00 0x7f311815f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f3120626640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311815f580 con 0x7f31180b03f0 2023-10-16T08:52:19.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f3120626640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180707f0 con 0x7f311815ad00 2023-10-16T08:52:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f3120626640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3118070ad0 con 0x7f31180b0010 2023-10-16T08:52:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f311dbc1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f311815ad00 0x7f311815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f311ebc3640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f31180b03f0 0x7f311815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58674/0 (socket says 172.21.15.94:58674) 2023-10-16T08:52:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f311ebc3640 1 -- 172.21.15.94:0/145737709 learned_addr learned my addr 172.21.15.94:0/145737709 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:19.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.382+0000 7f311e3c2640 1 --2- 172.21.15.94:0/145737709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.383+0000 7f311dbc1640 1 -- 172.21.15.94:0/145737709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 msgr2=0x7f31180701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.383+0000 7f311dbc1640 1 --2- 172.21.15.94:0/145737709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.383+0000 7f311dbc1640 1 -- 172.21.15.94:0/145737709 >> v1:172.21.15.94:6789/0 conn(0x7f31180b03f0 legacy=0x7f311815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.383+0000 7f311dbc1640 1 -- 172.21.15.94:0/145737709 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311815b1d0 con 0x7f311815ad00 2023-10-16T08:52:19.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.383+0000 7f311d3c0640 1 -- 172.21.15.94:0/145737709 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277664063 0 0) 0x7f3110001490 con 0x7f31180b03f0 2023-10-16T08:52:19.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.384+0000 7f311dbc1640 1 --2- 172.21.15.94:0/145737709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f311815f040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31080097a0 tx=0x7f310802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dff97ccf6b285a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:19.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.384+0000 7f311d3c0640 1 -- 172.21.15.94:0/145737709 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310802d040 con 0x7f311815ad00 2023-10-16T08:52:19.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.384+0000 7f311d3c0640 1 -- 172.21.15.94:0/145737709 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108031810 con 0x7f311815ad00 2023-10-16T08:52:19.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.384+0000 7f311d3c0640 1 -- 172.21.15.94:0/145737709 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108031ba0 con 0x7f311815ad00 2023-10-16T08:52:19.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 -- 172.21.15.94:0/145737709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 msgr2=0x7f311815f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 --2- 172.21.15.94:0/145737709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f311815f040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31080097a0 tx=0x7f310802b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 -- 172.21.15.94:0/145737709 shutdown_connections 2023-10-16T08:52:19.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 --2- 172.21.15.94:0/145737709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f311815f040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 --2- 172.21.15.94:0/145737709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 -- 172.21.15.94:0/145737709 >> 172.21.15.94:0/145737709 conn(0x7f311806c1c0 msgr2=0x7f311806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 -- 172.21.15.94:0/145737709 shutdown_connections 2023-10-16T08:52:19.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.385+0000 7f3120626640 1 -- 172.21.15.94:0/145737709 wait complete. 2023-10-16T08:52:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.387+0000 7f3120626640 1 Processor -- start 2023-10-16T08:52:19.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.387+0000 7f3120626640 1 -- start start 2023-10-16T08:52:19.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f3120626640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f3120626640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31180b03f0 0x7f31181528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f3120626640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f31180cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f3120626640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118152e00 con 0x7f311815ad00 2023-10-16T08:52:19.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f3120626640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31180c6fd0 con 0x7f31180b03f0 2023-10-16T08:52:19.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f3120626640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180c72b0 con 0x7f31180b0010 2023-10-16T08:52:19.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f311ebc3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f31180cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f311ebc3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f31180cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42556/0 (socket says 172.21.15.94:42556) 2023-10-16T08:52:19.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f311ebc3640 1 -- 172.21.15.94:0/1689821354 learned_addr learned my addr 172.21.15.94:0/1689821354 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:19.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f311e3c2640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.388+0000 7f311dbc1640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31180b03f0 0x7f31181528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f311ebc3640 1 -- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 msgr2=0x7f31180c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f311ebc3640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f311ebc3640 1 -- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31180b03f0 msgr2=0x7f31181528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f311ebc3640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31180b03f0 0x7f31181528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f311ebc3640 1 -- 172.21.15.94:0/1689821354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108009400 con 0x7f311815ad00 2023-10-16T08:52:19.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f311ebc3640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f31180cc860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f311000c7f0 tx=0x7f311000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:19.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000a5e0 con 0x7f311815ad00 2023-10-16T08:52:19.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311000a760 con 0x7f311815ad00 2023-10-16T08:52:19.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000ab50 con 0x7f311815ad00 2023-10-16T08:52:19.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31180c7590 con 0x7f311815ad00 2023-10-16T08:52:19.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.389+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31180c7b50 con 0x7f311815ad00 2023-10-16T08:52:19.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.390+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31180c7d40 con 0x7f311815ad00 2023-10-16T08:52:19.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.391+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f311000acb0 con 0x7f311815ad00 2023-10-16T08:52:19.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.392+0000 7f310effd640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f30fc06ae70 0x7f30fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.392+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3110088f00 con 0x7f311815ad00 2023-10-16T08:52:19.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.393+0000 7f311e3c2640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f30fc06ae70 0x7f30fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.393+0000 7f311e3c2640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f30fc06ae70 0x7f30fc06d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3114006fd0 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:19.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.396+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3110053ac0 con 0x7f311815ad00 2023-10-16T08:52:19.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.584+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f311815f580 con 0x7f311815ad00 2023-10-16T08:52:19.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.586+0000 7f310effd640 1 -- 172.21.15.94:0/1689821354 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f311815f580 con 0x7f311815ad00 2023-10-16T08:52:19.589 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:19.589 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:19.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f30fc06ae70 msgr2=0x7f30fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f30fc06ae70 0x7f30fc06d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3114006fd0 tx=0x7f3114008040 comp rx=0 tx=0).stop 2023-10-16T08:52:19.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 msgr2=0x7f31180cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f31180cc860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f311000c7f0 tx=0x7f311000ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 shutdown_connections 2023-10-16T08:52:19.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f311815ad00 0x7f31180cc860 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f30fc06ae70 0x7f30fc06d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31180b03f0 0x7f31181528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 --2- 172.21.15.94:0/1689821354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31180b0010 0x7f31180c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 >> 172.21.15.94:0/1689821354 conn(0x7f311806c1c0 msgr2=0x7f31180ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:19.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 shutdown_connections 2023-10-16T08:52:19.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.589+0000 7f3120626640 1 -- 172.21.15.94:0/1689821354 wait complete. 2023-10-16T08:52:19.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:19.611 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:19.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.817+0000 7fbee20b4640 1 Processor -- start 2023-10-16T08:52:19.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.817+0000 7fbee20b4640 1 -- start start 2023-10-16T08:52:19.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.818+0000 7fbee20b4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbedc071f40 0x7fbedc0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.818+0000 7fbee20b4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0cd0c0 con 0x7fbedc159890 2023-10-16T08:52:19.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.818+0000 7fbee20b4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0cc540 con 0x7fbedc0ca820 2023-10-16T08:52:19.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.818+0000 7fbee20b4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc0cc820 con 0x7fbedc071f40 2023-10-16T08:52:19.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbedb7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbedc159890 0x7fbedc0ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58680/0 (socket says 172.21.15.94:58680) 2023-10-16T08:52:19.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbedb7fe640 1 -- 172.21.15.94:0/3978225534 learned_addr learned my addr 172.21.15.94:0/3978225534 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:19.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbedbfff640 1 --2- 172.21.15.94:0/3978225534 >> v2:172.21.15.94:3300/0 conn(0x7fbedc071f40 0x7fbedc0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbeda7fc640 1 -- 172.21.15.94:0/3978225534 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155122537 0 0) 0x7fbedc0cd0c0 con 0x7fbedc159890 2023-10-16T08:52:19.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbeda7fc640 1 -- 172.21.15.94:0/3978225534 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8005730 con 0x7fbedc159890 2023-10-16T08:52:19.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbedbfff640 1 -- 172.21.15.94:0/3978225534 >> v1:172.21.15.130:6789/0 conn(0x7fbedc0ca820 legacy=0x7fbedc0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:19.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbedbfff640 1 -- 172.21.15.94:0/3978225534 >> v1:172.21.15.94:6789/0 conn(0x7fbedc159890 legacy=0x7fbedc0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.819+0000 7fbedbfff640 1 -- 172.21.15.94:0/3978225534 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0ccb00 con 0x7fbedc071f40 2023-10-16T08:52:19.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.820+0000 7fbedbfff640 1 --2- 172.21.15.94:0/3978225534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc0c95b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097a0 tx=0x7fbed402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f5e5d9efb46b1f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:19.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbeda7fc640 1 -- 172.21.15.94:0/3978225534 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4031830 con 0x7fbedc071f40 2023-10-16T08:52:19.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbeda7fc640 1 -- 172.21.15.94:0/3978225534 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4031990 con 0x7fbedc071f40 2023-10-16T08:52:19.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbeda7fc640 1 -- 172.21.15.94:0/3978225534 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4031d20 con 0x7fbedc071f40 2023-10-16T08:52:19.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 -- 172.21.15.94:0/3978225534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 msgr2=0x7fbedc0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 --2- 172.21.15.94:0/3978225534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc0c95b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097a0 tx=0x7fbed402b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 -- 172.21.15.94:0/3978225534 shutdown_connections 2023-10-16T08:52:19.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 --2- 172.21.15.94:0/3978225534 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc0c95b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 -- 172.21.15.94:0/3978225534 >> 172.21.15.94:0/3978225534 conn(0x7fbedc0b0030 msgr2=0x7fbedc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:19.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 -- 172.21.15.94:0/3978225534 shutdown_connections 2023-10-16T08:52:19.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.821+0000 7fbee20b4640 1 -- 172.21.15.94:0/3978225534 wait complete. 2023-10-16T08:52:19.830 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.823+0000 7fbee20b4640 1 Processor -- start 2023-10-16T08:52:19.830 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.823+0000 7fbee20b4640 1 -- start start 2023-10-16T08:52:19.830 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.824+0000 7fbee20b4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.831 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.824+0000 7fbee20b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbedc0ca820 0x7fbedc0c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.831 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.824+0000 7fbee20b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc159890 0x7fbedc156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.831 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.824+0000 7fbee20b4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc14bfb0 con 0x7fbedc071f40 2023-10-16T08:52:19.831 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.824+0000 7fbee20b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ac630 con 0x7fbedc159890 2023-10-16T08:52:19.831 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.824+0000 7fbee20b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ac910 con 0x7fbedc0ca820 2023-10-16T08:52:19.832 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.832 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42562/0 (socket says 172.21.15.94:42562) 2023-10-16T08:52:19.832 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 -- 172.21.15.94:0/4175155647 learned_addr learned my addr 172.21.15.94:0/4175155647 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:19.832 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedaffd640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbedc0ca820 0x7fbedc0c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.832 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 -- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbedc0ca820 msgr2=0x7fbedc0c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.833 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedbfff640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc159890 0x7fbedc156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.833 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbedc0ca820 0x7fbedc0c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.833 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 -- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc159890 msgr2=0x7fbedc156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:19.833 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc159890 0x7fbedc156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:19.833 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 -- 172.21.15.94:0/4175155647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009400 con 0x7fbedc071f40 2023-10-16T08:52:19.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedaffd640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbedc0ca820 0x7fbedc0c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:19.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.825+0000 7fbedb7fe640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc14ba70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00cbc0 tx=0x7fbecc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:19.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.826+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00ad40 con 0x7fbedc071f40 2023-10-16T08:52:19.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.826+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc012400 con 0x7fbedc071f40 2023-10-16T08:52:19.834 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.826+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00aea0 con 0x7fbedc071f40 2023-10-16T08:52:19.835 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.826+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0acbf0 con 0x7fbedc071f40 2023-10-16T08:52:19.835 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.826+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc0ad1b0 con 0x7fbedc071f40 2023-10-16T08:52:19.835 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.827+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc073ef0 con 0x7fbedc071f40 2023-10-16T08:52:19.835 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.828+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbecc007070 con 0x7fbedc071f40 2023-10-16T08:52:19.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.829+0000 7fbed3fff640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbebc06ae70 0x7fbebc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:19.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.829+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbecc089a20 con 0x7fbedc071f40 2023-10-16T08:52:19.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.829+0000 7fbedaffd640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbebc06ae70 0x7fbebc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:19.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.830+0000 7fbedaffd640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbebc06ae70 0x7fbebc06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0c6ac0 tx=0x7fbec4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:19.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:19.834+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbecc054710 con 0x7fbedc071f40 2023-10-16T08:52:20.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.027+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbedc0cd290 con 0x7fbedc071f40 2023-10-16T08:52:20.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.027+0000 7fbed3fff640 1 -- 172.21.15.94:0/4175155647 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbecc0170a0 con 0x7fbedc071f40 2023-10-16T08:52:20.029 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:20.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbebc06ae70 msgr2=0x7fbebc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbebc06ae70 0x7fbebc06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0c6ac0 tx=0x7fbec4009040 comp rx=0 tx=0).stop 2023-10-16T08:52:20.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 msgr2=0x7fbedc14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc14ba70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00cbc0 tx=0x7fbecc00a430 comp rx=0 tx=0).stop 2023-10-16T08:52:20.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 shutdown_connections 2023-10-16T08:52:20.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbebc06ae70 0x7fbebc06d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc159890 0x7fbedc156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbedc0ca820 0x7fbedc0c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 --2- 172.21.15.94:0/4175155647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbedc071f40 0x7fbedc14ba70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 >> 172.21.15.94:0/4175155647 conn(0x7fbedc0b0030 msgr2=0x7fbedc0caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:20.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 shutdown_connections 2023-10-16T08:52:20.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.030+0000 7fbee20b4640 1 -- 172.21.15.94:0/4175155647 wait complete. 2023-10-16T08:52:20.051 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:20.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.265+0000 7f6b724f3640 1 Processor -- start 2023-10-16T08:52:20.267 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.265+0000 7f6b724f3640 1 -- start start 2023-10-16T08:52:20.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.266+0000 7f6b724f3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6b6c15c940 0x7f6b6c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.266+0000 7f6b724f3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c0d0d80 0x7f6b6c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.266+0000 7f6b724f3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6b6c160520 0x7f6b6c1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.266+0000 7f6b724f3640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0d1740 con 0x7f6b6c15c940 2023-10-16T08:52:20.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.266+0000 7f6b724f3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0ce810 con 0x7f6b6c160520 2023-10-16T08:52:20.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.266+0000 7f6b724f3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b5b40 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6b6c15c940 0x7f6b6c0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6b6c15c940 0x7f6b6c0d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42574/0 (socket says 172.21.15.94:42574) 2023-10-16T08:52:20.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 -- 172.21.15.94:0/1707375560 learned_addr learned my addr 172.21.15.94:0/1707375560 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:20.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 -- 172.21.15.94:0/1707375560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c0d0d80 msgr2=0x7f6b6c0d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:20.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 --2- 172.21.15.94:0/1707375560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c0d0d80 0x7f6b6c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 -- 172.21.15.94:0/1707375560 >> v2:172.21.15.130:3300/0 conn(0x7f6b6c160520 msgr2=0x7f6b6c1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:20.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 --2- 172.21.15.94:0/1707375560 >> v2:172.21.15.130:3300/0 conn(0x7f6b6c160520 0x7f6b6c1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.267+0000 7f6b714f1640 1 -- 172.21.15.94:0/1707375560 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0ce250 con 0x7f6b6c15c940 2023-10-16T08:52:20.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.268+0000 7f6b714f1640 1 --2- 172.21.15.94:0/1707375560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c15c940 0x7f6b6c0d0400 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0c9820 tx=0x7f6b6802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62aa774fc091576 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:20.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.268+0000 7f6b5ffff640 1 -- 172.21.15.94:0/1707375560 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680317f0 con 0x7f6b6c15c940 2023-10-16T08:52:20.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b5ffff640 1 -- 172.21.15.94:0/1707375560 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68031950 con 0x7f6b6c15c940 2023-10-16T08:52:20.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b5ffff640 1 -- 172.21.15.94:0/1707375560 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68031ce0 con 0x7f6b6c15c940 2023-10-16T08:52:20.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 -- 172.21.15.94:0/1707375560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c15c940 msgr2=0x7f6b6c0d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 --2- 172.21.15.94:0/1707375560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c15c940 0x7f6b6c0d0400 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0c9820 tx=0x7f6b6802b890 comp rx=0 tx=0).stop 2023-10-16T08:52:20.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 -- 172.21.15.94:0/1707375560 shutdown_connections 2023-10-16T08:52:20.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 --2- 172.21.15.94:0/1707375560 >> v2:172.21.15.130:3300/0 conn(0x7f6b6c160520 0x7f6b6c1609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 --2- 172.21.15.94:0/1707375560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c0d0d80 0x7f6b6c0d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 --2- 172.21.15.94:0/1707375560 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c15c940 0x7f6b6c0d0400 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 -- 172.21.15.94:0/1707375560 >> 172.21.15.94:0/1707375560 conn(0x7f6b6c09bb30 msgr2=0x7f6b6c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 -- 172.21.15.94:0/1707375560 shutdown_connections 2023-10-16T08:52:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.269+0000 7f6b724f3640 1 -- 172.21.15.94:0/1707375560 wait complete. 2023-10-16T08:52:20.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.271+0000 7f6b724f3640 1 Processor -- start 2023-10-16T08:52:20.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.271+0000 7f6b724f3640 1 -- start start 2023-10-16T08:52:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b724f3640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 0x7f6b6c0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b724f3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c15c940 0x7f6b6c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b724f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b6c160520 0x7f6b6c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b724f3640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1f2470 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b724f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0cb730 con 0x7f6b6c160520 2023-10-16T08:52:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b724f3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0cc660 con 0x7f6b6c15c940 2023-10-16T08:52:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b714f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 0x7f6b6c0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b714f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 0x7f6b6c0ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42590/0 (socket says 172.21.15.94:42590) 2023-10-16T08:52:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.272+0000 7f6b714f1640 1 -- 172.21.15.94:0/354132850 learned_addr learned my addr 172.21.15.94:0/354132850 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:20.279 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b714f1640 1 -- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c15c940 msgr2=0x7f6b6c155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b70cf0640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c15c940 0x7f6b6c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b714f1640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c15c940 0x7f6b6c155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b71cf2640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b6c160520 0x7f6b6c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b714f1640 1 -- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b6c160520 msgr2=0x7f6b6c0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.280 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b714f1640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b6c160520 0x7f6b6c0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b714f1640 1 -- 172.21.15.94:0/354132850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094d0 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b70cf0640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c15c940 0x7f6b6c155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b71cf2640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b6c160520 0x7f6b6c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b714f1640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 0x7f6b6c0ca780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6b68000c00 tx=0x7f6b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:20.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.273+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680329d0 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.274+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68032b50 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.274+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c1562d0 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.274+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680453f0 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.274+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c0cb170 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.275+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c04e9b0 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.283 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.276+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b68045550 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.277+0000 7f6b5dffb640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6b5006ae70 0x7f6b5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.277+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b680abe90 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.277+0000 7f6b70cf0640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6b5006ae70 0x7f6b5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.278+0000 7f6b70cf0640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6b5006ae70 0x7f6b5006d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0b4930 tx=0x7f6b60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:20.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.281+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b68076c10 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.470+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b6c0a04e0 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.471+0000 7f6b5dffb640 1 -- 172.21.15.94:0/354132850 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b6807a230 con 0x7f6b6c0d0d80 2023-10-16T08:52:20.473 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6b5006ae70 msgr2=0x7f6b5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6b5006ae70 0x7f6b5006d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0b4930 tx=0x7f6b60008040 comp rx=0 tx=0).stop 2023-10-16T08:52:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 msgr2=0x7f6b6c0ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 0x7f6b6c0ca780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6b68000c00 tx=0x7f6b680046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 shutdown_connections 2023-10-16T08:52:20.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6b5006ae70 0x7f6b5006d330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b6c160520 0x7f6b6c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b6c15c940 0x7f6b6c155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 --2- 172.21.15.94:0/354132850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6b6c0d0d80 0x7f6b6c0ca780 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 >> 172.21.15.94:0/354132850 conn(0x7f6b6c09bb30 msgr2=0x7f6b6c0cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 shutdown_connections 2023-10-16T08:52:20.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.474+0000 7f6b724f3640 1 -- 172.21.15.94:0/354132850 wait complete. 2023-10-16T08:52:20.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:20.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.701+0000 7f78f49d0640 1 Processor -- start 2023-10-16T08:52:20.703 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.702+0000 7f78f49d0640 1 -- start start 2023-10-16T08:52:20.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.703+0000 7f78f49d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f78f015a830 0x7f78f00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.703+0000 7f78f49d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f78f00ca550 0x7f78f0070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.703+0000 7f78f49d0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f00cf040 con 0x7f78f0070860 2023-10-16T08:52:20.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.703+0000 7f78f49d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f0070cf0 con 0x7f78f00ca550 2023-10-16T08:52:20.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.703+0000 7f78f49d0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00ca9e0 con 0x7f78f015a830 2023-10-16T08:52:20.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.703+0000 7f78e5d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f78f00ca550 0x7f78f0070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78e5d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f78f00ca550 0x7f78f0070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42602/0 (socket says 172.21.15.94:42602) 2023-10-16T08:52:20.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78e5d9b640 1 -- 172.21.15.94:0/1838991657 learned_addr learned my addr 172.21.15.94:0/1838991657 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:20.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78ee59c640 1 --2- 172.21.15.94:0/1838991657 >> v2:172.21.15.130:3300/0 conn(0x7f78f015a830 0x7f78f00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78e5d9b640 1 -- 172.21.15.94:0/1838991657 >> v2:172.21.15.130:3300/0 conn(0x7f78f015a830 msgr2=0x7f78f00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78e5d9b640 1 --2- 172.21.15.94:0/1838991657 >> v2:172.21.15.130:3300/0 conn(0x7f78f015a830 0x7f78f00cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78e5d9b640 1 -- 172.21.15.94:0/1838991657 >> v1:172.21.15.130:6789/0 conn(0x7f78f0070860 legacy=0x7f78f015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:20.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.704+0000 7f78e5d9b640 1 -- 172.21.15.94:0/1838991657 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00ce430 con 0x7f78f00ca550 2023-10-16T08:52:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.705+0000 7f78e5d9b640 1 --2- 172.21.15.94:0/1838991657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f00ca550 0x7f78f0070320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f78f00cf570 tx=0x7f78d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9589ca31bc4e6d63 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:20.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.705+0000 7f78edd9b640 1 -- 172.21.15.94:0/1838991657 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8031870 con 0x7f78f00ca550 2023-10-16T08:52:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78edd9b640 1 -- 172.21.15.94:0/1838991657 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d80319d0 con 0x7f78f00ca550 2023-10-16T08:52:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78edd9b640 1 -- 172.21.15.94:0/1838991657 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8031d60 con 0x7f78f00ca550 2023-10-16T08:52:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78f49d0640 1 -- 172.21.15.94:0/1838991657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f00ca550 msgr2=0x7f78f0070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78f49d0640 1 --2- 172.21.15.94:0/1838991657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f00ca550 0x7f78f0070320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f78f00cf570 tx=0x7f78d802b910 comp rx=0 tx=0).stop 2023-10-16T08:52:20.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78f49d0640 1 -- 172.21.15.94:0/1838991657 shutdown_connections 2023-10-16T08:52:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78f49d0640 1 --2- 172.21.15.94:0/1838991657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f00ca550 0x7f78f0070320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78f49d0640 1 --2- 172.21.15.94:0/1838991657 >> v2:172.21.15.130:3300/0 conn(0x7f78f015a830 0x7f78f00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.706+0000 7f78f49d0640 1 -- 172.21.15.94:0/1838991657 >> 172.21.15.94:0/1838991657 conn(0x7f78f00b0030 msgr2=0x7f78f00b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.707+0000 7f78f49d0640 1 -- 172.21.15.94:0/1838991657 shutdown_connections 2023-10-16T08:52:20.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.707+0000 7f78f49d0640 1 -- 172.21.15.94:0/1838991657 wait complete. 2023-10-16T08:52:20.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.708+0000 7f78f49d0640 1 Processor -- start 2023-10-16T08:52:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.708+0000 7f78f49d0640 1 -- start start 2023-10-16T08:52:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.709+0000 7f78f49d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 0x7f78f00a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.709+0000 7f78f49d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78f00ca550 0x7f78f00a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.709+0000 7f78f49d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78f015a830 0x7f78f01f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.709+0000 7f78f49d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00c6620 con 0x7f78f0070860 2023-10-16T08:52:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.709+0000 7f78f49d0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00a88e0 con 0x7f78f015a830 2023-10-16T08:52:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.709+0000 7f78f49d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00c6870 con 0x7f78f00ca550 2023-10-16T08:52:20.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 0x7f78f00a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 0x7f78f00a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42608/0 (socket says 172.21.15.94:42608) 2023-10-16T08:52:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 -- 172.21.15.94:0/2078401471 learned_addr learned my addr 172.21.15.94:0/2078401471 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 -- 172.21.15.94:0/2078401471 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78f00ca550 msgr2=0x7f78f00a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78f00ca550 0x7f78f00a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 -- 172.21.15.94:0/2078401471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78f015a830 msgr2=0x7f78f01f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78f015a830 0x7f78f01f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 -- 172.21.15.94:0/2078401471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80094d0 con 0x7f78f0070860 2023-10-16T08:52:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.710+0000 7f78ee59c640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 0x7f78f00a9fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78e000d5f0 tx=0x7f78e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.711+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e00125f0 con 0x7f78f0070860 2023-10-16T08:52:20.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.711+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0012750 con 0x7f78f0070860 2023-10-16T08:52:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.711+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f00c6b50 con 0x7f78f0070860 2023-10-16T08:52:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.711+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0012b00 con 0x7f78f0070860 2023-10-16T08:52:20.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.711+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f0159f80 con 0x7f78f0070860 2023-10-16T08:52:20.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.712+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f00afea0 con 0x7f78f0070860 2023-10-16T08:52:20.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.713+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78e0012c60 con 0x7f78f0070860 2023-10-16T08:52:20.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.714+0000 7f78e77fe640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f78d006ae70 0x7f78d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:20.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.714+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f78e0089ed0 con 0x7f78f0070860 2023-10-16T08:52:20.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.715+0000 7f78e5d9b640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f78d006ae70 0x7f78d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:20.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.715+0000 7f78e5d9b640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f78d006ae70 0x7f78d006d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78d8036000 tx=0x7f78d8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:20.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.719+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78e0054bb0 con 0x7f78f0070860 2023-10-16T08:52:20.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.908+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78f0073ef0 con 0x7f78f0070860 2023-10-16T08:52:20.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.909+0000 7f78e77fe640 1 -- 172.21.15.94:0/2078401471 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78e00581d0 con 0x7f78f0070860 2023-10-16T08:52:20.911 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:20.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f78d006ae70 msgr2=0x7f78d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f78d006ae70 0x7f78d006d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78d8036000 tx=0x7f78d8030000 comp rx=0 tx=0).stop 2023-10-16T08:52:20.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 msgr2=0x7f78f00a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:20.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 0x7f78f00a9fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78e000d5f0 tx=0x7f78e000dab0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 shutdown_connections 2023-10-16T08:52:20.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f78d006ae70 0x7f78d006d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78f015a830 0x7f78f01f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78f00ca550 0x7f78f00a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 --2- 172.21.15.94:0/2078401471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78f0070860 0x7f78f00a9fa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 >> 172.21.15.94:0/2078401471 conn(0x7f78f00b0030 msgr2=0x7f78f00b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 shutdown_connections 2023-10-16T08:52:20.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:20.912+0000 7f78f49d0640 1 -- 172.21.15.94:0/2078401471 wait complete. 2023-10-16T08:52:20.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:21.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.145+0000 7fb1dbc56640 1 Processor -- start 2023-10-16T08:52:21.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.145+0000 7fb1dbc56640 1 -- start start 2023-10-16T08:52:21.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.146+0000 7fb1dbc56640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1d415a830 0x7fb1d40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.146+0000 7fb1dbc56640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1d4070a30 0x7fb1d40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.146+0000 7fb1dbc56640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40cf040 con 0x7fb1d40ca550 2023-10-16T08:52:21.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.146+0000 7fb1dbc56640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40ca9e0 con 0x7fb1d4070a30 2023-10-16T08:52:21.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.146+0000 7fb1dbc56640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40ce430 con 0x7fb1d415a830 2023-10-16T08:52:21.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.146+0000 7fb1da1f3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1d4070a30 0x7fb1d40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1da1f3640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1d4070a30 0x7fb1d40c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42610/0 (socket says 172.21.15.94:42610) 2023-10-16T08:52:21.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1da1f3640 1 -- 172.21.15.94:0/329843656 learned_addr learned my addr 172.21.15.94:0/329843656 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:21.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1d99f2640 1 --2- 172.21.15.94:0/329843656 >> v2:172.21.15.130:3300/0 conn(0x7fb1d415a830 0x7fb1d40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1da1f3640 1 -- 172.21.15.94:0/329843656 >> v2:172.21.15.130:3300/0 conn(0x7fb1d415a830 msgr2=0x7fb1d40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:21.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1da1f3640 1 --2- 172.21.15.94:0/329843656 >> v2:172.21.15.130:3300/0 conn(0x7fb1d415a830 0x7fb1d40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1da1f3640 1 -- 172.21.15.94:0/329843656 >> v1:172.21.15.130:6789/0 conn(0x7fb1d40ca550 legacy=0x7fb1d4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.147+0000 7fb1da1f3640 1 -- 172.21.15.94:0/329843656 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40ce710 con 0x7fb1d4070a30 2023-10-16T08:52:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.148+0000 7fb1da1f3640 1 --2- 172.21.15.94:0/329843656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c8b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40cf570 tx=0x7fb1cc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58256b62a120dd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.148+0000 7fb1d89f0640 1 -- 172.21.15.94:0/329843656 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc02ca80 con 0x7fb1d4070a30 2023-10-16T08:52:21.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1d89f0640 1 -- 172.21.15.94:0/329843656 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc02cbe0 con 0x7fb1d4070a30 2023-10-16T08:52:21.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1d89f0640 1 -- 172.21.15.94:0/329843656 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0343f0 con 0x7fb1d4070a30 2023-10-16T08:52:21.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 -- 172.21.15.94:0/329843656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d4070a30 msgr2=0x7fb1d40c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/329843656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c8b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40cf570 tx=0x7fb1cc02bee0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 -- 172.21.15.94:0/329843656 shutdown_connections 2023-10-16T08:52:21.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/329843656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c8b50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/329843656 >> v2:172.21.15.130:3300/0 conn(0x7fb1d415a830 0x7fb1d40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 -- 172.21.15.94:0/329843656 >> 172.21.15.94:0/329843656 conn(0x7fb1d40b0030 msgr2=0x7fb1d40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:21.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 -- 172.21.15.94:0/329843656 shutdown_connections 2023-10-16T08:52:21.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.149+0000 7fb1dbc56640 1 -- 172.21.15.94:0/329843656 wait complete. 2023-10-16T08:52:21.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 Processor -- start 2023-10-16T08:52:21.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 -- start start 2023-10-16T08:52:21.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 0x7fb1d4157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1d415a830 0x7fb1d41e5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d41e6040 con 0x7fb1d40ca550 2023-10-16T08:52:21.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40ae0d0 con 0x7fb1d4070a30 2023-10-16T08:52:21.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1dbc56640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d41e5d60 con 0x7fb1d415a830 2023-10-16T08:52:21.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.152+0000 7fb1d91f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 0x7fb1d4157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 0x7fb1d4157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42612/0 (socket says 172.21.15.94:42612) 2023-10-16T08:52:21.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 -- 172.21.15.94:0/355236337 learned_addr learned my addr 172.21.15.94:0/355236337 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:21.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d99f2640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1da1f3640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1d415a830 0x7fb1d41e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 -- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1d415a830 msgr2=0x7fb1d41e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1d415a830 0x7fb1d41e5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 -- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1d4070a30 msgr2=0x7fb1d40c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 -- 172.21.15.94:0/355236337 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc009b30 con 0x7fb1d40ca550 2023-10-16T08:52:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.153+0000 7fb1d91f1640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 0x7fb1d4157900 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c430 tx=0x7fb1c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:21.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.154+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4011790 con 0x7fb1d40ca550 2023-10-16T08:52:21.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.154+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c40118f0 con 0x7fb1d40ca550 2023-10-16T08:52:21.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.154+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4011ce0 con 0x7fb1d40ca550 2023-10-16T08:52:21.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.154+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d40ae370 con 0x7fb1d40ca550 2023-10-16T08:52:21.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.154+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d40c5840 con 0x7fb1d40ca550 2023-10-16T08:52:21.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.155+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d40ae890 con 0x7fb1d40ca550 2023-10-16T08:52:21.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.156+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1c401c460 con 0x7fb1d40ca550 2023-10-16T08:52:21.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.157+0000 7fb1ca7fc640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1b806ae70 0x7fb1b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.157+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb1c4089900 con 0x7fb1d40ca550 2023-10-16T08:52:21.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.157+0000 7fb1d99f2640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1b806ae70 0x7fb1b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.157+0000 7fb1d99f2640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1b806ae70 0x7fb1b806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0006fd0 tx=0x7fb1d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:21.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.161+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1d40ae890 con 0x7fb1d40ca550 2023-10-16T08:52:21.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.350+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1d40ae890 con 0x7fb1d40ca550 2023-10-16T08:52:21.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.351+0000 7fb1ca7fc640 1 -- 172.21.15.94:0/355236337 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1d40ae890 con 0x7fb1d40ca550 2023-10-16T08:52:21.353 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:21.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.353+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1b806ae70 msgr2=0x7fb1b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.353+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1b806ae70 0x7fb1b806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0006fd0 tx=0x7fb1d0008040 comp rx=0 tx=0).stop 2023-10-16T08:52:21.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.353+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 msgr2=0x7fb1d4157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.353+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 0x7fb1d4157900 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c430 tx=0x7fb1c400c8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 shutdown_connections 2023-10-16T08:52:21.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1d415a830 0x7fb1d41e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1d40ca550 0x7fb1d4157900 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb1b806ae70 0x7fb1b806d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 --2- 172.21.15.94:0/355236337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1d4070a30 0x7fb1d40c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 >> 172.21.15.94:0/355236337 conn(0x7fb1d40b0030 msgr2=0x7fb1d40cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:21.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 shutdown_connections 2023-10-16T08:52:21.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.354+0000 7fb1dbc56640 1 -- 172.21.15.94:0/355236337 wait complete. 2023-10-16T08:52:21.373 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:21.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.578+0000 7f2109875640 1 Processor -- start 2023-10-16T08:52:21.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.578+0000 7f2109875640 1 -- start start 2023-10-16T08:52:21.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2109875640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f21040c9e00 0x7f21040c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2109875640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040ca1e0 0x7f21040710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2109875640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2104071630 0x7f21040cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2109875640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21040cde00 con 0x7f21040c9e00 2023-10-16T08:52:21.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2109875640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2104071e40 con 0x7f2104071630 2023-10-16T08:52:21.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2109875640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2104072120 con 0x7f21040ca1e0 2023-10-16T08:52:21.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f21040c9e00 0x7f21040c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f21040c9e00 0x7f21040c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42626/0 (socket says 172.21.15.94:42626) 2023-10-16T08:52:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 -- 172.21.15.94:0/575722914 learned_addr learned my addr 172.21.15.94:0/575722914 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 -- 172.21.15.94:0/575722914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040ca1e0 msgr2=0x7f21040710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f20fa7fc640 1 --2- 172.21.15.94:0/575722914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040ca1e0 0x7f21040710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 --2- 172.21.15.94:0/575722914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040ca1e0 0x7f21040710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 -- 172.21.15.94:0/575722914 >> v2:172.21.15.130:3300/0 conn(0x7f2104071630 msgr2=0x7f21040cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:21.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f21037fe640 1 --2- 172.21.15.94:0/575722914 >> v2:172.21.15.130:3300/0 conn(0x7f2104071630 0x7f21040cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 --2- 172.21.15.94:0/575722914 >> v2:172.21.15.130:3300/0 conn(0x7f2104071630 0x7f21040cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.580+0000 7f2102ffd640 1 -- 172.21.15.94:0/575722914 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104072400 con 0x7f21040c9e00 2023-10-16T08:52:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.581+0000 7f2102ffd640 1 --2- 172.21.15.94:0/575722914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21040c9e00 0x7f21040c20e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f210406da60 tx=0x7f20f402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eddbb7ba326a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:21.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.581+0000 7f21027fc640 1 -- 172.21.15.94:0/575722914 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f402ee90 con 0x7f21040c9e00 2023-10-16T08:52:21.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.581+0000 7f21027fc640 1 -- 172.21.15.94:0/575722914 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4036440 con 0x7f21040c9e00 2023-10-16T08:52:21.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.581+0000 7f21027fc640 1 -- 172.21.15.94:0/575722914 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40367d0 con 0x7f21040c9e00 2023-10-16T08:52:21.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 -- 172.21.15.94:0/575722914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21040c9e00 msgr2=0x7f21040c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 --2- 172.21.15.94:0/575722914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21040c9e00 0x7f21040c20e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f210406da60 tx=0x7f20f402e0e0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 -- 172.21.15.94:0/575722914 shutdown_connections 2023-10-16T08:52:21.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 --2- 172.21.15.94:0/575722914 >> v2:172.21.15.130:3300/0 conn(0x7f2104071630 0x7f21040cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 --2- 172.21.15.94:0/575722914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040ca1e0 0x7f21040710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 --2- 172.21.15.94:0/575722914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21040c9e00 0x7f21040c20e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 -- 172.21.15.94:0/575722914 >> 172.21.15.94:0/575722914 conn(0x7f210406c1c0 msgr2=0x7f210406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:21.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 -- 172.21.15.94:0/575722914 shutdown_connections 2023-10-16T08:52:21.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.582+0000 7f2109875640 1 -- 172.21.15.94:0/575722914 wait complete. 2023-10-16T08:52:21.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.584+0000 7f2109875640 1 Processor -- start 2023-10-16T08:52:21.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.584+0000 7f2109875640 1 -- start start 2023-10-16T08:52:21.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2109875640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 0x7f21040b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2109875640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040c9e00 0x7f21040b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2109875640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21040ca1e0 0x7f21040b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2109875640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040b2650 con 0x7f2104071630 2023-10-16T08:52:21.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2109875640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040b2930 con 0x7f21040ca1e0 2023-10-16T08:52:21.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2109875640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21040b2c10 con 0x7f21040c9e00 2023-10-16T08:52:21.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 0x7f21040b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 0x7f21040b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42638/0 (socket says 172.21.15.94:42638) 2023-10-16T08:52:21.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 -- 172.21.15.94:0/2994454362 learned_addr learned my addr 172.21.15.94:0/2994454362 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:21.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 -- 172.21.15.94:0/2994454362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040c9e00 msgr2=0x7f21040b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040c9e00 0x7f21040b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 -- 172.21.15.94:0/2994454362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21040ca1e0 msgr2=0x7f21040b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21040ca1e0 0x7f21040b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.585+0000 7f2102ffd640 1 -- 172.21.15.94:0/2994454362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f400b770 con 0x7f2104071630 2023-10-16T08:52:21.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.586+0000 7f2102ffd640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 0x7f21040b1fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f20f402e120 tx=0x7f20f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:21.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.586+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4034b80 con 0x7f2104071630 2023-10-16T08:52:21.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.586+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4036e90 con 0x7f2104071630 2023-10-16T08:52:21.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.586+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4041460 con 0x7f2104071630 2023-10-16T08:52:21.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.586+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21040b2ef0 con 0x7f2104071630 2023-10-16T08:52:21.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.586+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104156200 con 0x7f2104071630 2023-10-16T08:52:21.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.587+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21040b3410 con 0x7f2104071630 2023-10-16T08:52:21.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.588+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20f4049360 con 0x7f2104071630 2023-10-16T08:52:21.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.589+0000 7f2100ff9640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f20e406aea0 0x7f20e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:21.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.589+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20f40abe40 con 0x7f2104071630 2023-10-16T08:52:21.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.589+0000 7f20fa7fc640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f20e406aea0 0x7f20e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:21.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.590+0000 7f20fa7fc640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f20e406aea0 0x7f20e406d360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20ec006b10 tx=0x7f20ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:21.598 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.593+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21040b3410 con 0x7f2104071630 2023-10-16T08:52:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.784+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21040b3410 con 0x7f2104071630 2023-10-16T08:52:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.787+0000 7f2100ff9640 1 -- 172.21.15.94:0/2994454362 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f21040b3410 con 0x7f2104071630 2023-10-16T08:52:21.789 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:21.790 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f20e406aea0 msgr2=0x7f20e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f20e406aea0 0x7f20e406d360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20ec006b10 tx=0x7f20ec008040 comp rx=0 tx=0).stop 2023-10-16T08:52:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 msgr2=0x7f21040b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 0x7f21040b1fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f20f402e120 tx=0x7f20f40046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 shutdown_connections 2023-10-16T08:52:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f20e406aea0 0x7f20e406d360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21040ca1e0 0x7f21040b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21040c9e00 0x7f21040b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 --2- 172.21.15.94:0/2994454362 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2104071630 0x7f21040b1fe0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.789+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 >> 172.21.15.94:0/2994454362 conn(0x7f210406c1c0 msgr2=0x7f2104157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.790+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 shutdown_connections 2023-10-16T08:52:21.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:21.790+0000 7f2109875640 1 -- 172.21.15.94:0/2994454362 wait complete. 2023-10-16T08:52:21.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:21.810 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:22.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.023+0000 7fe4e1875640 1 Processor -- start 2023-10-16T08:52:22.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.023+0000 7fe4e1875640 1 -- start start 2023-10-16T08:52:22.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.024+0000 7fe4e1875640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe4dc071f40 0x7fe4dc0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.024+0000 7fe4e1875640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0cd0c0 con 0x7fe4dc159890 2023-10-16T08:52:22.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.024+0000 7fe4e1875640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0cc540 con 0x7fe4dc0ca820 2023-10-16T08:52:22.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.024+0000 7fe4e1875640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc0cc820 con 0x7fe4dc071f40 2023-10-16T08:52:22.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.024+0000 7fe4daffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe4dc159890 0x7fe4dc0ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58694/0 (socket says 172.21.15.94:58694) 2023-10-16T08:52:22.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.024+0000 7fe4daffd640 1 -- 172.21.15.94:0/2656386279 learned_addr learned my addr 172.21.15.94:0/2656386279 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4db7fe640 1 --2- 172.21.15.94:0/2656386279 >> v2:172.21.15.130:3300/0 conn(0x7fe4dc071f40 0x7fe4dc0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370755217 0 0) 0x7fe4dc0cd0c0 con 0x7fe4dc159890 2023-10-16T08:52:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c8003520 con 0x7fe4dc159890 2023-10-16T08:52:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950855405 0 0) 0x7fe4c8003520 con 0x7fe4dc159890 2023-10-16T08:52:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 >> v2:172.21.15.130:3300/0 conn(0x7fe4dc071f40 msgr2=0x7fe4dc0c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 --2- 172.21.15.94:0/2656386279 >> v2:172.21.15.130:3300/0 conn(0x7fe4dc071f40 0x7fe4dc0c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 >> v1:172.21.15.130:6789/0 conn(0x7fe4dc0ca820 legacy=0x7fe4dc0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0ccb00 con 0x7fe4dc159890 2023-10-16T08:52:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fe4cc001670 con 0x7fe4dc159890 2023-10-16T08:52:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 >> v1:172.21.15.94:6789/0 conn(0x7fe4dc159890 legacy=0x7fe4dc0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4c8003970 0x7fe4c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4c80047c0 0x7fe4c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.025+0000 7fe4da7fc640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8005180 0x7fe4c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0cc820 con 0x7fe4c8003970 2023-10-16T08:52:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c800c0d0 con 0x7fe4c8005180 2023-10-16T08:52:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c800c290 con 0x7fe4c80047c0 2023-10-16T08:52:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4daffd640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4c8003970 0x7fe4c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4daffd640 1 -- 172.21.15.94:0/2656386279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4c80047c0 msgr2=0x7fe4c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4daffd640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4c80047c0 0x7fe4c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4daffd640 1 -- 172.21.15.94:0/2656386279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8005180 msgr2=0x7fe4c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4daffd640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8005180 0x7fe4c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4daffd640 1 -- 172.21.15.94:0/2656386279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8003520 con 0x7fe4c8003970 2023-10-16T08:52:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.026+0000 7fe4db7fe640 1 -- 172.21.15.94:0/2656386279 reap_dead start 2023-10-16T08:52:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.027+0000 7fe4daffd640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4c8003970 0x7fe4c8003d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c240 tx=0x7fe4c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b695e58b7f8194 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.027+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc005ad0 con 0x7fe4c8003970 2023-10-16T08:52:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.027+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc005c30 con 0x7fe4c8003970 2023-10-16T08:52:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.027+0000 7fe4da7fc640 1 -- 172.21.15.94:0/2656386279 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc02caf0 con 0x7fe4c8003970 2023-10-16T08:52:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 -- 172.21.15.94:0/2656386279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4c8003970 msgr2=0x7fe4c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4c8003970 0x7fe4c8003d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c240 tx=0x7fe4c80057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 -- 172.21.15.94:0/2656386279 shutdown_connections 2023-10-16T08:52:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 --2- 172.21.15.94:0/2656386279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4c8003970 0x7fe4c8003d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 -- 172.21.15.94:0/2656386279 >> 172.21.15.94:0/2656386279 conn(0x7fe4dc0b0030 msgr2=0x7fe4dc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 -- 172.21.15.94:0/2656386279 shutdown_connections 2023-10-16T08:52:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.028+0000 7fe4e1875640 1 -- 172.21.15.94:0/2656386279 wait complete. 2023-10-16T08:52:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.030+0000 7fe4e1875640 1 Processor -- start 2023-10-16T08:52:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.030+0000 7fe4e1875640 1 -- start start 2023-10-16T08:52:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4e1875640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8003970 0x7fe4dc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4e1875640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 0x7fe4dc1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4e1875640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4dc15ba10 0x7fe4dc15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4e1875640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc150b10 con 0x7fe4dc150690 2023-10-16T08:52:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4e1875640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc151570 con 0x7fe4c8003970 2023-10-16T08:52:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4e1875640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc15c3d0 con 0x7fe4dc15ba10 2023-10-16T08:52:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4d3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 0x7fe4dc1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4d3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 0x7fe4dc1575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42650/0 (socket says 172.21.15.94:42650) 2023-10-16T08:52:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4d3fff640 1 -- 172.21.15.94:0/3617712156 learned_addr learned my addr 172.21.15.94:0/3617712156 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.031+0000 7fe4db7fe640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4dc15ba10 0x7fe4dc15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4daffd640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8003970 0x7fe4dc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d3fff640 1 -- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4dc15ba10 msgr2=0x7fe4dc15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d3fff640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4dc15ba10 0x7fe4dc15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d3fff640 1 -- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8003970 msgr2=0x7fe4dc150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d3fff640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8003970 0x7fe4dc150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d3fff640 1 -- 172.21.15.94:0/3617712156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc157130 con 0x7fe4dc150690 2023-10-16T08:52:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4db7fe640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4dc15ba10 0x7fe4dc15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d3fff640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 0x7fe4dc1575c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c3c0 tx=0x7fe4c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40052d0 con 0x7fe4dc150690 2023-10-16T08:52:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4005450 con 0x7fe4dc150690 2023-10-16T08:52:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4007260 con 0x7fe4dc150690 2023-10-16T08:52:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc156520 con 0x7fe4dc150690 2023-10-16T08:52:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.032+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc156ae0 con 0x7fe4dc150690 2023-10-16T08:52:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.033+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc073ef0 con 0x7fe4dc150690 2023-10-16T08:52:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.034+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4c40073c0 con 0x7fe4dc150690 2023-10-16T08:52:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.035+0000 7fe4d8ff9640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe4bc06ae70 0x7fe4bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.035+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4c4088dc0 con 0x7fe4dc150690 2023-10-16T08:52:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.036+0000 7fe4daffd640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe4bc06ae70 0x7fe4bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.036+0000 7fe4daffd640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe4bc06ae70 0x7fe4bc06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc034000 tx=0x7fe4cc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.039+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4c4053a10 con 0x7fe4dc150690 2023-10-16T08:52:22.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.238+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4dc0ccdb0 con 0x7fe4dc150690 2023-10-16T08:52:22.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.239+0000 7fe4d8ff9640 1 -- 172.21.15.94:0/3617712156 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4c4057030 con 0x7fe4dc150690 2023-10-16T08:52:22.241 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:22.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.241+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe4bc06ae70 msgr2=0x7fe4bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe4bc06ae70 0x7fe4bc06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc034000 tx=0x7fe4cc009030 comp rx=0 tx=0).stop 2023-10-16T08:52:22.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 msgr2=0x7fe4dc1575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 0x7fe4dc1575c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c3c0 tx=0x7fe4c400c880 comp rx=0 tx=0).stop 2023-10-16T08:52:22.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 shutdown_connections 2023-10-16T08:52:22.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4dc15ba10 0x7fe4dc15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4dc150690 0x7fe4dc1575c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe4bc06ae70 0x7fe4bc06d330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 --2- 172.21.15.94:0/3617712156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4c8003970 0x7fe4dc150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 >> 172.21.15.94:0/3617712156 conn(0x7fe4dc0b0030 msgr2=0x7fe4dc071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:22.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 shutdown_connections 2023-10-16T08:52:22.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.242+0000 7fe4e1875640 1 -- 172.21.15.94:0/3617712156 wait complete. 2023-10-16T08:52:22.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:22.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.471+0000 7f024807c640 1 Processor -- start 2023-10-16T08:52:22.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.471+0000 7f024807c640 1 -- start start 2023-10-16T08:52:22.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.472+0000 7f024807c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f024015cbf0 0x7f02400d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.472+0000 7f024807c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02400b8400 0x7f02400d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.472+0000 7f024807c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024015cfd0 con 0x7f02400b4410 2023-10-16T08:52:22.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.472+0000 7f024807c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02400d0dc0 con 0x7f024015cbf0 2023-10-16T08:52:22.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.472+0000 7f024807c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02400d30b0 con 0x7f02400b8400 2023-10-16T08:52:22.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.472+0000 7f0245e18640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f024015cbf0 0x7f02400d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245e18640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f024015cbf0 0x7f02400d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42664/0 (socket says 172.21.15.94:42664) 2023-10-16T08:52:22.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245e18640 1 -- 172.21.15.94:0/3962276596 learned_addr learned my addr 172.21.15.94:0/3962276596 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:22.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245617640 1 --2- 172.21.15.94:0/3962276596 >> v2:172.21.15.130:3300/0 conn(0x7f02400b8400 0x7f02400d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245e18640 1 -- 172.21.15.94:0/3962276596 >> v2:172.21.15.130:3300/0 conn(0x7f02400b8400 msgr2=0x7f02400d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:22.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245e18640 1 --2- 172.21.15.94:0/3962276596 >> v2:172.21.15.130:3300/0 conn(0x7f02400b8400 0x7f02400d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245e18640 1 -- 172.21.15.94:0/3962276596 >> v1:172.21.15.130:6789/0 conn(0x7f02400b4410 legacy=0x7f02400b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:22.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.473+0000 7f0245e18640 1 -- 172.21.15.94:0/3962276596 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400d0700 con 0x7f024015cbf0 2023-10-16T08:52:22.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.474+0000 7f0245e18640 1 --2- 172.21.15.94:0/3962276596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400d29d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f024006c040 tx=0x7f023002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7127d77e1b39e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.474+0000 7f0244e16640 1 -- 172.21.15.94:0/3962276596 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023002ca80 con 0x7f024015cbf0 2023-10-16T08:52:22.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f0244e16640 1 -- 172.21.15.94:0/3962276596 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023002cbe0 con 0x7f024015cbf0 2023-10-16T08:52:22.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f0244e16640 1 -- 172.21.15.94:0/3962276596 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300343f0 con 0x7f024015cbf0 2023-10-16T08:52:22.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 -- 172.21.15.94:0/3962276596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 msgr2=0x7f02400d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 --2- 172.21.15.94:0/3962276596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400d29d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f024006c040 tx=0x7f023002bee0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 -- 172.21.15.94:0/3962276596 shutdown_connections 2023-10-16T08:52:22.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 --2- 172.21.15.94:0/3962276596 >> v2:172.21.15.130:3300/0 conn(0x7f02400b8400 0x7f02400d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 --2- 172.21.15.94:0/3962276596 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400d29d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 -- 172.21.15.94:0/3962276596 >> 172.21.15.94:0/3962276596 conn(0x7f0240071900 msgr2=0x7f0240071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:22.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 -- 172.21.15.94:0/3962276596 shutdown_connections 2023-10-16T08:52:22.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.475+0000 7f024807c640 1 -- 172.21.15.94:0/3962276596 wait complete. 2023-10-16T08:52:22.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.477+0000 7f024807c640 1 Processor -- start 2023-10-16T08:52:22.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.477+0000 7f024807c640 1 -- start start 2023-10-16T08:52:22.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.478+0000 7f024807c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02400b4410 0x7f024015de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.478+0000 7f024807c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02400b8400 0x7f02400ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.478+0000 7f024807c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.478+0000 7f024807c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400cb9d0 con 0x7f024015cbf0 2023-10-16T08:52:22.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.478+0000 7f024807c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400cadc0 con 0x7f02400b4410 2023-10-16T08:52:22.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.478+0000 7f024807c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400cb0a0 con 0x7f02400b8400 2023-10-16T08:52:22.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42678/0 (socket says 172.21.15.94:42678) 2023-10-16T08:52:22.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 -- 172.21.15.94:0/1314989431 learned_addr learned my addr 172.21.15.94:0/1314989431 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:22.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0245617640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02400b8400 0x7f02400ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0245e18640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02400b4410 0x7f024015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 -- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02400b8400 msgr2=0x7f02400ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02400b8400 0x7f02400ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 -- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02400b4410 msgr2=0x7f024015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02400b4410 0x7f024015de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.479+0000 7f0246619640 1 -- 172.21.15.94:0/1314989431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009b30 con 0x7f024015cbf0 2023-10-16T08:52:22.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.480+0000 7f0246619640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400b5cf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f023800b490 tx=0x7f023800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.480+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238011830 con 0x7f024015cbf0 2023-10-16T08:52:22.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.480+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380119b0 con 0x7f024015cbf0 2023-10-16T08:52:22.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.480+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238011d60 con 0x7f024015cbf0 2023-10-16T08:52:22.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.480+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02400cb380 con 0x7f024015cbf0 2023-10-16T08:52:22.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.480+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02400caab0 con 0x7f024015cbf0 2023-10-16T08:52:22.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.481+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02400cbb80 con 0x7f024015cbf0 2023-10-16T08:52:22.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.482+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f023801a400 con 0x7f024015cbf0 2023-10-16T08:52:22.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.484+0000 7f023e7fc640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f022c06ae70 0x7f022c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.484+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02380899e0 con 0x7f024015cbf0 2023-10-16T08:52:22.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.484+0000 7f0245e18640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f022c06ae70 0x7f022c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.485+0000 7f0245e18640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f022c06ae70 0x7f022c06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0230035000 tx=0x7f0230030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.489+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0238054760 con 0x7f024015cbf0 2023-10-16T08:52:22.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.677+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02400d16f0 con 0x7f024015cbf0 2023-10-16T08:52:22.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.679+0000 7f023e7fc640 1 -- 172.21.15.94:0/1314989431 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0238015020 con 0x7f024015cbf0 2023-10-16T08:52:22.681 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:22.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f022c06ae70 msgr2=0x7f022c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f022c06ae70 0x7f022c06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0230035000 tx=0x7f0230030000 comp rx=0 tx=0).stop 2023-10-16T08:52:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 msgr2=0x7f02400b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400b5cf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f023800b490 tx=0x7f023800b950 comp rx=0 tx=0).stop 2023-10-16T08:52:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 shutdown_connections 2023-10-16T08:52:22.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f024015cbf0 0x7f02400b5cf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02400b8400 0x7f02400ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f022c06ae70 0x7f022c06d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 --2- 172.21.15.94:0/1314989431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02400b4410 0x7f024015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.682+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 >> 172.21.15.94:0/1314989431 conn(0x7f0240071900 msgr2=0x7f0240155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:22.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.683+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 shutdown_connections 2023-10-16T08:52:22.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.683+0000 7f024807c640 1 -- 172.21.15.94:0/1314989431 wait complete. 2023-10-16T08:52:22.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:22.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.923+0000 7f25dc810640 1 Processor -- start 2023-10-16T08:52:22.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.924+0000 7f25dc810640 1 -- start start 2023-10-16T08:52:22.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25dc810640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f25d815c580 0x7f25d80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25dc810640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f25d80cdbb0 0x7f25d80cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25dc810640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d80cb180 con 0x7f25d80c8b50 2023-10-16T08:52:22.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25dc810640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d80cac40 con 0x7f25d815c580 2023-10-16T08:52:22.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25dc810640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d80cf440 con 0x7f25d80cdbb0 2023-10-16T08:52:22.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25d659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f25d815c580 0x7f25d80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25d659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f25d815c580 0x7f25d80cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42688/0 (socket says 172.21.15.94:42688) 2023-10-16T08:52:22.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25d659c640 1 -- 172.21.15.94:0/4261158453 learned_addr learned my addr 172.21.15.94:0/4261158453 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:22.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.925+0000 7f25d6d9d640 1 --1- 172.21.15.94:0/4261158453 >> v1:172.21.15.94:6789/0 conn(0x7f25d80c8b50 0x7f25d815cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58696/0 (socket says 172.21.15.94:58696) 2023-10-16T08:52:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.926+0000 7f25d659c640 1 -- 172.21.15.94:0/4261158453 >> v2:172.21.15.130:3300/0 conn(0x7f25d80cdbb0 msgr2=0x7f25d80cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.926+0000 7f25d5d9b640 1 --2- 172.21.15.94:0/4261158453 >> v2:172.21.15.130:3300/0 conn(0x7f25d80cdbb0 0x7f25d80cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.926+0000 7f25d659c640 1 --2- 172.21.15.94:0/4261158453 >> v2:172.21.15.130:3300/0 conn(0x7f25d80cdbb0 0x7f25d80cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.926+0000 7f25d659c640 1 -- 172.21.15.94:0/4261158453 >> v1:172.21.15.94:6789/0 conn(0x7f25d80c8b50 legacy=0x7f25d815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.926+0000 7f25d659c640 1 -- 172.21.15.94:0/4261158453 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80ceec0 con 0x7f25d815c580 2023-10-16T08:52:22.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.926+0000 7f25d5d9b640 1 --2- 172.21.15.94:0/4261158453 >> v2:172.21.15.130:3300/0 conn(0x7f25d80cdbb0 0x7f25d80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:22.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.927+0000 7f25d659c640 1 --2- 172.21.15.94:0/4261158453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80cd5f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25d80cbe80 tx=0x7f25c802dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26877b8677876f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.927+0000 7f25d559a640 1 -- 172.21.15.94:0/4261158453 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c802ec70 con 0x7f25d815c580 2023-10-16T08:52:22.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.927+0000 7f25d559a640 1 -- 172.21.15.94:0/4261158453 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8032070 con 0x7f25d815c580 2023-10-16T08:52:22.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.927+0000 7f25d559a640 1 -- 172.21.15.94:0/4261158453 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8038400 con 0x7f25d815c580 2023-10-16T08:52:22.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 -- 172.21.15.94:0/4261158453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 msgr2=0x7f25d80cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 --2- 172.21.15.94:0/4261158453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80cd5f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25d80cbe80 tx=0x7f25c802dec0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 -- 172.21.15.94:0/4261158453 shutdown_connections 2023-10-16T08:52:22.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 --2- 172.21.15.94:0/4261158453 >> v2:172.21.15.130:3300/0 conn(0x7f25d80cdbb0 0x7f25d80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 --2- 172.21.15.94:0/4261158453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80cd5f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 -- 172.21.15.94:0/4261158453 >> 172.21.15.94:0/4261158453 conn(0x7f25d80b0030 msgr2=0x7f25d80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:22.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 -- 172.21.15.94:0/4261158453 shutdown_connections 2023-10-16T08:52:22.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.928+0000 7f25dc810640 1 -- 172.21.15.94:0/4261158453 wait complete. 2023-10-16T08:52:22.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.930+0000 7f25dc810640 1 Processor -- start 2023-10-16T08:52:22.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.930+0000 7f25dc810640 1 -- start start 2023-10-16T08:52:22.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25dc810640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25d80c8b50 0x7f25d814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25dc810640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25d80cdbb0 0x7f25d81519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25dc810640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25dc810640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d814dca0 con 0x7f25d815c580 2023-10-16T08:52:22.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25dc810640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80c48d0 con 0x7f25d80cdbb0 2023-10-16T08:52:22.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25dc810640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8158e00 con 0x7f25d80c8b50 2023-10-16T08:52:22.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42696/0 (socket says 172.21.15.94:42696) 2023-10-16T08:52:22.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 -- 172.21.15.94:0/1103628559 learned_addr learned my addr 172.21.15.94:0/1103628559 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:22.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d659c640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25d80c8b50 0x7f25d814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d5d9b640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25d80cdbb0 0x7f25d81519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 -- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25d80c8b50 msgr2=0x7f25d814d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25d80c8b50 0x7f25d814d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 -- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25d80cdbb0 msgr2=0x7f25d81519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:22.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25d80cdbb0 0x7f25d81519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:22.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.931+0000 7f25d6d9d640 1 -- 172.21.15.94:0/1103628559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c800b760 con 0x7f25d815c580 2023-10-16T08:52:22.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.932+0000 7f25d6d9d640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80b2710 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c730 tx=0x7f25d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.932+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000ce40 con 0x7f25d815c580 2023-10-16T08:52:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.932+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000a640 con 0x7f25d815c580 2023-10-16T08:52:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.932+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80c4b20 con 0x7f25d815c580 2023-10-16T08:52:22.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.932+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000a9b0 con 0x7f25d815c580 2023-10-16T08:52:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.932+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d8151f30 con 0x7f25d815c580 2023-10-16T08:52:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.934+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d8073ef0 con 0x7f25d815c580 2023-10-16T08:52:22.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.934+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25d000ab10 con 0x7f25d815c580 2023-10-16T08:52:22.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.935+0000 7f25ceffd640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f25b806ae70 0x7f25b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:22.942 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.935+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f25d0088fe0 con 0x7f25d815c580 2023-10-16T08:52:22.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.935+0000 7f25d659c640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f25b806ae70 0x7f25b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:22.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.936+0000 7f25d659c640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f25b806ae70 0x7f25b806d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f25c8039000 tx=0x7f25c8034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:22.943 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:22.940+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25d00578a0 con 0x7f25d815c580 2023-10-16T08:52:23.132 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.131+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25d80b4480 con 0x7f25d815c580 2023-10-16T08:52:23.132 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.132+0000 7f25ceffd640 1 -- 172.21.15.94:0/1103628559 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25d00170a0 con 0x7f25d815c580 2023-10-16T08:52:23.133 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:23.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f25b806ae70 msgr2=0x7f25b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f25b806ae70 0x7f25b806d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f25c8039000 tx=0x7f25c8034000 comp rx=0 tx=0).stop 2023-10-16T08:52:23.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 msgr2=0x7f25d80b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80b2710 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c730 tx=0x7f25d000cbf0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 shutdown_connections 2023-10-16T08:52:23.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25d815c580 0x7f25d80b2710 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f25b806ae70 0x7f25b806d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25d80cdbb0 0x7f25d81519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 --2- 172.21.15.94:0/1103628559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25d80c8b50 0x7f25d814d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 >> 172.21.15.94:0/1103628559 conn(0x7f25d80b0030 msgr2=0x7f25d80aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:23.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 shutdown_connections 2023-10-16T08:52:23.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.135+0000 7f25dc810640 1 -- 172.21.15.94:0/1103628559 wait complete. 2023-10-16T08:52:23.155 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:23.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.369+0000 7fc3b23f5640 1 Processor -- start 2023-10-16T08:52:23.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.370+0000 7fc3b23f5640 1 -- start start 2023-10-16T08:52:23.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.371+0000 7fc3b23f5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc3ac159890 0x7fc3ac071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.371+0000 7fc3b23f5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac072480 con 0x7fc3ac0ca5a0 2023-10-16T08:52:23.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.371+0000 7fc3b23f5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0cd0c0 con 0x7fc3ac0ca110 2023-10-16T08:52:23.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.371+0000 7fc3b23f5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac15e210 con 0x7fc3ac159890 2023-10-16T08:52:23.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3b0992640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc3ac0ca5a0 0x7fc3ac15db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58702/0 (socket says 172.21.15.94:58702) 2023-10-16T08:52:23.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3b0992640 1 -- 172.21.15.94:0/3213059279 learned_addr learned my addr 172.21.15.94:0/3213059279 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:23.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3abfff640 1 --2- 172.21.15.94:0/3213059279 >> v2:172.21.15.130:3300/0 conn(0x7fc3ac159890 0x7fc3ac071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.375 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071640190 0 0) 0x7fc3ac072480 con 0x7fc3ac0ca5a0 2023-10-16T08:52:23.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc398003520 con 0x7fc3ac0ca5a0 2023-10-16T08:52:23.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282550048 0 0) 0x7fc398003520 con 0x7fc3ac0ca5a0 2023-10-16T08:52:23.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 >> v2:172.21.15.130:3300/0 conn(0x7fc3ac159890 msgr2=0x7fc3ac071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:23.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 --2- 172.21.15.94:0/3213059279 >> v2:172.21.15.130:3300/0 conn(0x7fc3ac159890 0x7fc3ac071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 >> v1:172.21.15.130:6789/0 conn(0x7fc3ac0ca110 legacy=0x7fc3ac15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.372+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0caa10 con 0x7fc3ac0ca5a0 2023-10-16T08:52:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fc3a4001690 con 0x7fc3ac0ca5a0 2023-10-16T08:52:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 >> v1:172.21.15.94:6789/0 conn(0x7fc3ac0ca5a0 legacy=0x7fc3ac15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc398003970 0x7fc398003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3980047c0 0x7fc398004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398005180 0x7fc39800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac15e210 con 0x7fc3980047c0 2023-10-16T08:52:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39800e230 con 0x7fc398005180 2023-10-16T08:52:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39800e3f0 con 0x7fc398003970 2023-10-16T08:52:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3980047c0 0x7fc398004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3abfff640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc398003970 0x7fc398003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc398003970 msgr2=0x7fc398003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:23.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc398003970 0x7fc398003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398005180 msgr2=0x7fc39800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:23.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398005180 0x7fc39800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/3213059279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398003520 con 0x7fc3980047c0 2023-10-16T08:52:23.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.373+0000 7fc3b0992640 1 -- 172.21.15.94:0/3213059279 reap_dead start 2023-10-16T08:52:23.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.374+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3980047c0 0x7fc398004c40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc394001750 tx=0x7fc3980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e071955501b881 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:23.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940052d0 con 0x7fc3980047c0 2023-10-16T08:52:23.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39402e050 con 0x7fc3980047c0 2023-10-16T08:52:23.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3aaffd640 1 -- 172.21.15.94:0/3213059279 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394003830 con 0x7fc3980047c0 2023-10-16T08:52:23.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 -- 172.21.15.94:0/3213059279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3980047c0 msgr2=0x7fc398004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3980047c0 0x7fc398004c40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc394001750 tx=0x7fc3980057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 -- 172.21.15.94:0/3213059279 shutdown_connections 2023-10-16T08:52:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/3213059279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3980047c0 0x7fc398004c40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 -- 172.21.15.94:0/3213059279 >> 172.21.15.94:0/3213059279 conn(0x7fc3ac0b0030 msgr2=0x7fc3ac0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 -- 172.21.15.94:0/3213059279 shutdown_connections 2023-10-16T08:52:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.375+0000 7fc3b23f5640 1 -- 172.21.15.94:0/3213059279 wait complete. 2023-10-16T08:52:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.377+0000 7fc3b23f5640 1 Processor -- start 2023-10-16T08:52:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.377+0000 7fc3b23f5640 1 -- start start 2023-10-16T08:52:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3b23f5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3980047c0 0x7fc3ac1edef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3b23f5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 0x7fc3ac0af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3b23f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3ac0c7360 0x7fc3ac0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3b23f5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1eb980 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3b23f5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0c5ef0 con 0x7fc3ac0c7360 2023-10-16T08:52:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3b23f5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0ae040 con 0x7fc3980047c0 2023-10-16T08:52:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.378+0000 7fc3ab7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 0x7fc3ac0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 0x7fc3ac0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42714/0 (socket says 172.21.15.94:42714) 2023-10-16T08:52:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/689684598 learned_addr learned my addr 172.21.15.94:0/689684598 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3abfff640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3980047c0 0x7fc3ac1edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3b0992640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3ac0c7360 0x7fc3ac0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3980047c0 msgr2=0x7fc3ac1edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3980047c0 0x7fc3ac1edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3ac0c7360 msgr2=0x7fc3ac0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3ac0c7360 0x7fc3ac0c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 -- 172.21.15.94:0/689684598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac1ee500 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.379+0000 7fc3ab7fe640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 0x7fc3ac0af850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc394005040 tx=0x7fc394001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.380+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394007a30 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.380+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3940069e0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.380+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394006d70 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.380+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac1ee7e0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.380+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac1eeda0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.381+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ac0ae1b0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.382+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3940035f0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.383+0000 7fc3a8ff9640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc38c06ae70 0x7fc38c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.383+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3940ab9f0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.383+0000 7fc3abfff640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc38c06ae70 0x7fc38c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.384+0000 7fc3abfff640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc38c06ae70 0x7fc38c06d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0cee80 tx=0x7fc39c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:23.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.387+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3ac0ae1b0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.581+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3ac0ae1b0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.582+0000 7fc3a8ff9640 1 -- 172.21.15.94:0/689684598 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3ac0ae1b0 con 0x7fc3ac0c5a70 2023-10-16T08:52:23.583 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:23.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc38c06ae70 msgr2=0x7fc38c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc38c06ae70 0x7fc38c06d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0cee80 tx=0x7fc39c00b040 comp rx=0 tx=0).stop 2023-10-16T08:52:23.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 msgr2=0x7fc3ac0af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 0x7fc3ac0af850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc394005040 tx=0x7fc394001120 comp rx=0 tx=0).stop 2023-10-16T08:52:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 shutdown_connections 2023-10-16T08:52:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc38c06ae70 0x7fc38c06d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3ac0c7360 0x7fc3ac0c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc3ac0c5a70 0x7fc3ac0af850 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 --2- 172.21.15.94:0/689684598 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3980047c0 0x7fc3ac1edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 >> 172.21.15.94:0/689684598 conn(0x7fc3ac0b0030 msgr2=0x7fc3ac0caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 shutdown_connections 2023-10-16T08:52:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.585+0000 7fc3b23f5640 1 -- 172.21.15.94:0/689684598 wait complete. 2023-10-16T08:52:23.645 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T08:52:23.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:23.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.866+0000 7f3879fa5640 1 Processor -- start 2023-10-16T08:52:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.867+0000 7f3879fa5640 1 -- start start 2023-10-16T08:52:23.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.868+0000 7f3879fa5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f38740c9e00 0x7f38740c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.868+0000 7f3879fa5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.868+0000 7f3879fa5640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3874071c10 con 0x7f38740ca1e0 2023-10-16T08:52:23.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.868+0000 7f3879fa5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740cde00 con 0x7f38740c9e00 2023-10-16T08:52:23.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.868+0000 7f3879fa5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3874071e40 con 0x7f3874071800 2023-10-16T08:52:23.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f3872ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f38740ca1e0 0x7f38740710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58710/0 (socket says 172.21.15.94:58710) 2023-10-16T08:52:23.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f3872ffd640 1 -- 172.21.15.94:0/2306599020 learned_addr learned my addr 172.21.15.94:0/2306599020 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:23.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38737fe640 1 --2- 172.21.15.94:0/2306599020 >> v2:172.21.15.94:3300/0 conn(0x7f38740c9e00 0x7f38740c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f3873fff640 1 --2- 172.21.15.94:0/2306599020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38727fc640 1 -- 172.21.15.94:0/2306599020 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269776396 0 0) 0x7f3874071c10 con 0x7f38740ca1e0 2023-10-16T08:52:23.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38727fc640 1 -- 172.21.15.94:0/2306599020 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3860005730 con 0x7f38740ca1e0 2023-10-16T08:52:23.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38737fe640 1 -- 172.21.15.94:0/2306599020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 msgr2=0x7f38740cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:23.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38737fe640 1 --2- 172.21.15.94:0/2306599020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38737fe640 1 -- 172.21.15.94:0/2306599020 >> v1:172.21.15.94:6789/0 conn(0x7f38740ca1e0 legacy=0x7f38740710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.869+0000 7f38737fe640 1 -- 172.21.15.94:0/2306599020 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874072120 con 0x7f38740c9e00 2023-10-16T08:52:23.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.870+0000 7f38737fe640 1 --2- 172.21.15.94:0/2306599020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c20e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f385c0097a0 tx=0x7f385c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2415dfcfa0503e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:23.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f38727fc640 1 -- 172.21.15.94:0/2306599020 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c02d040 con 0x7f38740c9e00 2023-10-16T08:52:23.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f38727fc640 1 -- 172.21.15.94:0/2306599020 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c031810 con 0x7f38740c9e00 2023-10-16T08:52:23.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f38727fc640 1 -- 172.21.15.94:0/2306599020 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c031ba0 con 0x7f38740c9e00 2023-10-16T08:52:23.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 -- 172.21.15.94:0/2306599020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 msgr2=0x7f38740c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 --2- 172.21.15.94:0/2306599020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c20e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f385c0097a0 tx=0x7f385c02b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 -- 172.21.15.94:0/2306599020 shutdown_connections 2023-10-16T08:52:23.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 --2- 172.21.15.94:0/2306599020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 --2- 172.21.15.94:0/2306599020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c20e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 -- 172.21.15.94:0/2306599020 >> 172.21.15.94:0/2306599020 conn(0x7f387406c1c0 msgr2=0x7f387406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:23.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 -- 172.21.15.94:0/2306599020 shutdown_connections 2023-10-16T08:52:23.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.871+0000 7f3879fa5640 1 -- 172.21.15.94:0/2306599020 wait complete. 2023-10-16T08:52:23.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.873+0000 7f3879fa5640 1 Processor -- start 2023-10-16T08:52:23.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.873+0000 7f3879fa5640 1 -- start start 2023-10-16T08:52:23.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3879fa5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3879fa5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3879fa5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38740ca1e0 0x7f3874147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3879fa5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740b0290 con 0x7f38740c9e00 2023-10-16T08:52:23.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3879fa5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740c6580 con 0x7f38740ca1e0 2023-10-16T08:52:23.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3879fa5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740c7060 con 0x7f3874071800 2023-10-16T08:52:23.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42734/0 (socket says 172.21.15.94:42734) 2023-10-16T08:52:23.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.874+0000 7f3872ffd640 1 -- 172.21.15.94:0/746826226 learned_addr learned my addr 172.21.15.94:0/746826226 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f38737fe640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3872ffd640 1 -- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 msgr2=0x7f38740b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3872ffd640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3872ffd640 1 -- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38740ca1e0 msgr2=0x7f3874147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:23.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3873fff640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38740ca1e0 0x7f3874147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3872ffd640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38740ca1e0 0x7f3874147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3872ffd640 1 -- 172.21.15.94:0/746826226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c009400 con 0x7f38740c9e00 2023-10-16T08:52:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f38737fe640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3872ffd640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c6040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f386400c440 tx=0x7f386400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864005ce0 con 0x7f38740c9e00 2023-10-16T08:52:23.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864005e40 con 0x7f38740c9e00 2023-10-16T08:52:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864007310 con 0x7f38740c9e00 2023-10-16T08:52:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.875+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38740c67c0 con 0x7f38740c9e00 2023-10-16T08:52:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.876+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38740c6d80 con 0x7f38740c9e00 2023-10-16T08:52:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.877+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38740b03d0 con 0x7f38740c9e00 2023-10-16T08:52:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.878+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3864007470 con 0x7f38740c9e00 2023-10-16T08:52:23.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.879+0000 7f386bfff640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f385406ae70 0x7f385406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:23.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.879+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3864088fa0 con 0x7f38740c9e00 2023-10-16T08:52:23.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.879+0000 7f38737fe640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f385406ae70 0x7f385406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:23.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.880+0000 7f38737fe640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f385406ae70 0x7f385406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f385c036000 tx=0x7f385c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:23.885 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:23.883+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38740b03d0 con 0x7f38740c9e00 2023-10-16T08:52:24.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.076+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38740b03d0 con 0x7f38740c9e00 2023-10-16T08:52:24.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.079+0000 7f386bfff640 1 -- 172.21.15.94:0/746826226 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f38740b03d0 con 0x7f38740c9e00 2023-10-16T08:52:24.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:24.080 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:24.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f385406ae70 msgr2=0x7f385406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f385406ae70 0x7f385406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f385c036000 tx=0x7f385c03c040 comp rx=0 tx=0).stop 2023-10-16T08:52:24.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 msgr2=0x7f38740c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c6040 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f386400c440 tx=0x7f386400c900 comp rx=0 tx=0).stop 2023-10-16T08:52:24.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 shutdown_connections 2023-10-16T08:52:24.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f385406ae70 0x7f385406d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.081+0000 7f3879fa5640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38740ca1e0 0x7f3874147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.082+0000 7f3879fa5640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38740c9e00 0x7f38740c6040 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.082+0000 7f3879fa5640 1 --2- 172.21.15.94:0/746826226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3874071800 0x7f38740b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.082+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 >> 172.21.15.94:0/746826226 conn(0x7f387406c1c0 msgr2=0x7f38740ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:24.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.082+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 shutdown_connections 2023-10-16T08:52:24.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.082+0000 7f3879fa5640 1 -- 172.21.15.94:0/746826226 wait complete. 2023-10-16T08:52:24.101 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:24.102 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:24.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.304+0000 7f53667ce640 1 Processor -- start 2023-10-16T08:52:24.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.304+0000 7f53667ce640 1 -- start start 2023-10-16T08:52:24.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.305+0000 7f53667ce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 0x7f53600cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.305+0000 7f53667ce640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600cf040 con 0x7f53600ca550 2023-10-16T08:52:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f53667ce640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600ca9e0 con 0x7f536015a830 2023-10-16T08:52:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f53667ce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ce430 con 0x7f5360070a30 2023-10-16T08:52:24.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f5364d6b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f53600ca550 0x7f53600c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58724/0 (socket says 172.21.15.94:58724) 2023-10-16T08:52:24.308 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f5364d6b640 1 -- 172.21.15.94:0/2560956850 learned_addr learned my addr 172.21.15.94:0/2560956850 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:24.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f5357fff640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 0x7f53600cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979521692 0 0) 0x7f53600cf040 con 0x7f53600ca550 2023-10-16T08:52:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.306+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5340003520 con 0x7f53600ca550 2023-10-16T08:52:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1570188482 0 0) 0x7f5340003520 con 0x7f53600ca550 2023-10-16T08:52:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 msgr2=0x7f53600cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 0x7f53600cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 >> v1:172.21.15.130:6789/0 conn(0x7f536015a830 legacy=0x7f5360070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600ce710 con 0x7f53600ca550 2023-10-16T08:52:24.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f53580019f0 con 0x7f53600ca550 2023-10-16T08:52:24.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 >> v1:172.21.15.94:6789/0 conn(0x7f53600ca550 legacy=0x7f53600c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53400039a0 0x7f5340003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 0x7f53400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f5340005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ce430 con 0x7f5340004d00 2023-10-16T08:52:24.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534000ba30 con 0x7f53400039a0 2023-10-16T08:52:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534000bbf0 con 0x7f5360070a30 2023-10-16T08:52:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5364d6b640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f5340005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5357fff640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 0x7f53400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f535ffff640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53400039a0 0x7f5340003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5364d6b640 1 -- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 msgr2=0x7f53400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5364d6b640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5360070a30 0x7f53400047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5364d6b640 1 -- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53400039a0 msgr2=0x7f5340003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5364d6b640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53400039a0 0x7f5340003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.307+0000 7f5364d6b640 1 -- 172.21.15.94:0/2560956850 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340003520 con 0x7f5340004d00 2023-10-16T08:52:24.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.308+0000 7f535ffff640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53400039a0 0x7f5340003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.308+0000 7f5364d6b640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f5340005180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f535800a810 tx=0x7f53400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0206d4a41501d03 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358034630 con 0x7f5340004d00 2023-10-16T08:52:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535802f070 con 0x7f5340004d00 2023-10-16T08:52:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f535f7fe640 1 -- 172.21.15.94:0/2560956850 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580349d0 con 0x7f5340004d00 2023-10-16T08:52:24.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f53667ce640 1 -- 172.21.15.94:0/2560956850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 msgr2=0x7f5340005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f53667ce640 1 --2- 172.21.15.94:0/2560956850 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f5340005180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f535800a810 tx=0x7f53400057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f5364d6b640 1 -- 172.21.15.94:0/2560956850 reap_dead start 2023-10-16T08:52:24.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f53667ce640 1 -- 172.21.15.94:0/2560956850 shutdown_connections 2023-10-16T08:52:24.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f53667ce640 1 -- 172.21.15.94:0/2560956850 >> 172.21.15.94:0/2560956850 conn(0x7f53600b0030 msgr2=0x7f53600b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:24.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f53667ce640 1 -- 172.21.15.94:0/2560956850 shutdown_connections 2023-10-16T08:52:24.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.309+0000 7f53667ce640 1 -- 172.21.15.94:0/2560956850 wait complete. 2023-10-16T08:52:24.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.311+0000 7f53667ce640 1 Processor -- start 2023-10-16T08:52:24.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.311+0000 7f53667ce640 1 -- start start 2023-10-16T08:52:24.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f53667ce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f53600ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f53667ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f536015df20 0x7f536015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f53667ce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53601f1b80 0x7f53601f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f53667ce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536015db00 con 0x7f5340004d00 2023-10-16T08:52:24.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f53667ce640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c4fa0 con 0x7f536015df20 2023-10-16T08:52:24.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f53667ce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ad460 con 0x7f53601f1b80 2023-10-16T08:52:24.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f535ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f53600ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f535ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f53600ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42756/0 (socket says 172.21.15.94:42756) 2023-10-16T08:52:24.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.312+0000 7f535ffff640 1 -- 172.21.15.94:0/1084503752 learned_addr learned my addr 172.21.15.94:0/1084503752 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:24.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535ffff640 1 -- 172.21.15.94:0/1084503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53601f1b80 msgr2=0x7f53601f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535ffff640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53601f1b80 0x7f53601f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535ffff640 1 -- 172.21.15.94:0/1084503752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f536015df20 msgr2=0x7f536015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535ffff640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f536015df20 0x7f536015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535ffff640 1 -- 172.21.15.94:0/1084503752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600cc9f0 con 0x7f5340004d00 2023-10-16T08:52:24.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535ffff640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f53600ace10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f535000d590 tx=0x7f535000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:24.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350007220 con 0x7f5340004d00 2023-10-16T08:52:24.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53500073a0 con 0x7f5340004d00 2023-10-16T08:52:24.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500067d0 con 0x7f5340004d00 2023-10-16T08:52:24.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.313+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53600cccd0 con 0x7f5340004d00 2023-10-16T08:52:24.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.314+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536015e8e0 con 0x7f5340004d00 2023-10-16T08:52:24.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.315+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360073ef0 con 0x7f5340004d00 2023-10-16T08:52:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.316+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5350006930 con 0x7f5340004d00 2023-10-16T08:52:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.317+0000 7f535d7fa640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f534406ae70 0x7f534406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.317+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5350089740 con 0x7f5340004d00 2023-10-16T08:52:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.317+0000 7f5357fff640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f534406ae70 0x7f534406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.318+0000 7f5357fff640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f534406ae70 0x7f534406d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53600b27b0 tx=0x7f5348008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:24.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.321+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5350054390 con 0x7f5340004d00 2023-10-16T08:52:24.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.496+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f536015dd70 con 0x7f5340004d00 2023-10-16T08:52:24.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.497+0000 7f535d7fa640 1 -- 172.21.15.94:0/1084503752 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53500579b0 con 0x7f5340004d00 2023-10-16T08:52:24.498 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:24.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.499+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f534406ae70 msgr2=0x7f534406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.499+0000 7f53667ce640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f534406ae70 0x7f534406d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53600b27b0 tx=0x7f5348008040 comp rx=0 tx=0).stop 2023-10-16T08:52:24.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.499+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 msgr2=0x7f53600ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.499+0000 7f53667ce640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f53600ace10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f535000d590 tx=0x7f535000da50 comp rx=0 tx=0).stop 2023-10-16T08:52:24.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 shutdown_connections 2023-10-16T08:52:24.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53601f1b80 0x7f53601f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f534406ae70 0x7f534406d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f536015df20 0x7f536015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 --2- 172.21.15.94:0/1084503752 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5340004d00 0x7f53600ace10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 >> 172.21.15.94:0/1084503752 conn(0x7f53600b0030 msgr2=0x7f53600b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:24.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 shutdown_connections 2023-10-16T08:52:24.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.500+0000 7f53667ce640 1 -- 172.21.15.94:0/1084503752 wait complete. 2023-10-16T08:52:24.519 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.726+0000 7fcbcea10640 1 Processor -- start 2023-10-16T08:52:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.726+0000 7fcbcea10640 1 -- start start 2023-10-16T08:52:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.727+0000 7fcbcea10640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcbc8071f40 0x7fcbc80c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.727+0000 7fcbcea10640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80cd0c0 con 0x7fcbc80ca820 2023-10-16T08:52:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.727+0000 7fcbcea10640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80cc540 con 0x7fcbc8159890 2023-10-16T08:52:24.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.727+0000 7fcbcea10640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc80cc820 con 0x7fcbc8071f40 2023-10-16T08:52:24.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.728+0000 7fcbc77fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcbc80ca820 0x7fcbc80c8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46834/0 (socket says 172.21.15.94:46834) 2023-10-16T08:52:24.730 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.728+0000 7fcbc77fe640 1 -- 172.21.15.94:0/2502320988 learned_addr learned my addr 172.21.15.94:0/2502320988 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.728+0000 7fcbccfad640 1 --2- 172.21.15.94:0/2502320988 >> v2:172.21.15.130:3300/0 conn(0x7fcbc8071f40 0x7fcbc80c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.728+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243884649 0 0) 0x7fcbc80cd0c0 con 0x7fcbc80ca820 2023-10-16T08:52:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.728+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb0003520 con 0x7fcbc80ca820 2023-10-16T08:52:24.731 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174437761 0 0) 0x7fcbb0003520 con 0x7fcbc80ca820 2023-10-16T08:52:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 >> v2:172.21.15.130:3300/0 conn(0x7fcbc8071f40 msgr2=0x7fcbc80c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 --2- 172.21.15.94:0/2502320988 >> v2:172.21.15.130:3300/0 conn(0x7fcbc8071f40 0x7fcbc80c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 >> v1:172.21.15.130:6789/0 conn(0x7fcbc8159890 legacy=0x7fcbc80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80ccb00 con 0x7fcbc80ca820 2023-10-16T08:52:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fcbbc001670 con 0x7fcbc80ca820 2023-10-16T08:52:24.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 >> v1:172.21.15.94:6789/0 conn(0x7fcbc80ca820 legacy=0x7fcbc80c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb00039c0 0x7fcbb0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00047c0 0x7fcbb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb0005180 0x7fcbb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80cc820 con 0x7fcbb00039c0 2023-10-16T08:52:24.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb000c080 con 0x7fcbb0005180 2023-10-16T08:52:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb000e450 con 0x7fcbb00047c0 2023-10-16T08:52:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb00039c0 0x7fcbb0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc7fff640 1 -- 172.21.15.94:0/2502320988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00047c0 msgr2=0x7fcbb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00047c0 0x7fcbb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc7fff640 1 -- 172.21.15.94:0/2502320988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb0005180 msgr2=0x7fcbb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbb0005180 0x7fcbb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbc7fff640 1 -- 172.21.15.94:0/2502320988 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0003520 con 0x7fcbb00039c0 2023-10-16T08:52:24.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.729+0000 7fcbccfad640 1 -- 172.21.15.94:0/2502320988 reap_dead start 2023-10-16T08:52:24.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.730+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb00039c0 0x7fcbb0003de0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001750 tx=0x7fcbb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700947db22759178 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80052d0 con 0x7fcbb00039c0 2023-10-16T08:52:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb802e050 con 0x7fcbb00039c0 2023-10-16T08:52:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbc6ffd640 1 -- 172.21.15.94:0/2502320988 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8003830 con 0x7fcbb00039c0 2023-10-16T08:52:24.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 -- 172.21.15.94:0/2502320988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb00039c0 msgr2=0x7fcbb0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb00039c0 0x7fcbb0003de0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8001750 tx=0x7fcbb00057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 -- 172.21.15.94:0/2502320988 shutdown_connections 2023-10-16T08:52:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2502320988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbb00039c0 0x7fcbb0003de0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 -- 172.21.15.94:0/2502320988 >> 172.21.15.94:0/2502320988 conn(0x7fcbc80b0030 msgr2=0x7fcbc80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:24.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 -- 172.21.15.94:0/2502320988 shutdown_connections 2023-10-16T08:52:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.731+0000 7fcbcea10640 1 -- 172.21.15.94:0/2502320988 wait complete. 2023-10-16T08:52:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.733+0000 7fcbcea10640 1 Processor -- start 2023-10-16T08:52:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.733+0000 7fcbcea10640 1 -- start start 2023-10-16T08:52:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbcea10640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00039c0 0x7fcbc81f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbcea10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc80c2fd0 0x7fcbc80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbcea10640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 0x7fcbc8150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbcea10640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81f20a0 con 0x7fcbc8150490 2023-10-16T08:52:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbcea10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8150e80 con 0x7fcbc80c2fd0 2023-10-16T08:52:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbcea10640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80c5990 con 0x7fcbb00039c0 2023-10-16T08:52:24.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbccfad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 0x7fcbc8150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbccfad640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 0x7fcbc8150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44072/0 (socket says 172.21.15.94:44072) 2023-10-16T08:52:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.734+0000 7fcbccfad640 1 -- 172.21.15.94:0/2266599376 learned_addr learned my addr 172.21.15.94:0/2266599376 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00039c0 0x7fcbc81f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbccfad640 1 -- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00039c0 msgr2=0x7fcbc81f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbccfad640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00039c0 0x7fcbc81f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbccfad640 1 -- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc80c2fd0 msgr2=0x7fcbc80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbc77fe640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc80c2fd0 0x7fcbc80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbccfad640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc80c2fd0 0x7fcbc80c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbccfad640 1 -- 172.21.15.94:0/2266599376 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80c5c70 con 0x7fcbc8150490 2023-10-16T08:52:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbccfad640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 0x7fcbc8150940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcbc806dd90 tx=0x7fcbc000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:24.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0010040 con 0x7fcbc8150490 2023-10-16T08:52:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc000bb30 con 0x7fcbc8150490 2023-10-16T08:52:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc80c5f50 con 0x7fcbc8150490 2023-10-16T08:52:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.735+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0014400 con 0x7fcbc8150490 2023-10-16T08:52:24.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.736+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc8156520 con 0x7fcbc8150490 2023-10-16T08:52:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.737+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8073ef0 con 0x7fcbc8150490 2023-10-16T08:52:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.738+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbc0014560 con 0x7fcbc8150490 2023-10-16T08:52:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.738+0000 7fcbc4ff9640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcbb406ae70 0x7fcbb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.739+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcbc008a0f0 con 0x7fcbc8150490 2023-10-16T08:52:24.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.739+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcbb406ae70 0x7fcbb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:24.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.739+0000 7fcbc7fff640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcbb406ae70 0x7fcbb406d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8033000 tx=0x7fcbb8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:24.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.743+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbc0054e70 con 0x7fcbc8150490 2023-10-16T08:52:24.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.934+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbc80cd290 con 0x7fcbc8150490 2023-10-16T08:52:24.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.935+0000 7fcbc4ff9640 1 -- 172.21.15.94:0/2266599376 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbc0058490 con 0x7fcbc8150490 2023-10-16T08:52:24.936 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:24.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.937+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcbb406ae70 msgr2=0x7fcbb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.937+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcbb406ae70 0x7fcbb406d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8033000 tx=0x7fcbb8009030 comp rx=0 tx=0).stop 2023-10-16T08:52:24.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.937+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 msgr2=0x7fcbc8150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:24.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.937+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 0x7fcbc8150940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcbc806dd90 tx=0x7fcbc000ef50 comp rx=0 tx=0).stop 2023-10-16T08:52:24.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 shutdown_connections 2023-10-16T08:52:24.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcbc8150490 0x7fcbc8150940 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcbb406ae70 0x7fcbb406d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbc80c2fd0 0x7fcbc80c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 --2- 172.21.15.94:0/2266599376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcbb00039c0 0x7fcbc81f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:24.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 >> 172.21.15.94:0/2266599376 conn(0x7fcbc80b0030 msgr2=0x7fcbc80caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:24.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 shutdown_connections 2023-10-16T08:52:24.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:24.938+0000 7fcbcea10640 1 -- 172.21.15.94:0/2266599376 wait complete. 2023-10-16T08:52:24.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:25.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.166+0000 7faffbfe9640 1 Processor -- start 2023-10-16T08:52:25.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.167+0000 7faffbfe9640 1 -- start start 2023-10-16T08:52:25.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffbfe9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 0x7faff40d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffbfe9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faff40b8400 0x7faff40d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffbfe9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff415cfd0 con 0x7faff40b4410 2023-10-16T08:52:25.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffbfe9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40d0dc0 con 0x7faff40b8400 2023-10-16T08:52:25.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffbfe9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff40d30b0 con 0x7faff415cbf0 2023-10-16T08:52:25.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffa586640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7faff40b4410 0x7faff40b5ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46850/0 (socket says 172.21.15.94:46850) 2023-10-16T08:52:25.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.168+0000 7faffa586640 1 -- 172.21.15.94:0/3380389768 learned_addr learned my addr 172.21.15.94:0/3380389768 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:25.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff9584640 1 --2- 172.21.15.94:0/3380389768 >> v2:172.21.15.130:3300/0 conn(0x7faff40b8400 0x7faff40d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff9d85640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 0x7faff40d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865178175 0 0) 0x7faff415cfd0 con 0x7faff40b4410 2023-10-16T08:52:25.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe0003520 con 0x7faff40b4410 2023-10-16T08:52:25.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968418473 0 0) 0x7fafe0003520 con 0x7faff40b4410 2023-10-16T08:52:25.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 msgr2=0x7faff40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 0x7faff40d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 >> v2:172.21.15.130:3300/0 conn(0x7faff40b8400 msgr2=0x7faff40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 --2- 172.21.15.94:0/3380389768 >> v2:172.21.15.130:3300/0 conn(0x7faff40b8400 0x7faff40d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40d0700 con 0x7faff40b4410 2023-10-16T08:52:25.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fafec0019f0 con 0x7faff40b4410 2023-10-16T08:52:25.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 >> v1:172.21.15.94:6789/0 conn(0x7faff40b4410 legacy=0x7faff40b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 0x7fafe0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe0003ef0 0x7fafe00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe0004d00 0x7fafe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40d0dc0 con 0x7fafe0004d00 2023-10-16T08:52:25.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40d30b0 con 0x7fafe0003ef0 2023-10-16T08:52:25.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe000b980 con 0x7faff415cbf0 2023-10-16T08:52:25.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.169+0000 7faffa586640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe0004d00 0x7fafe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.170+0000 7faffa586640 1 -- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 msgr2=0x7fafe0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.170+0000 7faffa586640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415cbf0 0x7fafe0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.170+0000 7faffa586640 1 -- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe0003ef0 msgr2=0x7fafe00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.170+0000 7faffa586640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe0003ef0 0x7fafe00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.170+0000 7faffa586640 1 -- 172.21.15.94:0/3380389768 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0003520 con 0x7fafe0004d00 2023-10-16T08:52:25.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.171+0000 7faffa586640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe0004d00 0x7fafe0005180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fafec00a860 tx=0x7fafe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f332eb11db05f4cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:25.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.171+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec034630 con 0x7fafe0004d00 2023-10-16T08:52:25.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.171+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec02f070 con 0x7fafe0004d00 2023-10-16T08:52:25.177 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.171+0000 7faff8d83640 1 -- 172.21.15.94:0/3380389768 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec034a30 con 0x7fafe0004d00 2023-10-16T08:52:25.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffbfe9640 1 -- 172.21.15.94:0/3380389768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe0004d00 msgr2=0x7fafe0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffbfe9640 1 --2- 172.21.15.94:0/3380389768 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafe0004d00 0x7fafe0005180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fafec00a860 tx=0x7fafe00057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffa586640 1 -- 172.21.15.94:0/3380389768 reap_dead start 2023-10-16T08:52:25.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffbfe9640 1 -- 172.21.15.94:0/3380389768 shutdown_connections 2023-10-16T08:52:25.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffbfe9640 1 -- 172.21.15.94:0/3380389768 >> 172.21.15.94:0/3380389768 conn(0x7faff4071900 msgr2=0x7faff4071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:25.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffbfe9640 1 -- 172.21.15.94:0/3380389768 shutdown_connections 2023-10-16T08:52:25.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.172+0000 7faffbfe9640 1 -- 172.21.15.94:0/3380389768 wait complete. 2023-10-16T08:52:25.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.173+0000 7faffbfe9640 1 Processor -- start 2023-10-16T08:52:25.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.173+0000 7faffbfe9640 1 -- start start 2023-10-16T08:52:25.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.174+0000 7faffbfe9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415fa50 0x7faff4156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.174+0000 7faffbfe9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faff415fe30 0x7faff4157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.174+0000 7faffbfe9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 0x7faff4143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.174+0000 7faffbfe9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4147db0 con 0x7faff41439c0 2023-10-16T08:52:25.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.174+0000 7faffbfe9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4144380 con 0x7faff415fe30 2023-10-16T08:52:25.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.174+0000 7faffbfe9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff4158e70 con 0x7faff415fa50 2023-10-16T08:52:25.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 0x7faff4143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 0x7faff4143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44088/0 (socket says 172.21.15.94:44088) 2023-10-16T08:52:25.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 -- 172.21.15.94:0/176555522 learned_addr learned my addr 172.21.15.94:0/176555522 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:25.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faff9d85640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415fa50 0x7faff4156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faff9584640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faff415fe30 0x7faff4157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 -- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415fa50 msgr2=0x7faff4156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415fa50 0x7faff4156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 -- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faff415fe30 msgr2=0x7faff4157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faff415fe30 0x7faff4157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 -- 172.21.15.94:0/176555522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4158260 con 0x7faff41439c0 2023-10-16T08:52:25.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faff9d85640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415fa50 0x7faff4156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:25.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.175+0000 7faffa586640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 0x7faff4143e40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fafec02cc00 tx=0x7fafec001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:25.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.176+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec034840 con 0x7faff41439c0 2023-10-16T08:52:25.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.176+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec001a40 con 0x7faff41439c0 2023-10-16T08:52:25.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.176+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec034ba0 con 0x7faff41439c0 2023-10-16T08:52:25.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.176+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff4158540 con 0x7faff41439c0 2023-10-16T08:52:25.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.176+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff4158b00 con 0x7faff41439c0 2023-10-16T08:52:25.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.177+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff4158cc0 con 0x7faff41439c0 2023-10-16T08:52:25.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.178+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fafec031030 con 0x7faff41439c0 2023-10-16T08:52:25.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.179+0000 7fafea7fc640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fafd806ae70 0x7fafd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.179+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fafec0abc70 con 0x7faff41439c0 2023-10-16T08:52:25.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.179+0000 7faff9d85640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fafd806ae70 0x7fafd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.180+0000 7faff9d85640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fafd806ae70 0x7fafd806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faff00099e0 tx=0x7faff0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:25.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.183+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafec07a350 con 0x7faff41439c0 2023-10-16T08:52:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.358+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faff4158cc0 con 0x7faff41439c0 2023-10-16T08:52:25.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.359+0000 7fafea7fc640 1 -- 172.21.15.94:0/176555522 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafec001fd0 con 0x7faff41439c0 2023-10-16T08:52:25.361 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.361+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fafd806ae70 msgr2=0x7fafd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.361+0000 7faffbfe9640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fafd806ae70 0x7fafd806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faff00099e0 tx=0x7faff0008040 comp rx=0 tx=0).stop 2023-10-16T08:52:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.361+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 msgr2=0x7faff4143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.361+0000 7faffbfe9640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 0x7faff4143e40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fafec02cc00 tx=0x7fafec001d80 comp rx=0 tx=0).stop 2023-10-16T08:52:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 shutdown_connections 2023-10-16T08:52:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faff41439c0 0x7faff4143e40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fafd806ae70 0x7fafd806d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faff415fe30 0x7faff4157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 --2- 172.21.15.94:0/176555522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faff415fa50 0x7faff4156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 >> 172.21.15.94:0/176555522 conn(0x7faff4071900 msgr2=0x7faff4151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:25.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 shutdown_connections 2023-10-16T08:52:25.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.362+0000 7faffbfe9640 1 -- 172.21.15.94:0/176555522 wait complete. 2023-10-16T08:52:25.381 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:25.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.598+0000 7faef355e640 1 Processor -- start 2023-10-16T08:52:25.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.598+0000 7faef355e640 1 -- start start 2023-10-16T08:52:25.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.599+0000 7faef355e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faeec0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.599+0000 7faef355e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0cd0c0 con 0x7faeec159890 2023-10-16T08:52:25.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.599+0000 7faef355e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0cc540 con 0x7faeec0ca820 2023-10-16T08:52:25.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.599+0000 7faef355e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0cc820 con 0x7faeec071f40 2023-10-16T08:52:25.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faef12fa640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7faeec159890 0x7faeec0ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46854/0 (socket says 172.21.15.94:46854) 2023-10-16T08:52:25.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faef12fa640 1 -- 172.21.15.94:0/289231360 learned_addr learned my addr 172.21.15.94:0/289231360 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:25.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677794959 0 0) 0x7faeec0cd0c0 con 0x7faeec159890 2023-10-16T08:52:25.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faef1afb640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faeec0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed8003520 con 0x7faeec159890 2023-10-16T08:52:25.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 801948721 0 0) 0x7faed8003520 con 0x7faeec159890 2023-10-16T08:52:25.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 msgr2=0x7faeec0c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faeec0c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 >> v1:172.21.15.130:6789/0 conn(0x7faeec0ca820 legacy=0x7faeec0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0ccb00 con 0x7faeec159890 2023-10-16T08:52:25.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.600+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7faee8001690 con 0x7faeec159890 2023-10-16T08:52:25.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 >> v1:172.21.15.94:6789/0 conn(0x7faeec159890 legacy=0x7faeec0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faed80039a0 0x7faed8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faed80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0cc820 con 0x7faed80047c0 2023-10-16T08:52:25.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed800bab0 con 0x7faed80039a0 2023-10-16T08:52:25.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed800bc70 con 0x7faeec071f40 2023-10-16T08:52:25.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef0af9640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef1afb640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faed80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef12fa640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faed80039a0 0x7faed8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef0af9640 1 -- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 msgr2=0x7faed80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef0af9640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faed80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef0af9640 1 -- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faed80039a0 msgr2=0x7faed8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:25.608 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef0af9640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faed80039a0 0x7faed8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef0af9640 1 -- 172.21.15.94:0/289231360 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8003520 con 0x7faed80047c0 2023-10-16T08:52:25.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef1afb640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec071f40 0x7faed80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:25.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.601+0000 7faef12fa640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faed80039a0 0x7faed8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:25.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.602+0000 7faef0af9640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faed8004c40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faedc001750 tx=0x7faed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a73395e9bd6ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:25.609 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0052d0 con 0x7faed80047c0 2023-10-16T08:52:25.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc02e050 con 0x7faed80047c0 2023-10-16T08:52:25.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faee3fff640 1 -- 172.21.15.94:0/289231360 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0035f0 con 0x7faed80047c0 2023-10-16T08:52:25.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef355e640 1 -- 172.21.15.94:0/289231360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 msgr2=0x7faed8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef355e640 1 --2- 172.21.15.94:0/289231360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faed8004c40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faedc001750 tx=0x7faed80057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef1afb640 1 -- 172.21.15.94:0/289231360 reap_dead start 2023-10-16T08:52:25.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef355e640 1 -- 172.21.15.94:0/289231360 shutdown_connections 2023-10-16T08:52:25.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef355e640 1 -- 172.21.15.94:0/289231360 >> 172.21.15.94:0/289231360 conn(0x7faeec0b0030 msgr2=0x7faeec0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:25.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef355e640 1 -- 172.21.15.94:0/289231360 shutdown_connections 2023-10-16T08:52:25.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.603+0000 7faef355e640 1 -- 172.21.15.94:0/289231360 wait complete. 2023-10-16T08:52:25.613 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.605+0000 7faef355e640 1 Processor -- start 2023-10-16T08:52:25.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.605+0000 7faef355e640 1 -- start start 2023-10-16T08:52:25.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef355e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faeec1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef355e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeec1f1e60 0x7faeec0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef355e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec157380 0x7faeec0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef355e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1f2f10 con 0x7faed80047c0 2023-10-16T08:52:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef355e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0aecf0 con 0x7faeec1f1e60 2023-10-16T08:52:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef355e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1f2390 con 0x7faeec157380 2023-10-16T08:52:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef12fa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faeec1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef12fa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faeec1f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44108/0 (socket says 172.21.15.94:44108) 2023-10-16T08:52:25.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.606+0000 7faef12fa640 1 -- 172.21.15.94:0/822986904 learned_addr learned my addr 172.21.15.94:0/822986904 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:25.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef0af9640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeec1f1e60 0x7faeec0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef12fa640 1 -- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec157380 msgr2=0x7faeec0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef1afb640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec157380 0x7faeec0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef12fa640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec157380 0x7faeec0c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef12fa640 1 -- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeec1f1e60 msgr2=0x7faeec0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef12fa640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeec1f1e60 0x7faeec0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef12fa640 1 -- 172.21.15.94:0/822986904 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec1f2670 con 0x7faed80047c0 2023-10-16T08:52:25.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef0af9640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeec1f1e60 0x7faeec0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:25.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef12fa640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faeec1f3070 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faee800d8e0 tx=0x7faee800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:25.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80074e0 con 0x7faed80047c0 2023-10-16T08:52:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8007640 con 0x7faed80047c0 2023-10-16T08:52:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8004a20 con 0x7faed80047c0 2023-10-16T08:52:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.607+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec1f2950 con 0x7faed80047c0 2023-10-16T08:52:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.608+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec0af5b0 con 0x7faed80047c0 2023-10-16T08:52:25.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.609+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec073ef0 con 0x7faed80047c0 2023-10-16T08:52:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.610+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faee8004b80 con 0x7faed80047c0 2023-10-16T08:52:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.610+0000 7faee1ffb640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faed006aea0 0x7faed006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.611+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faee8089520 con 0x7faed80047c0 2023-10-16T08:52:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.611+0000 7faef0af9640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faed006aea0 0x7faed006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:25.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.611+0000 7faef0af9640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faed006aea0 0x7faed006d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faedc033000 tx=0x7faedc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:25.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.615+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faee8057ca0 con 0x7faed80047c0 2023-10-16T08:52:25.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.803+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faeec155440 con 0x7faed80047c0 2023-10-16T08:52:25.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.804+0000 7faee1ffb640 1 -- 172.21.15.94:0/822986904 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7faee8057830 con 0x7faed80047c0 2023-10-16T08:52:25.806 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:25.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faed006aea0 msgr2=0x7faed006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faed006aea0 0x7faed006d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faedc033000 tx=0x7faedc009030 comp rx=0 tx=0).stop 2023-10-16T08:52:25.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 msgr2=0x7faeec1f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:25.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faeec1f3070 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faee800d8e0 tx=0x7faee800dda0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 shutdown_connections 2023-10-16T08:52:25.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faeec157380 0x7faeec0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7faed006aea0 0x7faed006d360 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeec1f1e60 0x7faeec0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 --2- 172.21.15.94:0/822986904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faed80047c0 0x7faeec1f3070 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:25.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 >> 172.21.15.94:0/822986904 conn(0x7faeec0b0030 msgr2=0x7faeec0ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:25.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 shutdown_connections 2023-10-16T08:52:25.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:25.807+0000 7faef355e640 1 -- 172.21.15.94:0/822986904 wait complete. 2023-10-16T08:52:25.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-16T08:52:26.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.043+0000 7fc32bfff640 1 Processor -- start 2023-10-16T08:52:26.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.044+0000 7fc32bfff640 1 -- start start 2023-10-16T08:52:26.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.045+0000 7fc32bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc32c06c010 0x7fc32c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.045+0000 7fc32bfff640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c0cac90 con 0x7fc32c0affa0 2023-10-16T08:52:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32bfff640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c0cb810 con 0x7fc32c0af8f0 2023-10-16T08:52:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32bfff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c0caee0 con 0x7fc32c06c010 2023-10-16T08:52:26.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc32c06c010 0x7fc32c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc323fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc32c0affa0 0x7fc32c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46864/0 (socket says 172.21.15.94:46864) 2023-10-16T08:52:26.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc323fff640 1 -- 172.21.15.94:0/2273576705 learned_addr learned my addr 172.21.15.94:0/2273576705 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:26.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32a7fc640 1 -- 172.21.15.94:0/2273576705 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158309664 0 0) 0x7fc32c0cac90 con 0x7fc32c0affa0 2023-10-16T08:52:26.050 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32a7fc640 1 -- 172.21.15.94:0/2273576705 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc318003520 con 0x7fc32c0affa0 2023-10-16T08:52:26.050 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2273576705 >> v1:172.21.15.130:6789/0 conn(0x7fc32c0af8f0 legacy=0x7fc32c0cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:26.050 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2273576705 >> v1:172.21.15.94:6789/0 conn(0x7fc32c0affa0 legacy=0x7fc32c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:26.050 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.046+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2273576705 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0cb1c0 con 0x7fc32c06c010 2023-10-16T08:52:26.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.048+0000 7fc32b7fe640 1 --2- 172.21.15.94:0/2273576705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c06c010 0x7fc32c15c2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc324009d90 tx=0x7fc32402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831bac030f0793e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:26.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.048+0000 7fc32a7fc640 1 -- 172.21.15.94:0/2273576705 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32402cc60 con 0x7fc32c06c010 2023-10-16T08:52:26.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.048+0000 7fc32a7fc640 1 -- 172.21.15.94:0/2273576705 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32402cdc0 con 0x7fc32c06c010 2023-10-16T08:52:26.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.048+0000 7fc32a7fc640 1 -- 172.21.15.94:0/2273576705 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324034660 con 0x7fc32c06c010 2023-10-16T08:52:26.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.048+0000 7fc32bfff640 1 -- 172.21.15.94:0/2273576705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c06c010 msgr2=0x7fc32c15c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:26.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.048+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2273576705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c06c010 0x7fc32c15c2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc324009d90 tx=0x7fc32402beb0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.049+0000 7fc32bfff640 1 -- 172.21.15.94:0/2273576705 shutdown_connections 2023-10-16T08:52:26.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.049+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2273576705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c06c010 0x7fc32c15c2b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.049+0000 7fc32bfff640 1 -- 172.21.15.94:0/2273576705 >> 172.21.15.94:0/2273576705 conn(0x7fc32c0d0640 msgr2=0x7fc32c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:26.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.049+0000 7fc32bfff640 1 -- 172.21.15.94:0/2273576705 shutdown_connections 2023-10-16T08:52:26.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.049+0000 7fc32bfff640 1 -- 172.21.15.94:0/2273576705 wait complete. 2023-10-16T08:52:26.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.050+0000 7fc32bfff640 1 Processor -- start 2023-10-16T08:52:26.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.050+0000 7fc32bfff640 1 -- start start 2023-10-16T08:52:26.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.051+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc32c06c010 0x7fc32c14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:26.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.051+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc32c0af8f0 0x7fc32c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:26.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.051+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 0x7fc32c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:26.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.051+0000 7fc32bfff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0b4960 con 0x7fc32c0affa0 2023-10-16T08:52:26.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.051+0000 7fc32bfff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c150330 con 0x7fc32c0af8f0 2023-10-16T08:52:26.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.051+0000 7fc32bfff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0b3ce0 con 0x7fc32c06c010 2023-10-16T08:52:26.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 0x7fc32c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:26.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 0x7fc32c0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44126/0 (socket says 172.21.15.94:44126) 2023-10-16T08:52:26.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2444206849 learned_addr learned my addr 172.21.15.94:0/2444206849 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:26.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc323fff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc32c0af8f0 0x7fc32c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:26.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32affd640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc32c06c010 0x7fc32c14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:26.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc32c06c010 msgr2=0x7fc32c14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:26.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc32c06c010 0x7fc32c14fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc32c0af8f0 msgr2=0x7fc32c0b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:26.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc32c0af8f0 0x7fc32c0b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.052+0000 7fc32b7fe640 1 -- 172.21.15.94:0/2444206849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc324009a70 con 0x7fc32c0affa0 2023-10-16T08:52:26.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.053+0000 7fc32b7fe640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 0x7fc32c0b3260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc324037040 tx=0x7fc324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:26.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.053+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324040650 con 0x7fc32c0affa0 2023-10-16T08:52:26.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.053+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3240407b0 con 0x7fc32c0affa0 2023-10-16T08:52:26.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.053+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324040b60 con 0x7fc32c0affa0 2023-10-16T08:52:26.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.053+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c0b3fc0 con 0x7fc32c0affa0 2023-10-16T08:52:26.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.053+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c0b4580 con 0x7fc32c0affa0 2023-10-16T08:52:26.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.054+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c0b4aa0 con 0x7fc32c0affa0 2023-10-16T08:52:26.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.055+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc324040cc0 con 0x7fc32c0affa0 2023-10-16T08:52:26.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.056+0000 7fc3237fe640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc30c06aea0 0x7fc30c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:26.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.056+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3240ac740 con 0x7fc32c0affa0 2023-10-16T08:52:26.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.056+0000 7fc32affd640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc30c06aea0 0x7fc30c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:26.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.057+0000 7fc32affd640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc30c06aea0 0x7fc30c06d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc31c004ea0 tx=0x7fc31c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:26.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.060+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc32c0b4aa0 con 0x7fc32c0affa0 2023-10-16T08:52:26.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.317+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fc32c0b4aa0 con 0x7fc32c0affa0 2023-10-16T08:52:26.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.969+0000 7fc3237fe640 1 -- 172.21.15.94:0/2444206849 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v82) v1 ==== 147+0+0 (secure 0 0 0) 0x7fc32c0b4aa0 con 0x7fc32c0affa0 2023-10-16T08:52:26.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.972+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc30c06aea0 msgr2=0x7fc30c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:26.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.972+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc30c06aea0 0x7fc30c06d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc31c004ea0 tx=0x7fc31c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:26.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.972+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 msgr2=0x7fc32c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.972+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 0x7fc32c0b3260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc324037040 tx=0x7fc324004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:26.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 shutdown_connections 2023-10-16T08:52:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc32c0affa0 0x7fc32c0b3260 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc30c06aea0 0x7fc30c06d360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc32c0af8f0 0x7fc32c0b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 --2- 172.21.15.94:0/2444206849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc32c06c010 0x7fc32c14fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:26.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 >> 172.21.15.94:0/2444206849 conn(0x7fc32c0d0640 msgr2=0x7fc32c0ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 shutdown_connections 2023-10-16T08:52:26.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:26.973+0000 7fc32bfff640 1 -- 172.21.15.94:0/2444206849 wait complete. 2023-10-16T08:52:26.994 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T08:52:27.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.210+0000 7f51f7ff5640 1 Processor -- start 2023-10-16T08:52:27.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.210+0000 7f51f7ff5640 1 -- start start 2023-10-16T08:52:27.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f7ff5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f51f015ca80 0x7f51f00d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:27.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f7ff5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f00d30b0 0x7f51f00cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:27.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f7ff5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00d0e80 con 0x7f51f00cd890 2023-10-16T08:52:27.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f7ff5640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00cdd00 con 0x7f51f015ca80 2023-10-16T08:52:27.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f7ff5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00d1160 con 0x7f51f00d30b0 2023-10-16T08:52:27.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f5d91640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f51f015ca80 0x7f51f00d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:27.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f5d91640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f51f015ca80 0x7f51f00d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44136/0 (socket says 172.21.15.94:44136) 2023-10-16T08:52:27.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.211+0000 7f51f5d91640 1 -- 172.21.15.94:0/2287468584 learned_addr learned my addr 172.21.15.94:0/2287468584 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:27.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.212+0000 7f51f5d91640 1 -- 172.21.15.94:0/2287468584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f00d30b0 msgr2=0x7f51f00cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:27.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.212+0000 7f51f5590640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f00d30b0 0x7f51f00cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:27.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.212+0000 7f51f5d91640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f00d30b0 0x7f51f00cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.212+0000 7f51f5d91640 1 -- 172.21.15.94:0/2287468584 >> v1:172.21.15.130:6789/0 conn(0x7f51f00cd890 legacy=0x7f51f00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:27.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.212+0000 7f51f5d91640 1 -- 172.21.15.94:0/2287468584 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00d1440 con 0x7f51f015ca80 2023-10-16T08:52:27.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.212+0000 7f51f5590640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f00d30b0 0x7f51f00cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:27.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.213+0000 7f51f5d91640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f015ca80 0x7f51f00d05a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbc9585af09eb96 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:27.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.213+0000 7f51f4d8f640 1 -- 172.21.15.94:0/2287468584 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec031640 con 0x7f51f015ca80 2023-10-16T08:52:27.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.213+0000 7f51f4d8f640 1 -- 172.21.15.94:0/2287468584 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0317a0 con 0x7f51f015ca80 2023-10-16T08:52:27.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.213+0000 7f51f4d8f640 1 -- 172.21.15.94:0/2287468584 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec031b30 con 0x7f51f015ca80 2023-10-16T08:52:27.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 -- 172.21.15.94:0/2287468584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f015ca80 msgr2=0x7f51f00d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:27.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f015ca80 0x7f51f00d05a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec02b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 -- 172.21.15.94:0/2287468584 shutdown_connections 2023-10-16T08:52:27.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f00d30b0 0x7f51f00cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/2287468584 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f015ca80 0x7f51f00d05a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 -- 172.21.15.94:0/2287468584 >> 172.21.15.94:0/2287468584 conn(0x7f51f0071900 msgr2=0x7f51f0071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:27.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 -- 172.21.15.94:0/2287468584 shutdown_connections 2023-10-16T08:52:27.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.214+0000 7f51f7ff5640 1 -- 172.21.15.94:0/2287468584 wait complete. 2023-10-16T08:52:27.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.216+0000 7f51f7ff5640 1 Processor -- start 2023-10-16T08:52:27.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.216+0000 7f51f7ff5640 1 -- start start 2023-10-16T08:52:27.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f7ff5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f00cd890 0x7f51f01f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:27.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f7ff5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 0x7f51f015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:27.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f7ff5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f015ca80 0x7f51f00cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:27.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f7ff5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00c9aa0 con 0x7f51f00d30b0 2023-10-16T08:52:27.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f7ff5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00ca8c0 con 0x7f51f00cd890 2023-10-16T08:52:27.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f7ff5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00c9cb0 con 0x7f51f015ca80 2023-10-16T08:52:27.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f5590640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 0x7f51f015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:27.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f5590640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 0x7f51f015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44146/0 (socket says 172.21.15.94:44146) 2023-10-16T08:52:27.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.217+0000 7f51f5590640 1 -- 172.21.15.94:0/193824563 learned_addr learned my addr 172.21.15.94:0/193824563 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:27.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5d91640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f00cd890 0x7f51f01f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:27.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f6592640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f015ca80 0x7f51f00cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:27.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5590640 1 -- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f015ca80 msgr2=0x7f51f00cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:27.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5590640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f015ca80 0x7f51f00cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5590640 1 -- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f00cd890 msgr2=0x7f51f01f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:27.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5590640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f00cd890 0x7f51f01f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5590640 1 -- 172.21.15.94:0/193824563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0094d0 con 0x7f51f00d30b0 2023-10-16T08:52:27.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f6592640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f015ca80 0x7f51f00cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:27.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5d91640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f00cd890 0x7f51f01f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:27.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51f5590640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 0x7f51f015aab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51e400cf30 tx=0x7f51e400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:27.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.218+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400d840 con 0x7f51f00d30b0 2023-10-16T08:52:27.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.219+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400d9a0 con 0x7f51f00d30b0 2023-10-16T08:52:27.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.219+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00c9f90 con 0x7f51f00d30b0 2023-10-16T08:52:27.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.219+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400dd30 con 0x7f51f00d30b0 2023-10-16T08:52:27.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.219+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f00ca550 con 0x7f51f00d30b0 2023-10-16T08:52:27.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.220+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f0067180 con 0x7f51f00d30b0 2023-10-16T08:52:27.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.221+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51e4015440 con 0x7f51f00d30b0 2023-10-16T08:52:27.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.222+0000 7f51e27fc640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f51d406ae70 0x7f51d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:27.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.222+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f51e408a350 con 0x7f51f00d30b0 2023-10-16T08:52:27.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.222+0000 7f51f5d91640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f51d406ae70 0x7f51d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:27.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.223+0000 7f51f5d91640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f51d406ae70 0x7f51d406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51ec036000 tx=0x7f51ec03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:27.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.226+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51e40550f0 con 0x7f51f00d30b0 2023-10-16T08:52:27.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.417+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f51f00caa00 con 0x7f51f00d30b0 2023-10-16T08:52:27.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.425+0000 7f51e27fc640 1 -- 172.21.15.94:0/193824563 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f51e4058710 con 0x7f51f00d30b0 2023-10-16T08:52:27.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.427+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f51d406ae70 msgr2=0x7f51d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:27.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.427+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f51d406ae70 0x7f51d406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51ec036000 tx=0x7f51ec03c040 comp rx=0 tx=0).stop 2023-10-16T08:52:27.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.427+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 msgr2=0x7f51f015aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:27.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.427+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 0x7f51f015aab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51e400cf30 tx=0x7f51e400a7d0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 shutdown_connections 2023-10-16T08:52:27.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51f015ca80 0x7f51f00cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51f00d30b0 0x7f51f015aab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f51d406ae70 0x7f51d406d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 --2- 172.21.15.94:0/193824563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f00cd890 0x7f51f01f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:27.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 >> 172.21.15.94:0/193824563 conn(0x7f51f0071900 msgr2=0x7f51f015f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:27.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 shutdown_connections 2023-10-16T08:52:27.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:27.428+0000 7f51f7ff5640 1 -- 172.21.15.94:0/193824563 wait complete. 2023-10-16T08:52:27.447 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T08:52:27.448 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T08:52:27.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T08:52:27.685 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T08:52:27.685 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:52:27.686 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:27.746 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:52:27.747 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:27.805 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:28.017 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.016+0000 7f9505e10640 1 Processor -- start 2023-10-16T08:52:28.017 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.016+0000 7f9505e10640 1 -- start start 2023-10-16T08:52:28.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.017+0000 7f9505e10640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f95000cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.017+0000 7f9505e10640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f950015ce60 0x7f95000cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.020 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.017+0000 7f9505e10640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9500161620 con 0x7f950015ca80 2023-10-16T08:52:28.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.017+0000 7f9505e10640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000cafa0 con 0x7f950015ce60 2023-10-16T08:52:28.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.017+0000 7f9505e10640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000cb280 con 0x7f95000b0720 2023-10-16T08:52:28.021 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94ff7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f950015ca80 0x7f95000b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46878/0 (socket says 172.21.15.94:46878) 2023-10-16T08:52:28.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94ff7fe640 1 -- 172.21.15.94:0/521404255 learned_addr learned my addr 172.21.15.94:0/521404255 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:28.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fffff640 1 --2- 172.21.15.94:0/521404255 >> v2:172.21.15.94:3300/0 conn(0x7f950015ce60 0x7f95000cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94feffd640 1 --2- 172.21.15.94:0/521404255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f95000cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fe7fc640 1 -- 172.21.15.94:0/521404255 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233476409 0 0) 0x7f9500161620 con 0x7f950015ca80 2023-10-16T08:52:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fe7fc640 1 -- 172.21.15.94:0/521404255 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ec003520 con 0x7f950015ca80 2023-10-16T08:52:28.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fffff640 1 -- 172.21.15.94:0/521404255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 msgr2=0x7f95000cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:28.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fffff640 1 --2- 172.21.15.94:0/521404255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f95000cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fffff640 1 -- 172.21.15.94:0/521404255 >> v1:172.21.15.94:6789/0 conn(0x7f950015ca80 legacy=0x7f95000b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.025 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.018+0000 7f94fffff640 1 -- 172.21.15.94:0/521404255 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000cb560 con 0x7f950015ce60 2023-10-16T08:52:28.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.019+0000 7f94fffff640 1 --2- 172.21.15.94:0/521404255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f95000cc4f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb393188e31c62e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f94fe7fc640 1 -- 172.21.15.94:0/521404255 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f802d040 con 0x7f950015ce60 2023-10-16T08:52:28.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f94fe7fc640 1 -- 172.21.15.94:0/521404255 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8031810 con 0x7f950015ce60 2023-10-16T08:52:28.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f94fe7fc640 1 -- 172.21.15.94:0/521404255 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8031ba0 con 0x7f950015ce60 2023-10-16T08:52:28.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 -- 172.21.15.94:0/521404255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 msgr2=0x7f95000cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 --2- 172.21.15.94:0/521404255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f95000cc4f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 -- 172.21.15.94:0/521404255 shutdown_connections 2023-10-16T08:52:28.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 --2- 172.21.15.94:0/521404255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f95000cc4f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 --2- 172.21.15.94:0/521404255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f95000cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 -- 172.21.15.94:0/521404255 >> 172.21.15.94:0/521404255 conn(0x7f950006c1c0 msgr2=0x7f950006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:28.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 -- 172.21.15.94:0/521404255 shutdown_connections 2023-10-16T08:52:28.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.020+0000 7f9505e10640 1 -- 172.21.15.94:0/521404255 wait complete. 2023-10-16T08:52:28.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.022+0000 7f9505e10640 1 Processor -- start 2023-10-16T08:52:28.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.022+0000 7f9505e10640 1 -- start start 2023-10-16T08:52:28.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.023+0000 7f9505e10640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f9500148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.023+0000 7f9505e10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f950015ca80 0x7f950015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.023+0000 7f9505e10640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f950014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.023+0000 7f9505e10640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500160460 con 0x7f950015ce60 2023-10-16T08:52:28.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.023+0000 7f9505e10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c3240 con 0x7f950015ca80 2023-10-16T08:52:28.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.023+0000 7f9505e10640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c3520 con 0x7f95000b0720 2023-10-16T08:52:28.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f950014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f950014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44170/0 (socket says 172.21.15.94:44170) 2023-10-16T08:52:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 -- 172.21.15.94:0/724842188 learned_addr learned my addr 172.21.15.94:0/724842188 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94ff7fe640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f9500148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 -- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 msgr2=0x7f9500148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f9500148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 -- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f950015ca80 msgr2=0x7f950015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94feffd640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f950015ca80 0x7f950015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f950015ca80 0x7f950015faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 -- 172.21.15.94:0/724842188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009400 con 0x7f950015ce60 2023-10-16T08:52:28.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.024+0000 7f94fffff640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f950014e240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f94f802b8f0 tx=0x7f94f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.025+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8006e10 con 0x7f950015ce60 2023-10-16T08:52:28.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.025+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f803ace0 con 0x7f950015ce60 2023-10-16T08:52:28.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.025+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8044610 con 0x7f950015ce60 2023-10-16T08:52:28.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.025+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95000c3800 con 0x7f950015ce60 2023-10-16T08:52:28.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.025+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9500149040 con 0x7f950015ce60 2023-10-16T08:52:28.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.026+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95000c3d20 con 0x7f950015ce60 2023-10-16T08:52:28.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.027+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94f8044770 con 0x7f950015ce60 2023-10-16T08:52:28.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.028+0000 7f94f7fff640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94e006ae70 0x7f94e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.028+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94f80abb80 con 0x7f950015ce60 2023-10-16T08:52:28.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.028+0000 7f94ff7fe640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94e006ae70 0x7f94e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.029+0000 7f94ff7fe640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94e006ae70 0x7f94e006d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94e80011e0 tx=0x7f94e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.032+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95000c3d20 con 0x7f950015ce60 2023-10-16T08:52:28.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.221+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95000c3d20 con 0x7f950015ce60 2023-10-16T08:52:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.223+0000 7f94f7fff640 1 -- 172.21.15.94:0/724842188 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f95000c3d20 con 0x7f950015ce60 2023-10-16T08:52:28.224 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:28.224 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:28.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.225+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94e006ae70 msgr2=0x7f94e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.225+0000 7f9505e10640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94e006ae70 0x7f94e006d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94e80011e0 tx=0x7f94e8009040 comp rx=0 tx=0).stop 2023-10-16T08:52:28.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 msgr2=0x7f950014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f950014e240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f94f802b8f0 tx=0x7f94f80046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 shutdown_connections 2023-10-16T08:52:28.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f950015ce60 0x7f950014e240 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94e006ae70 0x7f94e006d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f950015ca80 0x7f950015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 --2- 172.21.15.94:0/724842188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95000b0720 0x7f9500148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 >> 172.21.15.94:0/724842188 conn(0x7f950006c1c0 msgr2=0x7f95000ac500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:28.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 shutdown_connections 2023-10-16T08:52:28.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.226+0000 7f9505e10640 1 -- 172.21.15.94:0/724842188 wait complete. 2023-10-16T08:52:28.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:28.246 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:28.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.454+0000 7f33039d0640 1 Processor -- start 2023-10-16T08:52:28.455 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.454+0000 7f33039d0640 1 -- start start 2023-10-16T08:52:28.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.455+0000 7f33039d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f32fc15cbf0 0x7f32fc0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.455+0000 7f33039d0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32fc0b4410 0x7f32fc0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.455+0000 7f33039d0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc0b4d80 con 0x7f32fc0b8400 2023-10-16T08:52:28.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.455+0000 7f33039d0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0d0dc0 con 0x7f32fc0b4410 2023-10-16T08:52:28.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.455+0000 7f33039d0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0d18f0 con 0x7f32fc15cbf0 2023-10-16T08:52:28.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32fc0b4410 0x7f32fc0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32fc0b4410 0x7f32fc0b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44186/0 (socket says 172.21.15.94:44186) 2023-10-16T08:52:28.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 -- 172.21.15.94:0/3603254636 learned_addr learned my addr 172.21.15.94:0/3603254636 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:28.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f330176c640 1 --2- 172.21.15.94:0/3603254636 >> v2:172.21.15.130:3300/0 conn(0x7f32fc15cbf0 0x7f32fc0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 -- 172.21.15.94:0/3603254636 >> v2:172.21.15.130:3300/0 conn(0x7f32fc15cbf0 msgr2=0x7f32fc0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:28.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 --2- 172.21.15.94:0/3603254636 >> v2:172.21.15.130:3300/0 conn(0x7f32fc15cbf0 0x7f32fc0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 -- 172.21.15.94:0/3603254636 >> v1:172.21.15.130:6789/0 conn(0x7f32fc0b8400 legacy=0x7f32fc0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:28.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.456+0000 7f3301f6d640 1 -- 172.21.15.94:0/3603254636 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15cfd0 con 0x7f32fc0b4410 2023-10-16T08:52:28.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.458+0000 7f3301f6d640 1 --2- 172.21.15.94:0/3603254636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b4410 0x7f32fc0b4840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0b23a0 tx=0x7f32f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ac64783941d104 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.458+0000 7f32f3fff640 1 -- 172.21.15.94:0/3603254636 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f402ca40 con 0x7f32fc0b4410 2023-10-16T08:52:28.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.458+0000 7f32f3fff640 1 -- 172.21.15.94:0/3603254636 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f402cba0 con 0x7f32fc0b4410 2023-10-16T08:52:28.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.458+0000 7f32f3fff640 1 -- 172.21.15.94:0/3603254636 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40343f0 con 0x7f32fc0b4410 2023-10-16T08:52:28.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 -- 172.21.15.94:0/3603254636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b4410 msgr2=0x7f32fc0b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 --2- 172.21.15.94:0/3603254636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b4410 0x7f32fc0b4840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0b23a0 tx=0x7f32f402bea0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 -- 172.21.15.94:0/3603254636 shutdown_connections 2023-10-16T08:52:28.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 --2- 172.21.15.94:0/3603254636 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b4410 0x7f32fc0b4840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 --2- 172.21.15.94:0/3603254636 >> v2:172.21.15.130:3300/0 conn(0x7f32fc15cbf0 0x7f32fc0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 -- 172.21.15.94:0/3603254636 >> 172.21.15.94:0/3603254636 conn(0x7f32fc071900 msgr2=0x7f32fc071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:28.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 -- 172.21.15.94:0/3603254636 shutdown_connections 2023-10-16T08:52:28.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.459+0000 7f33039d0640 1 -- 172.21.15.94:0/3603254636 wait complete. 2023-10-16T08:52:28.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.461+0000 7f33039d0640 1 Processor -- start 2023-10-16T08:52:28.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.461+0000 7f33039d0640 1 -- start start 2023-10-16T08:52:28.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f33039d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32fc0b4410 0x7f32fc15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f33039d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 0x7f32fc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f33039d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32fc15cbf0 0x7f32fc150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f33039d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15e440 con 0x7f32fc0b8400 2023-10-16T08:52:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f33039d0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15d8c0 con 0x7f32fc15cbf0 2023-10-16T08:52:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f33039d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15dba0 con 0x7f32fc0b4410 2023-10-16T08:52:28.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f3300f6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 0x7f32fc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f3300f6b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 0x7f32fc0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44200/0 (socket says 172.21.15.94:44200) 2023-10-16T08:52:28.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.462+0000 7f3300f6b640 1 -- 172.21.15.94:0/1924767950 learned_addr learned my addr 172.21.15.94:0/1924767950 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:28.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3301f6d640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32fc15cbf0 0x7f32fc150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f330176c640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32fc0b4410 0x7f32fc15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3300f6b640 1 -- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32fc0b4410 msgr2=0x7f32fc15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3300f6b640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32fc0b4410 0x7f32fc15d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3300f6b640 1 -- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32fc15cbf0 msgr2=0x7f32fc150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3300f6b640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32fc15cbf0 0x7f32fc150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3300f6b640 1 -- 172.21.15.94:0/1924767950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009b30 con 0x7f32fc0b8400 2023-10-16T08:52:28.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f3300f6b640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 0x7f32fc0c7530 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c430 tx=0x7f32ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011790 con 0x7f32fc0b8400 2023-10-16T08:52:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0118f0 con 0x7f32fc0b8400 2023-10-16T08:52:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc15de80 con 0x7f32fc0b8400 2023-10-16T08:52:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.463+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011ce0 con 0x7f32fc0b8400 2023-10-16T08:52:28.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.464+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc150540 con 0x7f32fc0b8400 2023-10-16T08:52:28.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.465+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc073ef0 con 0x7f32fc0b8400 2023-10-16T08:52:28.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.466+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32ec01c460 con 0x7f32fc0b8400 2023-10-16T08:52:28.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.467+0000 7f32f1ffb640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f32e006ae70 0x7f32e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.467+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32ec0898f0 con 0x7f32fc0b8400 2023-10-16T08:52:28.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.467+0000 7f330176c640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f32e006ae70 0x7f32e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.468+0000 7f330176c640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f32e006ae70 0x7f32e006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.472+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32ec054670 con 0x7f32fc0b8400 2023-10-16T08:52:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.661+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32fc0b69c0 con 0x7f32fc0b8400 2023-10-16T08:52:28.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.662+0000 7f32f1ffb640 1 -- 172.21.15.94:0/1924767950 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32ec057c90 con 0x7f32fc0b8400 2023-10-16T08:52:28.663 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:28.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f32e006ae70 msgr2=0x7f32e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f32e006ae70 0x7f32e006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8008040 comp rx=0 tx=0).stop 2023-10-16T08:52:28.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 msgr2=0x7f32fc0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 0x7f32fc0c7530 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c430 tx=0x7f32ec00c8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 shutdown_connections 2023-10-16T08:52:28.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f32e006ae70 0x7f32e006d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32fc15cbf0 0x7f32fc150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32fc0b8400 0x7f32fc0c7530 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 --2- 172.21.15.94:0/1924767950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32fc0b4410 0x7f32fc15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.664+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 >> 172.21.15.94:0/1924767950 conn(0x7f32fc071900 msgr2=0x7f32fc0c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:28.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.665+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 shutdown_connections 2023-10-16T08:52:28.668 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.665+0000 7f33039d0640 1 -- 172.21.15.94:0/1924767950 wait complete. 2023-10-16T08:52:28.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:28.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.902+0000 7f5dab4ec640 1 Processor -- start 2023-10-16T08:52:28.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.902+0000 7f5dab4ec640 1 -- start start 2023-10-16T08:52:28.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5dab4ec640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da415a830 0x7f5da40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5dab4ec640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5da40ca550 0x7f5da4070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5dab4ec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40cf040 con 0x7f5da4070860 2023-10-16T08:52:28.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5dab4ec640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da4070cf0 con 0x7f5da40ca550 2023-10-16T08:52:28.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5dab4ec640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40ce430 con 0x7f5da415a830 2023-10-16T08:52:28.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5da8a87640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5da40ca550 0x7f5da4070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5da8a87640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5da40ca550 0x7f5da4070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44202/0 (socket says 172.21.15.94:44202) 2023-10-16T08:52:28.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5da8a87640 1 -- 172.21.15.94:0/4288166910 learned_addr learned my addr 172.21.15.94:0/4288166910 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:28.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5da9288640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da415a830 0x7f5da40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.904+0000 7f5da8a87640 1 -- 172.21.15.94:0/4288166910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da415a830 msgr2=0x7f5da40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:28.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.905+0000 7f5da8a87640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da415a830 0x7f5da40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.905+0000 7f5da8a87640 1 -- 172.21.15.94:0/4288166910 >> v1:172.21.15.130:6789/0 conn(0x7f5da4070860 legacy=0x7f5da415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:28.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.905+0000 7f5da8a87640 1 -- 172.21.15.94:0/4288166910 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40ce710 con 0x7f5da40ca550 2023-10-16T08:52:28.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.905+0000 7f5da9288640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da415a830 0x7f5da40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:28.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.906+0000 7f5da8a87640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40ca550 0x7f5da4070320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009870 tx=0x7f5d9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfa4918c9c26195 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.906+0000 7f5d9bfff640 1 -- 172.21.15.94:0/4288166910 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94031640 con 0x7f5da40ca550 2023-10-16T08:52:28.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.906+0000 7f5d9bfff640 1 -- 172.21.15.94:0/4288166910 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d940317a0 con 0x7f5da40ca550 2023-10-16T08:52:28.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.906+0000 7f5d9bfff640 1 -- 172.21.15.94:0/4288166910 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94031b30 con 0x7f5da40ca550 2023-10-16T08:52:28.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.906+0000 7f5dab4ec640 1 -- 172.21.15.94:0/4288166910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40ca550 msgr2=0x7f5da4070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.906+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40ca550 0x7f5da4070320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009870 tx=0x7f5d9402b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.907+0000 7f5dab4ec640 1 -- 172.21.15.94:0/4288166910 shutdown_connections 2023-10-16T08:52:28.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.907+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40ca550 0x7f5da4070320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.907+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/4288166910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da415a830 0x7f5da40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.907+0000 7f5dab4ec640 1 -- 172.21.15.94:0/4288166910 >> 172.21.15.94:0/4288166910 conn(0x7f5da40b0030 msgr2=0x7f5da40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:28.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.907+0000 7f5dab4ec640 1 -- 172.21.15.94:0/4288166910 shutdown_connections 2023-10-16T08:52:28.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.907+0000 7f5dab4ec640 1 -- 172.21.15.94:0/4288166910 wait complete. 2023-10-16T08:52:28.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.908+0000 7f5dab4ec640 1 Processor -- start 2023-10-16T08:52:28.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 -- start start 2023-10-16T08:52:28.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 0x7f5da415bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da40ca550 0x7f5da415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5da415a830 0x7f5da415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40cd250 con 0x7f5da4070860 2023-10-16T08:52:28.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40cc640 con 0x7f5da415a830 2023-10-16T08:52:28.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.909+0000 7f5dab4ec640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40cc920 con 0x7f5da40ca550 2023-10-16T08:52:28.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 0x7f5da415bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 0x7f5da415bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44214/0 (socket says 172.21.15.94:44214) 2023-10-16T08:52:28.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 -- 172.21.15.94:0/1313803605 learned_addr learned my addr 172.21.15.94:0/1313803605 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:28.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da8a87640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da40ca550 0x7f5da415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9a89640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5da415a830 0x7f5da415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 -- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da40ca550 msgr2=0x7f5da415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da40ca550 0x7f5da415cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 -- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5da415a830 msgr2=0x7f5da415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:28.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5da415a830 0x7f5da415d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:28.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.910+0000 7f5da9288640 1 -- 172.21.15.94:0/1313803605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940094d0 con 0x7f5da4070860 2023-10-16T08:52:28.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.911+0000 7f5da9288640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 0x7f5da415bb40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5da000c7f0 tx=0x7f5da000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.911+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0007820 con 0x7f5da4070860 2023-10-16T08:52:28.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.911+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0007980 con 0x7f5da4070860 2023-10-16T08:52:28.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.911+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da40ccc00 con 0x7f5da4070860 2023-10-16T08:52:28.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.911+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0007cf0 con 0x7f5da4070860 2023-10-16T08:52:28.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.911+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da415c080 con 0x7f5da4070860 2023-10-16T08:52:28.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.912+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da4073ef0 con 0x7f5da4070860 2023-10-16T08:52:28.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.913+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5da00113f0 con 0x7f5da4070860 2023-10-16T08:52:28.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.914+0000 7f5d99ffb640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5d8806ae70 0x7f5d8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:28.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.914+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5da0089db0 con 0x7f5da4070860 2023-10-16T08:52:28.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.914+0000 7f5da8a87640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5d8806ae70 0x7f5d8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:28.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.915+0000 7f5da8a87640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5d8806ae70 0x7f5d8806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d94036000 tx=0x7f5d9403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:28.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:28.919+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5da008e070 con 0x7f5da4070860 2023-10-16T08:52:29.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.108+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5da4072de0 con 0x7f5da4070860 2023-10-16T08:52:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.109+0000 7f5d99ffb640 1 -- 172.21.15.94:0/1313803605 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5da0054a00 con 0x7f5da4070860 2023-10-16T08:52:29.110 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:29.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5d8806ae70 msgr2=0x7f5d8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5d8806ae70 0x7f5d8806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d94036000 tx=0x7f5d9403c040 comp rx=0 tx=0).stop 2023-10-16T08:52:29.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 msgr2=0x7f5da415bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 0x7f5da415bb40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5da000c7f0 tx=0x7f5da000ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 shutdown_connections 2023-10-16T08:52:29.113 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5d8806ae70 0x7f5d8806d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5da415a830 0x7f5da415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.111+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5da40ca550 0x7f5da415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.112+0000 7f5dab4ec640 1 --2- 172.21.15.94:0/1313803605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4070860 0x7f5da415bb40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.112+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 >> 172.21.15.94:0/1313803605 conn(0x7f5da40b0030 msgr2=0x7f5da40b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.112+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 shutdown_connections 2023-10-16T08:52:29.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.112+0000 7f5dab4ec640 1 -- 172.21.15.94:0/1313803605 wait complete. 2023-10-16T08:52:29.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:29.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.343+0000 7feeafcb4640 1 Processor -- start 2023-10-16T08:52:29.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.343+0000 7feeafcb4640 1 -- start start 2023-10-16T08:52:29.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.344+0000 7feeafcb4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feea80ca820 0x7feea8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.344+0000 7feeafcb4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feea80c8ea0 0x7feea80c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.344+0000 7feeafcb4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea8072480 con 0x7feea8159890 2023-10-16T08:52:29.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.344+0000 7feeafcb4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80cd0c0 con 0x7feea80ca820 2023-10-16T08:52:29.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.344+0000 7feeafcb4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80cc540 con 0x7feea80c8ea0 2023-10-16T08:52:29.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feea80ca820 0x7feea8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feea80ca820 0x7feea8071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44226/0 (socket says 172.21.15.94:44226) 2023-10-16T08:52:29.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 -- 172.21.15.94:0/1076447407 learned_addr learned my addr 172.21.15.94:0/1076447407 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:29.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feeae251640 1 --2- 172.21.15.94:0/1076447407 >> v2:172.21.15.130:3300/0 conn(0x7feea80c8ea0 0x7feea80c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 -- 172.21.15.94:0/1076447407 >> v2:172.21.15.130:3300/0 conn(0x7feea80c8ea0 msgr2=0x7feea80c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:29.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 --2- 172.21.15.94:0/1076447407 >> v2:172.21.15.130:3300/0 conn(0x7feea80c8ea0 0x7feea80c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 -- 172.21.15.94:0/1076447407 >> v1:172.21.15.130:6789/0 conn(0x7feea8159890 legacy=0x7feea80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:29.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.345+0000 7feead24f640 1 -- 172.21.15.94:0/1076447407 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80cc820 con 0x7feea80ca820 2023-10-16T08:52:29.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.346+0000 7feead24f640 1 --2- 172.21.15.94:0/1076447407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80ca820 0x7feea8071f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feea80b0fd0 tx=0x7fee9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69ffeb8c99b670f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:29.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.346+0000 7feeaca4e640 1 -- 172.21.15.94:0/1076447407 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98031640 con 0x7feea80ca820 2023-10-16T08:52:29.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeaca4e640 1 -- 172.21.15.94:0/1076447407 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee980317a0 con 0x7feea80ca820 2023-10-16T08:52:29.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeaca4e640 1 -- 172.21.15.94:0/1076447407 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98031b30 con 0x7feea80ca820 2023-10-16T08:52:29.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 -- 172.21.15.94:0/1076447407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80ca820 msgr2=0x7feea8071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 --2- 172.21.15.94:0/1076447407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80ca820 0x7feea8071f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feea80b0fd0 tx=0x7fee9802b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 -- 172.21.15.94:0/1076447407 shutdown_connections 2023-10-16T08:52:29.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 --2- 172.21.15.94:0/1076447407 >> v2:172.21.15.130:3300/0 conn(0x7feea80c8ea0 0x7feea80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 --2- 172.21.15.94:0/1076447407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80ca820 0x7feea8071f40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 -- 172.21.15.94:0/1076447407 >> 172.21.15.94:0/1076447407 conn(0x7feea80b0030 msgr2=0x7feea80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:29.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 -- 172.21.15.94:0/1076447407 shutdown_connections 2023-10-16T08:52:29.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.347+0000 7feeafcb4640 1 -- 172.21.15.94:0/1076447407 wait complete. 2023-10-16T08:52:29.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.349+0000 7feeafcb4640 1 Processor -- start 2023-10-16T08:52:29.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.349+0000 7feeafcb4640 1 -- start start 2023-10-16T08:52:29.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.350+0000 7feeafcb4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feea80c8ea0 0x7feea80c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.350+0000 7feeafcb4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea8159890 0x7feea8149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.350+0000 7feeafcb4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 0x7feea80c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.350+0000 7feeafcb4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c7680 con 0x7feea80c4b70 2023-10-16T08:52:29.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.350+0000 7feeafcb4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c7fe0 con 0x7feea8159890 2023-10-16T08:52:29.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.350+0000 7feeafcb4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c6a00 con 0x7feea80c8ea0 2023-10-16T08:52:29.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 0x7feea80c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 0x7feea80c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44236/0 (socket says 172.21.15.94:44236) 2023-10-16T08:52:29.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 -- 172.21.15.94:0/2255458112 learned_addr learned my addr 172.21.15.94:0/2255458112 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:29.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeada50640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feea80c8ea0 0x7feea80c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feead24f640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea8159890 0x7feea8149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 -- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feea80c8ea0 msgr2=0x7feea80c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feea80c8ea0 0x7feea80c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 -- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea8159890 msgr2=0x7feea8149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea8159890 0x7feea8149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 -- 172.21.15.94:0/2255458112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980094d0 con 0x7feea80c4b70 2023-10-16T08:52:29.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feead24f640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea8159890 0x7feea8149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:29.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.351+0000 7feeae251640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 0x7feea80c2030 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feea0007e70 tx=0x7feea000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.352+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0014620 con 0x7feea80c4b70 2023-10-16T08:52:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.352+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00147a0 con 0x7feea80c4b70 2023-10-16T08:52:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.352+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80c6ce0 con 0x7feea80c4b70 2023-10-16T08:52:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.352+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0014b50 con 0x7feea80c4b70 2023-10-16T08:52:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.352+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea80c72a0 con 0x7feea80c4b70 2023-10-16T08:52:29.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.353+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80c77c0 con 0x7feea80c4b70 2023-10-16T08:52:29.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.354+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feea0014cb0 con 0x7feea80c4b70 2023-10-16T08:52:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.355+0000 7fee9e7fc640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee8c06ae70 0x7fee8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.355+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feea008a3d0 con 0x7feea80c4b70 2023-10-16T08:52:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.355+0000 7feeada50640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee8c06ae70 0x7fee8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.356+0000 7feeada50640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee8c06ae70 0x7fee8c06d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feea815cf40 tx=0x7feea4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.359+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feea80c77c0 con 0x7feea80c4b70 2023-10-16T08:52:29.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.547+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feea80c77c0 con 0x7feea80c4b70 2023-10-16T08:52:29.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.548+0000 7fee9e7fc640 1 -- 172.21.15.94:0/2255458112 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7feea80c77c0 con 0x7feea80c4b70 2023-10-16T08:52:29.549 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:29.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee8c06ae70 msgr2=0x7fee8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee8c06ae70 0x7fee8c06d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feea815cf40 tx=0x7feea4009040 comp rx=0 tx=0).stop 2023-10-16T08:52:29.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 msgr2=0x7feea80c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 0x7feea80c2030 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feea0007e70 tx=0x7feea000e4b0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 shutdown_connections 2023-10-16T08:52:29.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feea80c4b70 0x7feea80c2030 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fee8c06ae70 0x7fee8c06d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea8159890 0x7feea8149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 --2- 172.21.15.94:0/2255458112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feea80c8ea0 0x7feea80c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 >> 172.21.15.94:0/2255458112 conn(0x7feea80b0030 msgr2=0x7feea80b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:29.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 shutdown_connections 2023-10-16T08:52:29.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.551+0000 7feeafcb4640 1 -- 172.21.15.94:0/2255458112 wait complete. 2023-10-16T08:52:29.569 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:29.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.786+0000 7f627a090640 1 Processor -- start 2023-10-16T08:52:29.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.787+0000 7f627a090640 1 -- start start 2023-10-16T08:52:29.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f627a090640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 0x7f627406cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f627a090640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f62740ca9b0 0x7f62740c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f627a090640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627406d510 con 0x7f62740ca5d0 2023-10-16T08:52:29.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f627a090640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627406c2a0 con 0x7f62740ca9b0 2023-10-16T08:52:29.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f627a090640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740cafa0 con 0x7f627406e0e0 2023-10-16T08:52:29.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f62737fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f62740ca5d0 0x7f62740ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46886/0 (socket says 172.21.15.94:46886) 2023-10-16T08:52:29.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.788+0000 7f62737fe640 1 -- 172.21.15.94:0/2230751617 learned_addr learned my addr 172.21.15.94:0/2230751617 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:29.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566530264 0 0) 0x7f6264001490 con 0x7f62740ca5d0 2023-10-16T08:52:29.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6260003520 con 0x7f62740ca5d0 2023-10-16T08:52:29.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f6273fff640 1 --2- 172.21.15.94:0/2230751617 >> v2:172.21.15.130:3300/0 conn(0x7f62740ca9b0 0x7f62740c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f6272ffd640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 0x7f627406cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441572134 0 0) 0x7f6260003520 con 0x7f62740ca5d0 2023-10-16T08:52:29.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 msgr2=0x7f627406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:29.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 0x7f627406cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 >> v2:172.21.15.130:3300/0 conn(0x7f62740ca9b0 msgr2=0x7f62740c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:29.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 --2- 172.21.15.94:0/2230751617 >> v2:172.21.15.130:3300/0 conn(0x7f62740ca9b0 0x7f62740c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627406c4f0 con 0x7f62740ca5d0 2023-10-16T08:52:29.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f6264001b80 con 0x7f62740ca5d0 2023-10-16T08:52:29.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 >> v1:172.21.15.94:6789/0 conn(0x7f62740ca5d0 legacy=0x7f62740ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 0x7f6260003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6260003fa0 0x7f62600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6260004d00 0x7f6260005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627406c2a0 con 0x7f6260003fa0 2023-10-16T08:52:29.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740cafa0 con 0x7f6260004d00 2023-10-16T08:52:29.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.789+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626000bb40 con 0x7f627406e0e0 2023-10-16T08:52:29.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6272ffd640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6260003fa0 0x7f62600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f62737fe640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 0x7f6260003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6272ffd640 1 -- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 msgr2=0x7f6260003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:29.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6272ffd640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627406e0e0 0x7f6260003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6272ffd640 1 -- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6260004d00 msgr2=0x7f6260005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:29.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6273fff640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6260004d00 0x7f6260005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6272ffd640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6260004d00 0x7f6260005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6272ffd640 1 -- 172.21.15.94:0/2230751617 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260003520 con 0x7f6260003fa0 2023-10-16T08:52:29.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.790+0000 7f6273fff640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6260004d00 0x7f6260005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:29.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.791+0000 7f6272ffd640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6260003fa0 0x7f62600047c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f625c00ba30 tx=0x7f62600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197f706e155f259a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:29.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.791+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c032640 con 0x7f6260003fa0 2023-10-16T08:52:29.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0327a0 con 0x7f6260003fa0 2023-10-16T08:52:29.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f62727fc640 1 -- 172.21.15.94:0/2230751617 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c032b30 con 0x7f6260003fa0 2023-10-16T08:52:29.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f627a090640 1 -- 172.21.15.94:0/2230751617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6260003fa0 msgr2=0x7f62600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f627a090640 1 --2- 172.21.15.94:0/2230751617 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6260003fa0 0x7f62600047c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f625c00ba30 tx=0x7f62600057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f6273fff640 1 -- 172.21.15.94:0/2230751617 reap_dead start 2023-10-16T08:52:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f627a090640 1 -- 172.21.15.94:0/2230751617 shutdown_connections 2023-10-16T08:52:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f627a090640 1 -- 172.21.15.94:0/2230751617 >> 172.21.15.94:0/2230751617 conn(0x7f62740b0870 msgr2=0x7f62740b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f627a090640 1 -- 172.21.15.94:0/2230751617 shutdown_connections 2023-10-16T08:52:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.792+0000 7f627a090640 1 -- 172.21.15.94:0/2230751617 wait complete. 2023-10-16T08:52:29.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.794+0000 7f627a090640 1 Processor -- start 2023-10-16T08:52:29.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.794+0000 7f627a090640 1 -- start start 2023-10-16T08:52:29.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f627a090640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6260003fa0 0x7f62741f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f627a090640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62740af670 0x7f62740afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f627a090640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 0x7f627409e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f627a090640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741501a0 con 0x7f627409ded0 2023-10-16T08:52:29.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f627a090640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740b0010 con 0x7f62740af670 2023-10-16T08:52:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f627a090640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627409eec0 con 0x7f6260003fa0 2023-10-16T08:52:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f6273fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 0x7f627409e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f6273fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 0x7f627409e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44256/0 (socket says 172.21.15.94:44256) 2023-10-16T08:52:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.795+0000 7f6273fff640 1 -- 172.21.15.94:0/593317330 learned_addr learned my addr 172.21.15.94:0/593317330 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6272ffd640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62740af670 0x7f62740afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f62737fe640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6260003fa0 0x7f62741f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6273fff640 1 -- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6260003fa0 msgr2=0x7f62741f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6273fff640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6260003fa0 0x7f62741f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6273fff640 1 -- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62740af670 msgr2=0x7f62740afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:29.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6273fff640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62740af670 0x7f62740afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:29.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6273fff640 1 -- 172.21.15.94:0/593317330 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627409ebe0 con 0x7f627409ded0 2023-10-16T08:52:29.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f6273fff640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 0x7f627409e350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f62740ae790 tx=0x7f626c00e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:29.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00c070 con 0x7f627409ded0 2023-10-16T08:52:29.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c013610 con 0x7f627409ded0 2023-10-16T08:52:29.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627414fae0 con 0x7f627409ded0 2023-10-16T08:52:29.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.796+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0139c0 con 0x7f627409ded0 2023-10-16T08:52:29.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.797+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627409e890 con 0x7f627409ded0 2023-10-16T08:52:29.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.798+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62741502e0 con 0x7f627409ded0 2023-10-16T08:52:29.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.799+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f626c013b20 con 0x7f627409ded0 2023-10-16T08:52:29.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.799+0000 7f626bfff640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f625406ae70 0x7f625406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:29.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.800+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f626c089540 con 0x7f627409ded0 2023-10-16T08:52:29.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.800+0000 7f62737fe640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f625406ae70 0x7f625406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:29.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.800+0000 7f62737fe640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f625406ae70 0x7f625406d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6264001630 tx=0x7f6264009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:29.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.804+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62741502e0 con 0x7f627409ded0 2023-10-16T08:52:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.996+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62741502e0 con 0x7f627409ded0 2023-10-16T08:52:29.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.997+0000 7f626bfff640 1 -- 172.21.15.94:0/593317330 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62741502e0 con 0x7f627409ded0 2023-10-16T08:52:29.998 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:30.001 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.999+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f625406ae70 msgr2=0x7f625406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.001 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.999+0000 7f627a090640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f625406ae70 0x7f625406d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6264001630 tx=0x7f6264009040 comp rx=0 tx=0).stop 2023-10-16T08:52:30.001 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.999+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 msgr2=0x7f627409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.001 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:29.999+0000 7f627a090640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 0x7f627409e350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f62740ae790 tx=0x7f626c00e830 comp rx=0 tx=0).stop 2023-10-16T08:52:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 shutdown_connections 2023-10-16T08:52:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f627409ded0 0x7f627409e350 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f625406ae70 0x7f625406d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62740af670 0x7f62740afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 --2- 172.21.15.94:0/593317330 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6260003fa0 0x7f62741f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 >> 172.21.15.94:0/593317330 conn(0x7f62740b0870 msgr2=0x7f62740ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:30.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 shutdown_connections 2023-10-16T08:52:30.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.000+0000 7f627a090640 1 -- 172.21.15.94:0/593317330 wait complete. 2023-10-16T08:52:30.019 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:30.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.223+0000 7f5f51d0c640 1 Processor -- start 2023-10-16T08:52:30.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.223+0000 7f5f51d0c640 1 -- start start 2023-10-16T08:52:30.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.224+0000 7f5f51d0c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f4c15cd40 0x7f5f4c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f51d0c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0cffe0 con 0x7f5f4c0cb940 2023-10-16T08:52:30.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f51d0c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c15d120 con 0x7f5f4c06a320 2023-10-16T08:52:30.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f51d0c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c06a7b0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f4b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f4c15cd40 0x7f5f4c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f4b7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f4c15cd40 0x7f5f4c069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44272/0 (socket says 172.21.15.94:44272) 2023-10-16T08:52:30.227 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f4b7fe640 1 -- 172.21.15.94:0/169246866 learned_addr learned my addr 172.21.15.94:0/169246866 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:30.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f4b7fe640 1 -- 172.21.15.94:0/169246866 >> v1:172.21.15.130:6789/0 conn(0x7f5f4c06a320 legacy=0x7f5f4c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:30.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f4b7fe640 1 -- 172.21.15.94:0/169246866 >> v1:172.21.15.94:6789/0 conn(0x7f5f4c0cb940 legacy=0x7f5f4c0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.225+0000 7f5f4b7fe640 1 -- 172.21.15.94:0/169246866 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0cc3a0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.227+0000 7f5f4b7fe640 1 --2- 172.21.15.94:0/169246866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c069de0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009870 tx=0x7f5f3c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13be3d840ea1703 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:30.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.227+0000 7f5f4a7fc640 1 -- 172.21.15.94:0/169246866 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c031860 con 0x7f5f4c15cd40 2023-10-16T08:52:30.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.227+0000 7f5f4a7fc640 1 -- 172.21.15.94:0/169246866 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0319c0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.227+0000 7f5f4a7fc640 1 -- 172.21.15.94:0/169246866 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c031d50 con 0x7f5f4c15cd40 2023-10-16T08:52:30.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 -- 172.21.15.94:0/169246866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 msgr2=0x7f5f4c069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/169246866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c069de0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009870 tx=0x7f5f3c02b900 comp rx=0 tx=0).stop 2023-10-16T08:52:30.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 -- 172.21.15.94:0/169246866 shutdown_connections 2023-10-16T08:52:30.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/169246866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c069de0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 -- 172.21.15.94:0/169246866 >> 172.21.15.94:0/169246866 conn(0x7f5f4c0989e0 msgr2=0x7f5f4c0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:30.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 -- 172.21.15.94:0/169246866 shutdown_connections 2023-10-16T08:52:30.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.228+0000 7f5f51d0c640 1 -- 172.21.15.94:0/169246866 wait complete. 2023-10-16T08:52:30.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.229+0000 7f5f51d0c640 1 Processor -- start 2023-10-16T08:52:30.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 -- start start 2023-10-16T08:52:30.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f4c06a320 0x7f5f4c157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f4c0cb940 0x7f5f4c06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c7a90 con 0x7f5f4c15cd40 2023-10-16T08:52:30.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c7ca0 con 0x7f5f4c0cb940 2023-10-16T08:52:30.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.230+0000 7f5f51d0c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c7f40 con 0x7f5f4c06a320 2023-10-16T08:52:30.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c0c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44282/0 (socket says 172.21.15.94:44282) 2023-10-16T08:52:30.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 -- 172.21.15.94:0/4062095094 learned_addr learned my addr 172.21.15.94:0/4062095094 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:30.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4b7fe640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f4c06a320 0x7f5f4c157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 -- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f4c06a320 msgr2=0x7f5f4c157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4affd640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f4c0cb940 0x7f5f4c06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f4c06a320 0x7f5f4c157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 -- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f4c0cb940 msgr2=0x7f5f4c06ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f4c0cb940 0x7f5f4c06ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.231+0000 7f5f4bfff640 1 -- 172.21.15.94:0/4062095094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0094d0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.232+0000 7f5f4bfff640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c0c8d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b970 tx=0x7f5f4400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:30.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.232+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400cb40 con 0x7f5f4c15cd40 2023-10-16T08:52:30.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.232+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400cca0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.232+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c0c8220 con 0x7f5f4c15cd40 2023-10-16T08:52:30.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.232+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44014680 con 0x7f5f4c15cd40 2023-10-16T08:52:30.238 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.232+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c0c87e0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.233+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c099000 con 0x7f5f4c15cd40 2023-10-16T08:52:30.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.234+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f4401d3b0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.235+0000 7f5f43fff640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.235+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f440898a0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.235+0000 7f5f4b7fe640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.236+0000 7f5f4b7fe640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f3006ae70 0x7f5f3006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c036000 tx=0x7f5f3c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:30.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.239+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f440544f0 con 0x7f5f4c15cd40 2023-10-16T08:52:30.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.446+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f4c0c8a00 con 0x7f5f4c15cd40 2023-10-16T08:52:30.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.447+0000 7f5f43fff640 1 -- 172.21.15.94:0/4062095094 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5f44057b10 con 0x7f5f4c15cd40 2023-10-16T08:52:30.448 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:30.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.450+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f3006ae70 msgr2=0x7f5f3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.450+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f3006ae70 0x7f5f3006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c036000 tx=0x7f5f3c03c040 comp rx=0 tx=0).stop 2023-10-16T08:52:30.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.450+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 msgr2=0x7f5f4c0c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.450+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c0c8d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400b970 tx=0x7f5f4400be30 comp rx=0 tx=0).stop 2023-10-16T08:52:30.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 shutdown_connections 2023-10-16T08:52:30.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f4c15cd40 0x7f5f4c0c8d00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f4c0cb940 0x7f5f4c06ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 --2- 172.21.15.94:0/4062095094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f4c06a320 0x7f5f4c157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 >> 172.21.15.94:0/4062095094 conn(0x7f5f4c0989e0 msgr2=0x7f5f4c0c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:30.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 shutdown_connections 2023-10-16T08:52:30.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.451+0000 7f5f51d0c640 1 -- 172.21.15.94:0/4062095094 wait complete. 2023-10-16T08:52:30.470 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:52:30.470 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:30.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:30.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.734+0000 7f534015e640 1 Processor -- start 2023-10-16T08:52:30.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.734+0000 7f534015e640 1 -- start start 2023-10-16T08:52:30.736 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f534015e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f53380cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f534015e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53380b0720 0x7f53380cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f534015e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5338161620 con 0x7f533815ce60 2023-10-16T08:52:30.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f534015e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380cafa0 con 0x7f53380b0720 2023-10-16T08:52:30.737 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f534015e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53380cb280 con 0x7f533815ca80 2023-10-16T08:52:30.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f533e6fb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53380b0720 0x7f53380cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.736+0000 7f533defa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f53380cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533e6fb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53380b0720 0x7f53380cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:57688/0 (socket says 172.21.15.94:57688) 2023-10-16T08:52:30.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533d6f9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f533815ce60 0x7f53380b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:34642/0 (socket says 172.21.15.94:34642) 2023-10-16T08:52:30.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533e6fb640 1 -- 172.21.15.94:0/1027750397 learned_addr learned my addr 172.21.15.94:0/1027750397 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:30.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533defa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f53380cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:45732/0 (socket says 172.21.15.94:45732) 2023-10-16T08:52:30.739 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533e6fb640 1 -- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 msgr2=0x7f53380cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:30.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533e6fb640 1 --2- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f53380cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533e6fb640 1 -- 172.21.15.94:0/1027750397 >> v1:172.21.15.130:6789/0 conn(0x7f533815ce60 legacy=0x7f53380b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.737+0000 7f533e6fb640 1 -- 172.21.15.94:0/1027750397 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380cb560 con 0x7f53380b0720 2023-10-16T08:52:30.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.739+0000 7f533e6fb640 1 --2- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f53380cc4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5330009e50 tx=0x7f533002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f08ba258fc8b97a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:30.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.739+0000 7f533cef8640 1 -- 172.21.15.94:0/1027750397 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533002cb00 con 0x7f53380b0720 2023-10-16T08:52:30.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.739+0000 7f533cef8640 1 -- 172.21.15.94:0/1027750397 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533002cc60 con 0x7f53380b0720 2023-10-16T08:52:30.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.739+0000 7f533cef8640 1 -- 172.21.15.94:0/1027750397 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300343f0 con 0x7f53380b0720 2023-10-16T08:52:30.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 -- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 msgr2=0x7f53380cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 --2- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f53380cc4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5330009e50 tx=0x7f533002bf60 comp rx=0 tx=0).stop 2023-10-16T08:52:30.742 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 -- 172.21.15.94:0/1027750397 shutdown_connections 2023-10-16T08:52:30.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 --2- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f53380cc4f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 --2- 172.21.15.94:0/1027750397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f53380cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 -- 172.21.15.94:0/1027750397 >> 172.21.15.94:0/1027750397 conn(0x7f533806c1c0 msgr2=0x7f533806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:30.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 -- 172.21.15.94:0/1027750397 shutdown_connections 2023-10-16T08:52:30.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.740+0000 7f534015e640 1 -- 172.21.15.94:0/1027750397 wait complete. 2023-10-16T08:52:30.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.742+0000 7f534015e640 1 Processor -- start 2023-10-16T08:52:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.742+0000 7f534015e640 1 -- start start 2023-10-16T08:52:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f534015e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f5338156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f534015e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f533815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f534015e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 0x7f533815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f534015e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53381573f0 con 0x7f533815ce60 2023-10-16T08:52:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f534015e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53380b2480 con 0x7f53380b0720 2023-10-16T08:52:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f534015e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533815e020 con 0x7f533815ca80 2023-10-16T08:52:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f533e6fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 0x7f533815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f533e6fb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 0x7f533815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44296/0 (socket says 172.21.15.94:44296) 2023-10-16T08:52:30.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f533e6fb640 1 -- 172.21.15.94:0/82440018 learned_addr learned my addr 172.21.15.94:0/82440018 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.743+0000 7f533defa640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f5338156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533d6f9640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f533815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533e6fb640 1 -- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 msgr2=0x7f533815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533e6fb640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f533815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533e6fb640 1 -- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 msgr2=0x7f5338156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533e6fb640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f5338156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533e6fb640 1 -- 172.21.15.94:0/82440018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330009b30 con 0x7f533815ce60 2023-10-16T08:52:30.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533d6f9640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f533815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:30.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f533e6fb640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 0x7f533815fab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5330036040 tx=0x7f5330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:30.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330009510 con 0x7f533815ce60 2023-10-16T08:52:30.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533003e450 con 0x7f533815ce60 2023-10-16T08:52:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533003e800 con 0x7f533815ce60 2023-10-16T08:52:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.744+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533815e300 con 0x7f533815ce60 2023-10-16T08:52:30.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.745+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533815d7e0 con 0x7f533815ce60 2023-10-16T08:52:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.746+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53380b2610 con 0x7f533815ce60 2023-10-16T08:52:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.746+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f533003e960 con 0x7f533815ce60 2023-10-16T08:52:30.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.747+0000 7f532e7fc640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f531c06ae70 0x7f531c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.747+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f53300ac600 con 0x7f533815ce60 2023-10-16T08:52:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.748+0000 7f533defa640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f531c06ae70 0x7f531c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.748+0000 7f533defa640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f531c06ae70 0x7f531c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5334009a30 tx=0x7f5334008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:30.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.752+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5330077380 con 0x7f533815ce60 2023-10-16T08:52:30.945 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.944+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5338073ef0 con 0x7f533815ce60 2023-10-16T08:52:30.946 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.946+0000 7f532e7fc640 1 -- 172.21.15.94:0/82440018 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f533007a9a0 con 0x7f533815ce60 2023-10-16T08:52:30.947 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:30.947 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:30.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f531c06ae70 msgr2=0x7f531c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f531c06ae70 0x7f531c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5334009a30 tx=0x7f5334008040 comp rx=0 tx=0).stop 2023-10-16T08:52:30.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 msgr2=0x7f533815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 0x7f533815fab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5330036040 tx=0x7f5330004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 shutdown_connections 2023-10-16T08:52:30.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f533815ce60 0x7f533815fab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f533815ca80 0x7f533815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f531c06ae70 0x7f531c06d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 --2- 172.21.15.94:0/82440018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53380b0720 0x7f5338156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:30.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.948+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 >> 172.21.15.94:0/82440018 conn(0x7f533806c1c0 msgr2=0x7f533815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.949+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 shutdown_connections 2023-10-16T08:52:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:30.949+0000 7f534015e640 1 -- 172.21.15.94:0/82440018 wait complete. 2023-10-16T08:52:30.968 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:30.972 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:31.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.178+0000 7f6db1239640 1 Processor -- start 2023-10-16T08:52:31.180 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.179+0000 7f6db1239640 1 -- start start 2023-10-16T08:52:31.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.180+0000 7f6db1239640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6dac0c8930 0x7f6dac15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.180+0000 7f6db1239640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0c8e40 con 0x7f6dac0cb400 2023-10-16T08:52:31.181 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.180+0000 7f6db1239640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0c9090 con 0x7f6dac070400 2023-10-16T08:52:31.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.180+0000 7f6db1239640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0c9370 con 0x7f6dac0c8930 2023-10-16T08:52:31.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.180+0000 7f6da3fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6dac0cb400 0x7f6dac15af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46894/0 (socket says 172.21.15.94:46894) 2023-10-16T08:52:31.182 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.180+0000 7f6da3fff640 1 -- 172.21.15.94:0/4213644517 learned_addr learned my addr 172.21.15.94:0/4213644517 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:31.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6db0a38640 1 --2- 172.21.15.94:0/4213644517 >> v2:172.21.15.130:3300/0 conn(0x7f6dac0c8930 0x7f6dac15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977981449 0 0) 0x7f6dac0c8e40 con 0x7f6dac0cb400 2023-10-16T08:52:31.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d98003520 con 0x7f6dac0cb400 2023-10-16T08:52:31.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386851478 0 0) 0x7f6d98003520 con 0x7f6dac0cb400 2023-10-16T08:52:31.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 >> v2:172.21.15.130:3300/0 conn(0x7f6dac0c8930 msgr2=0x7f6dac15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 --2- 172.21.15.94:0/4213644517 >> v2:172.21.15.130:3300/0 conn(0x7f6dac0c8930 0x7f6dac15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 >> v1:172.21.15.130:6789/0 conn(0x7f6dac070400 legacy=0x7f6dac0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0c9650 con 0x7f6dac0cb400 2023-10-16T08:52:31.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f6d94001670 con 0x7f6dac0cb400 2023-10-16T08:52:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 >> v1:172.21.15.94:6789/0 conn(0x7f6dac0cb400 legacy=0x7f6dac15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d98003970 0x7f6d98003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d980047c0 0x7f6d98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d98005180 0x7f6d9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c9370 con 0x7f6d98003970 2023-10-16T08:52:31.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9800c000 con 0x7f6d980047c0 2023-10-16T08:52:31.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.181+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9800c1c0 con 0x7f6d98005180 2023-10-16T08:52:31.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6dabfff640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d98003970 0x7f6d98003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6dabfff640 1 -- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d98005180 msgr2=0x7f6d9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6dabfff640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d98005180 0x7f6d9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6dabfff640 1 -- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d980047c0 msgr2=0x7f6d98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6da3fff640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d980047c0 0x7f6d98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6dabfff640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d980047c0 0x7f6d98004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6dabfff640 1 -- 172.21.15.94:0/4213644517 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d98003520 con 0x7f6d98003970 2023-10-16T08:52:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.182+0000 7f6db0a38640 1 -- 172.21.15.94:0/4213644517 reap_dead start 2023-10-16T08:52:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.183+0000 7f6dabfff640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d98003970 0x7f6d98003d70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c003db0 tx=0x7f6d980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159dc68c7c35a1f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.183+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c032600 con 0x7f6d98003970 2023-10-16T08:52:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.183+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c02e050 con 0x7f6d98003970 2023-10-16T08:52:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.183+0000 7f6dab7fe640 1 -- 172.21.15.94:0/4213644517 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0329e0 con 0x7f6d98003970 2023-10-16T08:52:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 -- 172.21.15.94:0/4213644517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d98003970 msgr2=0x7f6d98003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d98003970 0x7f6d98003d70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c003db0 tx=0x7f6d980057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 -- 172.21.15.94:0/4213644517 shutdown_connections 2023-10-16T08:52:31.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 --2- 172.21.15.94:0/4213644517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d98003970 0x7f6d98003d70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 -- 172.21.15.94:0/4213644517 >> 172.21.15.94:0/4213644517 conn(0x7f6dac06a470 msgr2=0x7f6dac0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:31.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 -- 172.21.15.94:0/4213644517 shutdown_connections 2023-10-16T08:52:31.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.184+0000 7f6db1239640 1 -- 172.21.15.94:0/4213644517 wait complete. 2023-10-16T08:52:31.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.186+0000 7f6db1239640 1 Processor -- start 2023-10-16T08:52:31.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.186+0000 7f6db1239640 1 -- start start 2023-10-16T08:52:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db1239640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d98003970 0x7f6dac152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db1239640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6dac0c4690 0x7f6dac0b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db1239640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 0x7f6dac1f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db1239640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0b3070 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db1239640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c4400 con 0x7f6d98003970 2023-10-16T08:52:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db1239640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac1540f0 con 0x7f6dac0c4690 2023-10-16T08:52:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 0x7f6dac1f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 0x7f6dac1f5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44312/0 (socket says 172.21.15.94:44312) 2023-10-16T08:52:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 -- 172.21.15.94:0/1179055132 learned_addr learned my addr 172.21.15.94:0/1179055132 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 -- 172.21.15.94:0/1179055132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6dac0c4690 msgr2=0x7f6dac0b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6dac0c4690 0x7f6dac0b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 -- 172.21.15.94:0/1179055132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d98003970 msgr2=0x7f6dac152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d98003970 0x7f6dac152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.187+0000 7f6db0a38640 1 -- 172.21.15.94:0/1179055132 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac1f2d70 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.188+0000 7f6db0a38640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 0x7f6dac1f5140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0c8d90 tx=0x7f6da400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:31.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.188+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4010040 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.188+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da400bd10 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.188+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4014640 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.188+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac152640 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.188+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0c4120 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.189+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac1f2650 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.190+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6da40147a0 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.191+0000 7f6da97fa640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d8c06ae70 0x7f6d8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.191+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6da408a0f0 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.191+0000 7f6dabfff640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d8c06ae70 0x7f6d8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.192+0000 7f6dabfff640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d8c06ae70 0x7f6d8c06d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c034000 tx=0x7f6d9c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:31.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.195+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dac1f2650 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.381+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dac1f2650 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.382+0000 7f6da97fa640 1 -- 172.21.15.94:0/1179055132 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dac1f2650 con 0x7f6dac0b2bf0 2023-10-16T08:52:31.383 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:31.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d8c06ae70 msgr2=0x7f6d8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d8c06ae70 0x7f6d8c06d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c034000 tx=0x7f6d9c02f000 comp rx=0 tx=0).stop 2023-10-16T08:52:31.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 msgr2=0x7f6dac1f5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 0x7f6dac1f5140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0c8d90 tx=0x7f6da400b480 comp rx=0 tx=0).stop 2023-10-16T08:52:31.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 shutdown_connections 2023-10-16T08:52:31.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6dac0b2bf0 0x7f6dac1f5140 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6dac0c4690 0x7f6dac0b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d8c06ae70 0x7f6d8c06d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 --2- 172.21.15.94:0/1179055132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d98003970 0x7f6dac152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 >> 172.21.15.94:0/1179055132 conn(0x7f6dac06a470 msgr2=0x7f6dac1596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:31.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 shutdown_connections 2023-10-16T08:52:31.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.385+0000 7f6db1239640 1 -- 172.21.15.94:0/1179055132 wait complete. 2023-10-16T08:52:31.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:31.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.626+0000 7f18dd840640 1 Processor -- start 2023-10-16T08:52:31.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.626+0000 7f18dd840640 1 -- start start 2023-10-16T08:52:31.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18dd840640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f18d815c580 0x7f18d80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18dd840640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d80cb180 con 0x7f18d80cdbb0 2023-10-16T08:52:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18dd840640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d80cf440 con 0x7f18d80c9260 2023-10-16T08:52:31.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18dd840640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80cac40 con 0x7f18d815c580 2023-10-16T08:52:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18cffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f18d80cdbb0 0x7f18d80c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46902/0 (socket says 172.21.15.94:46902) 2023-10-16T08:52:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18cffff640 1 -- 172.21.15.94:0/3181655913 learned_addr learned my addr 172.21.15.94:0/3181655913 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:31.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18d6ffd640 1 --2- 172.21.15.94:0/3181655913 >> v2:172.21.15.130:3300/0 conn(0x7f18d815c580 0x7f18d80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104797969 0 0) 0x7f18d80cb180 con 0x7f18d80cdbb0 2023-10-16T08:52:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.628+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c4005730 con 0x7f18d80cdbb0 2023-10-16T08:52:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2847684683 0 0) 0x7f18c4005730 con 0x7f18d80cdbb0 2023-10-16T08:52:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 >> v2:172.21.15.130:3300/0 conn(0x7f18d815c580 msgr2=0x7f18d80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 --2- 172.21.15.94:0/3181655913 >> v2:172.21.15.130:3300/0 conn(0x7f18d815c580 0x7f18d80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 >> v1:172.21.15.130:6789/0 conn(0x7f18d80c9260 legacy=0x7f18d815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80ceec0 con 0x7f18d80cdbb0 2023-10-16T08:52:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f18c0001670 con 0x7f18d80cdbb0 2023-10-16T08:52:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 >> v1:172.21.15.94:6789/0 conn(0x7f18d80cdbb0 legacy=0x7f18d80c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c4005b80 0x7f18c4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18c4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4007390 0x7f18c400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cac40 con 0x7f18c40069d0 2023-10-16T08:52:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400e330 con 0x7f18c4007390 2023-10-16T08:52:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400e4f0 con 0x7f18c4005b80 2023-10-16T08:52:31.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.629+0000 7f18cffff640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18c4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18d6ffd640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c4005b80 0x7f18c4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18cffff640 1 -- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c4005b80 msgr2=0x7f18c4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18cffff640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c4005b80 0x7f18c4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18cffff640 1 -- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4007390 msgr2=0x7f18c400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:31.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18cffff640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c4007390 0x7f18c400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18cffff640 1 -- 172.21.15.94:0/3181655913 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4005730 con 0x7f18c40069d0 2023-10-16T08:52:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18d77fe640 1 -- 172.21.15.94:0/3181655913 reap_dead start 2023-10-16T08:52:31.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.630+0000 7f18d6ffd640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c4005b80 0x7f18c4005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.631+0000 7f18cffff640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18c4006e50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f18c000c240 tx=0x7f18c4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cd3ebeb673ab67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.631+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0005ad0 con 0x7f18c40069d0 2023-10-16T08:52:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.631+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c0005c30 con 0x7f18c40069d0 2023-10-16T08:52:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.631+0000 7f18d67fc640 1 -- 172.21.15.94:0/3181655913 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c002caf0 con 0x7f18c40069d0 2023-10-16T08:52:31.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 -- 172.21.15.94:0/3181655913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 msgr2=0x7f18c4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18c4006e50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f18c000c240 tx=0x7f18c4007a00 comp rx=0 tx=0).stop 2023-10-16T08:52:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 -- 172.21.15.94:0/3181655913 shutdown_connections 2023-10-16T08:52:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 --2- 172.21.15.94:0/3181655913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18c4006e50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 -- 172.21.15.94:0/3181655913 >> 172.21.15.94:0/3181655913 conn(0x7f18d80b0030 msgr2=0x7f18d80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:31.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 -- 172.21.15.94:0/3181655913 shutdown_connections 2023-10-16T08:52:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.632+0000 7f18dd840640 1 -- 172.21.15.94:0/3181655913 wait complete. 2023-10-16T08:52:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.634+0000 7f18dd840640 1 Processor -- start 2023-10-16T08:52:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.634+0000 7f18dd840640 1 -- start start 2023-10-16T08:52:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18dd840640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18d80add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18dd840640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d80c7520 0x7f18d8156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18dd840640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18d80b2770 0x7f18d8155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18dd840640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80ae2a0 con 0x7f18c40069d0 2023-10-16T08:52:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18dd840640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80ae4d0 con 0x7f18d80c7520 2023-10-16T08:52:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18dd840640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80ae7b0 con 0x7f18d80b2770 2023-10-16T08:52:31.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18d80add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18d80add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44332/0 (socket says 172.21.15.94:44332) 2023-10-16T08:52:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 -- 172.21.15.94:0/1980018097 learned_addr learned my addr 172.21.15.94:0/1980018097 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18cffff640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d80c7520 0x7f18d8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 -- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18d80b2770 msgr2=0x7f18d8155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18d80b2770 0x7f18d8155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 -- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d80c7520 msgr2=0x7f18d8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d80c7520 0x7f18d8156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.635+0000 7f18d6ffd640 1 -- 172.21.15.94:0/1980018097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80aea90 con 0x7f18c40069d0 2023-10-16T08:52:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.636+0000 7f18d6ffd640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18d80add60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f18c8010790 tx=0x7f18c8010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:31.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.636+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800e960 con 0x7f18c40069d0 2023-10-16T08:52:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.636+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800eac0 con 0x7f18c40069d0 2023-10-16T08:52:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.636+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800ee30 con 0x7f18c40069d0 2023-10-16T08:52:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.636+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d80aed70 con 0x7f18c40069d0 2023-10-16T08:52:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.636+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81568c0 con 0x7f18c40069d0 2023-10-16T08:52:31.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.637+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8156ed0 con 0x7f18c40069d0 2023-10-16T08:52:31.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.638+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f18c801c400 con 0x7f18c40069d0 2023-10-16T08:52:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.639+0000 7f18d4ff9640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f18b806aea0 0x7f18b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.639+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18c8089f30 con 0x7f18c40069d0 2023-10-16T08:52:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.639+0000 7f18cffff640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f18b806aea0 0x7f18b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.640+0000 7f18cffff640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f18b806aea0 0x7f18b806d360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18c0034000 tx=0x7f18c0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:31.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.643+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18c8054c30 con 0x7f18c40069d0 2023-10-16T08:52:31.832 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.831+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18d8073ef0 con 0x7f18c40069d0 2023-10-16T08:52:31.833 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.832+0000 7f18d4ff9640 1 -- 172.21.15.94:0/1980018097 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18c8058250 con 0x7f18c40069d0 2023-10-16T08:52:31.834 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:31.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f18b806aea0 msgr2=0x7f18b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f18b806aea0 0x7f18b806d360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18c0034000 tx=0x7f18c0009030 comp rx=0 tx=0).stop 2023-10-16T08:52:31.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 msgr2=0x7f18d80add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:31.836 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18d80add60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f18c8010790 tx=0x7f18c8010c50 comp rx=0 tx=0).stop 2023-10-16T08:52:31.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 shutdown_connections 2023-10-16T08:52:31.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18d80b2770 0x7f18d8155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f18b806aea0 0x7f18b806d360 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.837 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18d80c7520 0x7f18d8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 --2- 172.21.15.94:0/1980018097 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18c40069d0 0x7f18d80add60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:31.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 >> 172.21.15.94:0/1980018097 conn(0x7f18d80b0030 msgr2=0x7f18d8157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:31.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 shutdown_connections 2023-10-16T08:52:31.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:31.835+0000 7f18dd840640 1 -- 172.21.15.94:0/1980018097 wait complete. 2023-10-16T08:52:31.856 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:32.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.073+0000 7f4256861640 1 Processor -- start 2023-10-16T08:52:32.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.073+0000 7f4256861640 1 -- start start 2023-10-16T08:52:32.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f4256861640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4250159890 0x7f4250071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f4256861640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca5a0 0x7f425015db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f4256861640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4250072480 con 0x7f42500ca110 2023-10-16T08:52:32.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f4256861640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500cd0c0 con 0x7f4250159890 2023-10-16T08:52:32.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f4256861640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500caa30 con 0x7f42500ca5a0 2023-10-16T08:52:32.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f424ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4250159890 0x7f4250071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f424ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4250159890 0x7f4250071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44334/0 (socket says 172.21.15.94:44334) 2023-10-16T08:52:32.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f424ffff640 1 -- 172.21.15.94:0/1795906098 learned_addr learned my addr 172.21.15.94:0/1795906098 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:32.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f4254dfe640 1 --2- 172.21.15.94:0/1795906098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca5a0 0x7f425015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.075+0000 7f424ffff640 1 -- 172.21.15.94:0/1795906098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca5a0 msgr2=0x7f425015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:32.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.076+0000 7f424ffff640 1 --2- 172.21.15.94:0/1795906098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca5a0 0x7f425015db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.076+0000 7f424ffff640 1 -- 172.21.15.94:0/1795906098 >> v1:172.21.15.130:6789/0 conn(0x7f42500ca110 legacy=0x7f425015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:32.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.076+0000 7f424ffff640 1 -- 172.21.15.94:0/1795906098 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500cc540 con 0x7f4250159890 2023-10-16T08:52:32.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.077+0000 7f424ffff640 1 --2- 172.21.15.94:0/1795906098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f4250071f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f424000bb10 tx=0x7f424002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96feeb3818125b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.077+0000 7f424effd640 1 -- 172.21.15.94:0/1795906098 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424002ee70 con 0x7f4250159890 2023-10-16T08:52:32.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.077+0000 7f424effd640 1 -- 172.21.15.94:0/1795906098 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240036440 con 0x7f4250159890 2023-10-16T08:52:32.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.077+0000 7f424effd640 1 -- 172.21.15.94:0/1795906098 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400367d0 con 0x7f4250159890 2023-10-16T08:52:32.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 -- 172.21.15.94:0/1795906098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 msgr2=0x7f4250071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 --2- 172.21.15.94:0/1795906098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f4250071f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f424000bb10 tx=0x7f424002e0c0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 -- 172.21.15.94:0/1795906098 shutdown_connections 2023-10-16T08:52:32.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 --2- 172.21.15.94:0/1795906098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca5a0 0x7f425015db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 --2- 172.21.15.94:0/1795906098 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f4250071f40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 -- 172.21.15.94:0/1795906098 >> 172.21.15.94:0/1795906098 conn(0x7f42500b0030 msgr2=0x7f42500b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:32.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 -- 172.21.15.94:0/1795906098 shutdown_connections 2023-10-16T08:52:32.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.078+0000 7f4256861640 1 -- 172.21.15.94:0/1795906098 wait complete. 2023-10-16T08:52:32.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.080+0000 7f4256861640 1 Processor -- start 2023-10-16T08:52:32.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.080+0000 7f4256861640 1 -- start start 2023-10-16T08:52:32.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4256861640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca110 0x7f42500c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4256861640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42500ca5a0 0x7f42500c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4256861640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f42501f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4256861640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500c6990 con 0x7f4250159890 2023-10-16T08:52:32.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4256861640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500c6c70 con 0x7f42500ca5a0 2023-10-16T08:52:32.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4256861640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500c6f50 con 0x7f42500ca110 2023-10-16T08:52:32.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4254dfe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f42501f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4254dfe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f42501f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44342/0 (socket says 172.21.15.94:44342) 2023-10-16T08:52:32.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.081+0000 7f4254dfe640 1 -- 172.21.15.94:0/3172338195 learned_addr learned my addr 172.21.15.94:0/3172338195 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:32.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f424ffff640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca110 0x7f42500c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f424f7fe640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42500ca5a0 0x7f42500c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f4254dfe640 1 -- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca110 msgr2=0x7f42500c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f4254dfe640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca110 0x7f42500c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f4254dfe640 1 -- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42500ca5a0 msgr2=0x7f42500c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f4254dfe640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42500ca5a0 0x7f42500c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f4254dfe640 1 -- 172.21.15.94:0/3172338195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424000b770 con 0x7f4250159890 2023-10-16T08:52:32.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f424f7fe640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42500ca5a0 0x7f42500c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:32.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f4254dfe640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f42501f1670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4248007e60 tx=0x7f424800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248014420 con 0x7f4250159890 2023-10-16T08:52:32.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42480145a0 con 0x7f4250159890 2023-10-16T08:52:32.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.082+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248014950 con 0x7f4250159890 2023-10-16T08:52:32.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.083+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42500c7230 con 0x7f4250159890 2023-10-16T08:52:32.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.083+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42500c7f70 con 0x7f4250159890 2023-10-16T08:52:32.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.084+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4250073ef0 con 0x7f4250159890 2023-10-16T08:52:32.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.085+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4248014ab0 con 0x7f4250159890 2023-10-16T08:52:32.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.085+0000 7f424cff9640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f423c06ae70 0x7f423c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.086+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f424808a330 con 0x7f4250159890 2023-10-16T08:52:32.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.086+0000 7f424ffff640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f423c06ae70 0x7f423c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.087+0000 7f424ffff640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f423c06ae70 0x7f423c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4240038000 tx=0x7f4240032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.090+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4248055010 con 0x7f4250159890 2023-10-16T08:52:32.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:52:32.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:52:32.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.280+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f425006cfc0 con 0x7f4250159890 2023-10-16T08:52:32.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.281+0000 7f424cff9640 1 -- 172.21.15.94:0/3172338195 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4248058630 con 0x7f4250159890 2023-10-16T08:52:32.282 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:32.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f423c06ae70 msgr2=0x7f423c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f423c06ae70 0x7f423c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4240038000 tx=0x7f4240032000 comp rx=0 tx=0).stop 2023-10-16T08:52:32.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 msgr2=0x7f42501f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f42501f1670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4248007e60 tx=0x7f424800e4b0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 shutdown_connections 2023-10-16T08:52:32.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4250159890 0x7f42501f1670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f423c06ae70 0x7f423c06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42500ca5a0 0x7f42500c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 --2- 172.21.15.94:0/3172338195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42500ca110 0x7f42500c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 >> 172.21.15.94:0/3172338195 conn(0x7f42500b0030 msgr2=0x7f42500cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:32.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 shutdown_connections 2023-10-16T08:52:32.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.284+0000 7f4256861640 1 -- 172.21.15.94:0/3172338195 wait complete. 2023-10-16T08:52:32.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:32.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.513+0000 7fec14b25640 1 Processor -- start 2023-10-16T08:52:32.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.513+0000 7fec14b25640 1 -- start start 2023-10-16T08:52:32.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec14b25640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cbf0 0x7fec100caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec14b25640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec101611f0 0x7fec100cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec14b25640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec10160730 con 0x7fec1015cfd0 2023-10-16T08:52:32.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec14b25640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100cb720 con 0x7fec101611f0 2023-10-16T08:52:32.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec14b25640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1015db70 con 0x7fec1015cbf0 2023-10-16T08:52:32.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec07fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec101611f0 0x7fec100cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec07fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fec101611f0 0x7fec100cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44352/0 (socket says 172.21.15.94:44352) 2023-10-16T08:52:32.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec07fff640 1 -- 172.21.15.94:0/3430002338 learned_addr learned my addr 172.21.15.94:0/3430002338 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:32.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.515+0000 7fec0e59c640 1 --2- 172.21.15.94:0/3430002338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cbf0 0x7fec100caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.516+0000 7fec07fff640 1 -- 172.21.15.94:0/3430002338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cbf0 msgr2=0x7fec100caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:32.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.516+0000 7fec07fff640 1 --2- 172.21.15.94:0/3430002338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cbf0 0x7fec100caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.516+0000 7fec07fff640 1 -- 172.21.15.94:0/3430002338 >> v1:172.21.15.130:6789/0 conn(0x7fec1015cfd0 legacy=0x7fec1015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:32.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.516+0000 7fec07fff640 1 -- 172.21.15.94:0/3430002338 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1015dd60 con 0x7fec101611f0 2023-10-16T08:52:32.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.517+0000 7fec07fff640 1 --2- 172.21.15.94:0/3430002338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec100cb1e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e476e546e497a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.517+0000 7fec0dd9b640 1 -- 172.21.15.94:0/3430002338 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80317c0 con 0x7fec101611f0 2023-10-16T08:52:32.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.517+0000 7fec0dd9b640 1 -- 172.21.15.94:0/3430002338 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf8031920 con 0x7fec101611f0 2023-10-16T08:52:32.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.517+0000 7fec0dd9b640 1 -- 172.21.15.94:0/3430002338 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8031cb0 con 0x7fec101611f0 2023-10-16T08:52:32.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 -- 172.21.15.94:0/3430002338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 msgr2=0x7fec100cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 --2- 172.21.15.94:0/3430002338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec100cb1e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf802b860 comp rx=0 tx=0).stop 2023-10-16T08:52:32.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 -- 172.21.15.94:0/3430002338 shutdown_connections 2023-10-16T08:52:32.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 --2- 172.21.15.94:0/3430002338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec100cb1e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 --2- 172.21.15.94:0/3430002338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cbf0 0x7fec100caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 -- 172.21.15.94:0/3430002338 >> 172.21.15.94:0/3430002338 conn(0x7fec100b0030 msgr2=0x7fec100b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:32.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 -- 172.21.15.94:0/3430002338 shutdown_connections 2023-10-16T08:52:32.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.518+0000 7fec14b25640 1 -- 172.21.15.94:0/3430002338 wait complete. 2023-10-16T08:52:32.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.520+0000 7fec14b25640 1 Processor -- start 2023-10-16T08:52:32.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.520+0000 7fec14b25640 1 -- start start 2023-10-16T08:52:32.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec14b25640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec1015cbf0 0x7fec10159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec14b25640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cfd0 0x7fec1015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec14b25640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec10071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec14b25640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1015bfd0 con 0x7fec101611f0 2023-10-16T08:52:32.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec14b25640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101494b0 con 0x7fec1015cbf0 2023-10-16T08:52:32.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec14b25640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100c3a90 con 0x7fec1015cfd0 2023-10-16T08:52:32.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec0ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec10071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec0ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec10071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44360/0 (socket says 172.21.15.94:44360) 2023-10-16T08:52:32.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.521+0000 7fec0ed9d640 1 -- 172.21.15.94:0/955565825 learned_addr learned my addr 172.21.15.94:0/955565825 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:32.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec07fff640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cfd0 0x7fec1015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0e59c640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec1015cbf0 0x7fec10159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0ed9d640 1 -- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cfd0 msgr2=0x7fec1015b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0ed9d640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cfd0 0x7fec1015b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0ed9d640 1 -- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec1015cbf0 msgr2=0x7fec10159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0ed9d640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec1015cbf0 0x7fec10159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0ed9d640 1 -- 172.21.15.94:0/955565825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80094d0 con 0x7fec101611f0 2023-10-16T08:52:32.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec07fff640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cfd0 0x7fec1015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:32.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0e59c640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec1015cbf0 0x7fec10159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:32.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec0ed9d640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec10071300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c7b0 tx=0x7fec0800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08004b60 con 0x7fec101611f0 2023-10-16T08:52:32.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08004cc0 con 0x7fec101611f0 2023-10-16T08:52:32.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800aa90 con 0x7fec101611f0 2023-10-16T08:52:32.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec10159e40 con 0x7fec101611f0 2023-10-16T08:52:32.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.522+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec100c3440 con 0x7fec101611f0 2023-10-16T08:52:32.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.523+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec100c32a0 con 0x7fec101611f0 2023-10-16T08:52:32.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.524+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fec0800abf0 con 0x7fec101611f0 2023-10-16T08:52:32.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.525+0000 7fec06ffd640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7febf006ae70 0x7febf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.525+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec08089bb0 con 0x7fec101611f0 2023-10-16T08:52:32.534 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.526+0000 7fec0e59c640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7febf006ae70 0x7febf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.534 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.526+0000 7fec0e59c640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7febf006ae70 0x7febf006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec00006fd0 tx=0x7fec00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.534 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.530+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec100c32a0 con 0x7fec101611f0 2023-10-16T08:52:32.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.718+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec100c32a0 con 0x7fec101611f0 2023-10-16T08:52:32.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.719+0000 7fec06ffd640 1 -- 172.21.15.94:0/955565825 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec100c32a0 con 0x7fec101611f0 2023-10-16T08:52:32.720 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7febf006ae70 msgr2=0x7febf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7febf006ae70 0x7febf006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec00006fd0 tx=0x7fec00008040 comp rx=0 tx=0).stop 2023-10-16T08:52:32.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 msgr2=0x7fec10071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec10071300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec0800c7b0 tx=0x7fec0800cc70 comp rx=0 tx=0).stop 2023-10-16T08:52:32.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 shutdown_connections 2023-10-16T08:52:32.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec101611f0 0x7fec10071300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec1015cfd0 0x7fec1015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7febf006ae70 0x7febf006d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 --2- 172.21.15.94:0/955565825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec1015cbf0 0x7fec10159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 >> 172.21.15.94:0/955565825 conn(0x7fec100b0030 msgr2=0x7fec1015ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 shutdown_connections 2023-10-16T08:52:32.725 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.722+0000 7fec14b25640 1 -- 172.21.15.94:0/955565825 wait complete. 2023-10-16T08:52:32.743 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:32.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.951+0000 7fef8b70f640 1 Processor -- start 2023-10-16T08:52:32.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.951+0000 7fef8b70f640 1 -- start start 2023-10-16T08:52:32.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.952+0000 7fef8b70f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fef8415cc20 0x7fef840c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.952+0000 7fef8b70f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef84161310 0x7fef840ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef8b70f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef840b01b0 0x7fef840b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef8b70f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840b0b80 con 0x7fef840b01b0 2023-10-16T08:52:32.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef8b70f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840c9c70 con 0x7fef8415cc20 2023-10-16T08:52:32.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef8b70f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840cca90 con 0x7fef84161310 2023-10-16T08:52:32.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef89cac640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef840b01b0 0x7fef840b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef89cac640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef840b01b0 0x7fef840b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44376/0 (socket says 172.21.15.94:44376) 2023-10-16T08:52:32.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef89cac640 1 -- 172.21.15.94:0/371834952 learned_addr learned my addr 172.21.15.94:0/371834952 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:32.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef894ab640 1 --2- 172.21.15.94:0/371834952 >> v2:172.21.15.130:3300/0 conn(0x7fef8415cc20 0x7fef840c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.953+0000 7fef88caa640 1 --2- 172.21.15.94:0/371834952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef84161310 0x7fef840ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.954+0000 7fef89cac640 1 -- 172.21.15.94:0/371834952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef84161310 msgr2=0x7fef840ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:32.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.954+0000 7fef89cac640 1 --2- 172.21.15.94:0/371834952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef84161310 0x7fef840ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.954+0000 7fef89cac640 1 -- 172.21.15.94:0/371834952 >> v2:172.21.15.130:3300/0 conn(0x7fef8415cc20 msgr2=0x7fef840c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:32.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.954+0000 7fef89cac640 1 --2- 172.21.15.94:0/371834952 >> v2:172.21.15.130:3300/0 conn(0x7fef8415cc20 0x7fef840c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.954+0000 7fef89cac640 1 -- 172.21.15.94:0/371834952 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8415d000 con 0x7fef840b01b0 2023-10-16T08:52:32.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.955+0000 7fef89cac640 1 --2- 172.21.15.94:0/371834952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef840b01b0 0x7fef840b0640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fef84071770 tx=0x7fef7c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfe796623af4e05 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.960 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.955+0000 7fef7bfff640 1 -- 172.21.15.94:0/371834952 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c02ca80 con 0x7fef840b01b0 2023-10-16T08:52:32.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.955+0000 7fef7bfff640 1 -- 172.21.15.94:0/371834952 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c02cbe0 con 0x7fef840b01b0 2023-10-16T08:52:32.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.955+0000 7fef7bfff640 1 -- 172.21.15.94:0/371834952 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0343f0 con 0x7fef840b01b0 2023-10-16T08:52:32.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.955+0000 7fef8b70f640 1 -- 172.21.15.94:0/371834952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef840b01b0 msgr2=0x7fef840b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.955+0000 7fef8b70f640 1 --2- 172.21.15.94:0/371834952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef840b01b0 0x7fef840b0640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fef84071770 tx=0x7fef7c02bee0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 -- 172.21.15.94:0/371834952 shutdown_connections 2023-10-16T08:52:32.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 --2- 172.21.15.94:0/371834952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef840b01b0 0x7fef840b0640 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 --2- 172.21.15.94:0/371834952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef84161310 0x7fef840ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 --2- 172.21.15.94:0/371834952 >> v2:172.21.15.130:3300/0 conn(0x7fef8415cc20 0x7fef840c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 -- 172.21.15.94:0/371834952 >> 172.21.15.94:0/371834952 conn(0x7fef840cb1b0 msgr2=0x7fef840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:32.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 -- 172.21.15.94:0/371834952 shutdown_connections 2023-10-16T08:52:32.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.956+0000 7fef8b70f640 1 -- 172.21.15.94:0/371834952 wait complete. 2023-10-16T08:52:32.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.957+0000 7fef8b70f640 1 Processor -- start 2023-10-16T08:52:32.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.957+0000 7fef8b70f640 1 -- start start 2023-10-16T08:52:32.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.958+0000 7fef8b70f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef840b01b0 0x7fef8415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.958+0000 7fef8b70f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef8415cc20 0x7fef84156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.958+0000 7fef8b70f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 0x7fef841f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.958+0000 7fef8b70f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef841f2930 con 0x7fef84161310 2023-10-16T08:52:32.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.958+0000 7fef8b70f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef841f33b0 con 0x7fef840b01b0 2023-10-16T08:52:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.958+0000 7fef8b70f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840afe20 con 0x7fef8415cc20 2023-10-16T08:52:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 0x7fef841f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 0x7fef841f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44392/0 (socket says 172.21.15.94:44392) 2023-10-16T08:52:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 -- 172.21.15.94:0/2048118283 learned_addr learned my addr 172.21.15.94:0/2048118283 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 -- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef8415cc20 msgr2=0x7fef84156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef8415cc20 0x7fef84156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 -- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef840b01b0 msgr2=0x7fef8415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:32.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef894ab640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef840b01b0 0x7fef8415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef840b01b0 0x7fef8415fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:32.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 -- 172.21.15.94:0/2048118283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c009b30 con 0x7fef84161310 2023-10-16T08:52:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.959+0000 7fef89cac640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 0x7fef841f23f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef7c036040 tx=0x7fef7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.960+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c009510 con 0x7fef84161310 2023-10-16T08:52:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.960+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c03e450 con 0x7fef84161310 2023-10-16T08:52:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.960+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c03e7e0 con 0x7fef84161310 2023-10-16T08:52:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.960+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef841f2b10 con 0x7fef84161310 2023-10-16T08:52:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.960+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef841f30d0 con 0x7fef84161310 2023-10-16T08:52:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.961+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef840b4480 con 0x7fef84161310 2023-10-16T08:52:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.962+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fef7c02cd50 con 0x7fef84161310 2023-10-16T08:52:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.963+0000 7fef79ffb640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fef6806ae70 0x7fef6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.963+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef7c0ac4c0 con 0x7fef84161310 2023-10-16T08:52:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.963+0000 7fef894ab640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fef6806ae70 0x7fef6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:32.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.964+0000 7fef894ab640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fef6806ae70 0x7fef6806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef80006fd0 tx=0x7fef80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:32.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:32.967+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef7c077360 con 0x7fef84161310 2023-10-16T08:52:33.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.167+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef84073ef0 con 0x7fef84161310 2023-10-16T08:52:33.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.168+0000 7fef79ffb640 1 -- 172.21.15.94:0/2048118283 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef7c07a980 con 0x7fef84161310 2023-10-16T08:52:33.170 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:33.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fef6806ae70 msgr2=0x7fef6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fef6806ae70 0x7fef6806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef80006fd0 tx=0x7fef80008040 comp rx=0 tx=0).stop 2023-10-16T08:52:33.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 msgr2=0x7fef841f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 0x7fef841f23f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef7c036040 tx=0x7fef7c004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:33.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 shutdown_connections 2023-10-16T08:52:33.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef84161310 0x7fef841f23f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef8415cc20 0x7fef84156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fef6806ae70 0x7fef6806d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 --2- 172.21.15.94:0/2048118283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef840b01b0 0x7fef8415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 >> 172.21.15.94:0/2048118283 conn(0x7fef840cb1b0 msgr2=0x7fef8415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:33.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 shutdown_connections 2023-10-16T08:52:33.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.171+0000 7fef8b70f640 1 -- 172.21.15.94:0/2048118283 wait complete. 2023-10-16T08:52:33.191 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2023-10-16T08:52:33.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:33.192 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-16T08:52:33.288 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:52:33.288 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:52:33.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:33.289 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T08:52:33.338 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:52:33.339 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:33.401 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:52:33.402 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:33.456 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:33.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.673+0000 7f3a77f1d640 1 Processor -- start 2023-10-16T08:52:33.674 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.673+0000 7f3a77f1d640 1 -- start start 2023-10-16T08:52:33.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.674+0000 7f3a77f1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a700c9e00 0x7f3a700c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a77f1d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 0x7f3a700cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a77f1d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a70071c10 con 0x7f3a700ca1e0 2023-10-16T08:52:33.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a77f1d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a700cde00 con 0x7f3a700c9e00 2023-10-16T08:52:33.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a77f1d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70071e40 con 0x7f3a70071800 2023-10-16T08:52:33.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a754b8640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3a700ca1e0 0x7f3a700710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46914/0 (socket says 172.21.15.94:46914) 2023-10-16T08:52:33.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a754b8640 1 -- 172.21.15.94:0/3162883307 learned_addr learned my addr 172.21.15.94:0/3162883307 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:33.678 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106240219 0 0) 0x7f3a70071c10 con 0x7f3a700ca1e0 2023-10-16T08:52:33.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c003520 con 0x7f3a700ca1e0 2023-10-16T08:52:33.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/3162883307 >> v2:172.21.15.130:3300/0 conn(0x7f3a700c9e00 0x7f3a700c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.675+0000 7f3a764ba640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 0x7f3a700cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879055345 0 0) 0x7f3a5c003520 con 0x7f3a700ca1e0 2023-10-16T08:52:33.679 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 msgr2=0x7f3a700cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:33.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 0x7f3a700cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 >> v2:172.21.15.130:3300/0 conn(0x7f3a700c9e00 msgr2=0x7f3a700c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:33.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 --2- 172.21.15.94:0/3162883307 >> v2:172.21.15.130:3300/0 conn(0x7f3a700c9e00 0x7f3a700c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a70072120 con 0x7f3a700ca1e0 2023-10-16T08:52:33.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f3a64001670 con 0x7f3a700ca1e0 2023-10-16T08:52:33.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 >> v1:172.21.15.94:6789/0 conn(0x7f3a700ca1e0 legacy=0x7f3a700710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a5c0039e0 0x7f3a5c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 0x7f3a5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c004d00 0x7f3a5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700cde00 con 0x7f3a5c0039e0 2023-10-16T08:52:33.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70071e40 con 0x7f3a5c004d00 2023-10-16T08:52:33.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00dd20 con 0x7f3a70071800 2023-10-16T08:52:33.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.676+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a5c0039e0 0x7f3a5c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.677+0000 7f3a75cb9640 1 -- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 msgr2=0x7f3a5c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:33.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.677+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a70071800 0x7f3a5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.677+0000 7f3a75cb9640 1 -- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c004d00 msgr2=0x7f3a5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:33.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.677+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c004d00 0x7f3a5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.677+0000 7f3a75cb9640 1 -- 172.21.15.94:0/3162883307 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c003520 con 0x7f3a5c0039e0 2023-10-16T08:52:33.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a5c0039e0 0x7f3a5c003e00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ba30 tx=0x7f3a5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57a2c909a222e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:33.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c033660 con 0x7f3a5c0039e0 2023-10-16T08:52:33.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0337c0 con 0x7f3a5c0039e0 2023-10-16T08:52:33.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a74cb7640 1 -- 172.21.15.94:0/3162883307 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c033b50 con 0x7f3a5c0039e0 2023-10-16T08:52:33.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a77f1d640 1 -- 172.21.15.94:0/3162883307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a5c0039e0 msgr2=0x7f3a5c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/3162883307 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a5c0039e0 0x7f3a5c003e00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ba30 tx=0x7f3a5c0057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.678+0000 7f3a764ba640 1 -- 172.21.15.94:0/3162883307 reap_dead start 2023-10-16T08:52:33.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.679+0000 7f3a77f1d640 1 -- 172.21.15.94:0/3162883307 shutdown_connections 2023-10-16T08:52:33.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.679+0000 7f3a77f1d640 1 -- 172.21.15.94:0/3162883307 >> 172.21.15.94:0/3162883307 conn(0x7f3a7006c1c0 msgr2=0x7f3a7006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:33.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.679+0000 7f3a77f1d640 1 -- 172.21.15.94:0/3162883307 shutdown_connections 2023-10-16T08:52:33.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.679+0000 7f3a77f1d640 1 -- 172.21.15.94:0/3162883307 wait complete. 2023-10-16T08:52:33.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.680+0000 7f3a77f1d640 1 Processor -- start 2023-10-16T08:52:33.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.680+0000 7f3a77f1d640 1 -- start start 2023-10-16T08:52:33.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.681+0000 7f3a77f1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c0039e0 0x7f3a701557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.681+0000 7f3a77f1d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a701411d0 0x7f3a70141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.681+0000 7f3a77f1d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 0x7f3a7013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.681+0000 7f3a77f1d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700acd40 con 0x7f3a70141b90 2023-10-16T08:52:33.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.681+0000 7f3a77f1d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700ad1d0 con 0x7f3a5c0039e0 2023-10-16T08:52:33.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.681+0000 7f3a77f1d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70142010 con 0x7f3a701411d0 2023-10-16T08:52:33.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 0x7f3a7013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 0x7f3a7013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44402/0 (socket says 172.21.15.94:44402) 2023-10-16T08:52:33.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 -- 172.21.15.94:0/2542112397 learned_addr learned my addr 172.21.15.94:0/2542112397 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:33.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c0039e0 0x7f3a701557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a754b8640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a701411d0 0x7f3a70141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 -- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a701411d0 msgr2=0x7f3a70141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a701411d0 0x7f3a70141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 -- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c0039e0 msgr2=0x7f3a701557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c0039e0 0x7f3a701557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.682+0000 7f3a764ba640 1 -- 172.21.15.94:0/2542112397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700ac410 con 0x7f3a70141b90 2023-10-16T08:52:33.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.683+0000 7f3a764ba640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 0x7f3a7013f620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3a700c55f0 tx=0x7f3a6800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:33.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.683+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800ed90 con 0x7f3a70141b90 2023-10-16T08:52:33.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.683+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68014420 con 0x7f3a70141b90 2023-10-16T08:52:33.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.683+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680147d0 con 0x7f3a70141b90 2023-10-16T08:52:33.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.683+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a700ac6f0 con 0x7f3a70141b90 2023-10-16T08:52:33.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.683+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7013fb60 con 0x7f3a70141b90 2023-10-16T08:52:33.693 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.684+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a70073ef0 con 0x7f3a70141b90 2023-10-16T08:52:33.694 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.685+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a68014930 con 0x7f3a70141b90 2023-10-16T08:52:33.694 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.686+0000 7f3a627fc640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3a5406ae70 0x7f3a5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:33.694 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.686+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a68089f00 con 0x7f3a70141b90 2023-10-16T08:52:33.694 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.686+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3a5406ae70 0x7f3a5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:33.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.687+0000 7f3a75cb9640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3a5406ae70 0x7f3a5406d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ba00 tx=0x7f3a6c03e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:33.695 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.690+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a68054ca0 con 0x7f3a70141b90 2023-10-16T08:52:33.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.882+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a7006b140 con 0x7f3a70141b90 2023-10-16T08:52:33.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.883+0000 7f3a627fc640 1 -- 172.21.15.94:0/2542112397 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f3a680582c0 con 0x7f3a70141b90 2023-10-16T08:52:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:33.885 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:33.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3a5406ae70 msgr2=0x7f3a5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3a5406ae70 0x7f3a5406d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00ba00 tx=0x7f3a6c03e040 comp rx=0 tx=0).stop 2023-10-16T08:52:33.887 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 msgr2=0x7f3a7013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:33.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 0x7f3a7013f620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3a700c55f0 tx=0x7f3a6800e4b0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 shutdown_connections 2023-10-16T08:52:33.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3a70141b90 0x7f3a7013f620 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a701411d0 0x7f3a70141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3a5406ae70 0x7f3a5406d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 --2- 172.21.15.94:0/2542112397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a5c0039e0 0x7f3a701557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:33.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 >> 172.21.15.94:0/2542112397 conn(0x7f3a7006c1c0 msgr2=0x7f3a700adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:33.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 shutdown_connections 2023-10-16T08:52:33.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:33.886+0000 7f3a77f1d640 1 -- 172.21.15.94:0/2542112397 wait complete. 2023-10-16T08:52:33.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:33.908 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:34.125 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.124+0000 7f9f24890640 1 Processor -- start 2023-10-16T08:52:34.126 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.124+0000 7f9f24890640 1 -- start start 2023-10-16T08:52:34.128 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f24890640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9f20071f40 0x7f9f200c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.128 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f24890640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200cd0c0 con 0x7f9f200ca820 2023-10-16T08:52:34.128 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f24890640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200cc540 con 0x7f9f20159890 2023-10-16T08:52:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f24890640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200cc820 con 0x7f9f20071f40 2023-10-16T08:52:34.129 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f15d9b640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9f200ca820 0x7f9f200c8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46920/0 (socket says 172.21.15.94:46920) 2023-10-16T08:52:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f15d9b640 1 -- 172.21.15.94:0/897715860 learned_addr learned my addr 172.21.15.94:0/897715860 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f1ed9d640 1 --2- 172.21.15.94:0/897715860 >> v2:172.21.15.94:3300/0 conn(0x7f9f20071f40 0x7f9f200c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f1dd9b640 1 -- 172.21.15.94:0/897715860 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578092012 0 0) 0x7f9f200cd0c0 con 0x7f9f200ca820 2023-10-16T08:52:34.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f1dd9b640 1 -- 172.21.15.94:0/897715860 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f0c003520 con 0x7f9f200ca820 2023-10-16T08:52:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f1ed9d640 1 -- 172.21.15.94:0/897715860 >> v1:172.21.15.130:6789/0 conn(0x7f9f20159890 legacy=0x7f9f200ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f1ed9d640 1 -- 172.21.15.94:0/897715860 >> v1:172.21.15.94:6789/0 conn(0x7f9f200ca820 legacy=0x7f9f200c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.126+0000 7f9f1ed9d640 1 -- 172.21.15.94:0/897715860 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200ccb00 con 0x7f9f20071f40 2023-10-16T08:52:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f1ed9d640 1 --2- 172.21.15.94:0/897715860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c95b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009d90 tx=0x7f9f1802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291b9929015aee51 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:34.134 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f1dd9b640 1 -- 172.21.15.94:0/897715860 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1802cc60 con 0x7f9f20071f40 2023-10-16T08:52:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f1dd9b640 1 -- 172.21.15.94:0/897715860 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1802cdc0 con 0x7f9f20071f40 2023-10-16T08:52:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f1dd9b640 1 -- 172.21.15.94:0/897715860 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18034660 con 0x7f9f20071f40 2023-10-16T08:52:34.135 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f24890640 1 -- 172.21.15.94:0/897715860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 msgr2=0x7f9f200c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f24890640 1 --2- 172.21.15.94:0/897715860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c95b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009d90 tx=0x7f9f1802beb0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f24890640 1 -- 172.21.15.94:0/897715860 shutdown_connections 2023-10-16T08:52:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f24890640 1 --2- 172.21.15.94:0/897715860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c95b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.128+0000 7f9f24890640 1 -- 172.21.15.94:0/897715860 >> 172.21.15.94:0/897715860 conn(0x7f9f200b0030 msgr2=0x7f9f200b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.129+0000 7f9f24890640 1 -- 172.21.15.94:0/897715860 shutdown_connections 2023-10-16T08:52:34.136 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.129+0000 7f9f24890640 1 -- 172.21.15.94:0/897715860 wait complete. 2023-10-16T08:52:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.130+0000 7f9f24890640 1 Processor -- start 2023-10-16T08:52:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.130+0000 7f9f24890640 1 -- start start 2023-10-16T08:52:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.131+0000 7f9f24890640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.131+0000 7f9f24890640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f200ca820 0x7f9f200af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.137 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.131+0000 7f9f24890640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20159890 0x7f9f200abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.131+0000 7f9f24890640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f201f3360 con 0x7f9f20071f40 2023-10-16T08:52:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.131+0000 7f9f24890640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f201f26e0 con 0x7f9f20159890 2023-10-16T08:52:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.131+0000 7f9f24890640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f201f29c0 con 0x7f9f200ca820 2023-10-16T08:52:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.138 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:44428/0 (socket says 172.21.15.94:44428) 2023-10-16T08:52:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 -- 172.21.15.94:0/2268637882 learned_addr learned my addr 172.21.15.94:0/2268637882 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 -- 172.21.15.94:0/2268637882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f200ca820 msgr2=0x7f9f200af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f200ca820 0x7f9f200af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 -- 172.21.15.94:0/2268637882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20159890 msgr2=0x7f9f200abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.139 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20159890 0x7f9f200abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 -- 172.21.15.94:0/2268637882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009a70 con 0x7f9f20071f40 2023-10-16T08:52:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.132+0000 7f9f1e59c640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c6cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b3f0 tx=0x7f9f1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.133+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10011830 con 0x7f9f20071f40 2023-10-16T08:52:34.140 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.133+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10011990 con 0x7f9f20071f40 2023-10-16T08:52:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.133+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10011d40 con 0x7f9f20071f40 2023-10-16T08:52:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.133+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f201f2ca0 con 0x7f9f20071f40 2023-10-16T08:52:34.141 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.133+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f201f23e0 con 0x7f9f20071f40 2023-10-16T08:52:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.134+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f20073ef0 con 0x7f9f20071f40 2023-10-16T08:52:34.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.135+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9f1001a400 con 0x7f9f20071f40 2023-10-16T08:52:34.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.136+0000 7f9f177fe640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9f0006ae70 0x7f9f0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.144 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.136+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f10089880 con 0x7f9f20071f40 2023-10-16T08:52:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.136+0000 7f9f15d9b640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9f0006ae70 0x7f9f0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.137+0000 7f9f15d9b640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9f0006ae70 0x7f9f0006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9f200ad3a0 tx=0x7f9f08007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:34.145 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.140+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f10054570 con 0x7f9f20071f40 2023-10-16T08:52:34.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.332+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f200cd290 con 0x7f9f20071f40 2023-10-16T08:52:34.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.333+0000 7f9f177fe640 1 -- 172.21.15.94:0/2268637882 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f10057b90 con 0x7f9f20071f40 2023-10-16T08:52:34.334 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:34.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9f0006ae70 msgr2=0x7f9f0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9f0006ae70 0x7f9f0006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9f200ad3a0 tx=0x7f9f08007930 comp rx=0 tx=0).stop 2023-10-16T08:52:34.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 msgr2=0x7f9f200c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c6cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b3f0 tx=0x7f9f1000b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 shutdown_connections 2023-10-16T08:52:34.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f9f0006ae70 0x7f9f0006d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f20159890 0x7f9f200abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f200ca820 0x7f9f200af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 --2- 172.21.15.94:0/2268637882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9f20071f40 0x7f9f200c6cd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 >> 172.21.15.94:0/2268637882 conn(0x7f9f200b0030 msgr2=0x7f9f200cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:34.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 shutdown_connections 2023-10-16T08:52:34.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.336+0000 7f9f24890640 1 -- 172.21.15.94:0/2268637882 wait complete. 2023-10-16T08:52:34.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.566+0000 7ffb60202640 1 Processor -- start 2023-10-16T08:52:34.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.566+0000 7ffb60202640 1 -- start start 2023-10-16T08:52:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb60202640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb58159890 0x7ffb58071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb60202640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 0x7ffb5815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb60202640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb58072480 con 0x7ffb580ca110 2023-10-16T08:52:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb60202640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb580cd0c0 con 0x7ffb58159890 2023-10-16T08:52:34.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb60202640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580caa30 con 0x7ffb580ca5a0 2023-10-16T08:52:34.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb5d79d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ffb580ca110 0x7ffb5815d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56414/0 (socket says 172.21.15.94:56414) 2023-10-16T08:52:34.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb5d79d640 1 -- 172.21.15.94:0/3822271241 learned_addr learned my addr 172.21.15.94:0/3822271241 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.568+0000 7ffb5e79f640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 0x7ffb5815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5df9e640 1 --2- 172.21.15.94:0/3822271241 >> v2:172.21.15.130:3300/0 conn(0x7ffb58159890 0x7ffb58071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581402735 0 0) 0x7ffb58072480 con 0x7ffb580ca110 2023-10-16T08:52:34.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb44003520 con 0x7ffb580ca110 2023-10-16T08:52:34.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883797372 0 0) 0x7ffb44003520 con 0x7ffb580ca110 2023-10-16T08:52:34.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 msgr2=0x7ffb5815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:34.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 0x7ffb5815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 >> v2:172.21.15.130:3300/0 conn(0x7ffb58159890 msgr2=0x7ffb58071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 --2- 172.21.15.94:0/3822271241 >> v2:172.21.15.130:3300/0 conn(0x7ffb58159890 0x7ffb58071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580cc540 con 0x7ffb580ca110 2023-10-16T08:52:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7ffb48001670 con 0x7ffb580ca110 2023-10-16T08:52:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 >> v1:172.21.15.94:6789/0 conn(0x7ffb580ca110 legacy=0x7ffb5815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 0x7ffb44003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb44004d00 0x7ffb44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580cd0c0 con 0x7ffb44003f40 2023-10-16T08:52:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580caa30 con 0x7ffb44004d00 2023-10-16T08:52:34.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.569+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4400b980 con 0x7ffb580ca5a0 2023-10-16T08:52:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5df9e640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 0x7ffb44003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5e79f640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb44004d00 0x7ffb44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5d79d640 1 -- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 msgr2=0x7ffb44003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:34.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580ca5a0 0x7ffb44003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5d79d640 1 -- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb44004d00 msgr2=0x7ffb44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb44004d00 0x7ffb44005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.570+0000 7ffb5d79d640 1 -- 172.21.15.94:0/3822271241 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44003520 con 0x7ffb44003f40 2023-10-16T08:52:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.571+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb440047c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c190 tx=0x7ffb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c18fe6409a0951 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.571+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48005ad0 con 0x7ffb44003f40 2023-10-16T08:52:34.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.571+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48005c30 con 0x7ffb44003f40 2023-10-16T08:52:34.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.571+0000 7ffb5cf9c640 1 -- 172.21.15.94:0/3822271241 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4802c810 con 0x7ffb44003f40 2023-10-16T08:52:34.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb60202640 1 -- 172.21.15.94:0/3822271241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 msgr2=0x7ffb440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb60202640 1 --2- 172.21.15.94:0/3822271241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb440047c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c190 tx=0x7ffb440057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb5e79f640 1 -- 172.21.15.94:0/3822271241 reap_dead start 2023-10-16T08:52:34.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb60202640 1 -- 172.21.15.94:0/3822271241 shutdown_connections 2023-10-16T08:52:34.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb60202640 1 -- 172.21.15.94:0/3822271241 >> 172.21.15.94:0/3822271241 conn(0x7ffb580b0030 msgr2=0x7ffb580b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:34.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb60202640 1 -- 172.21.15.94:0/3822271241 shutdown_connections 2023-10-16T08:52:34.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.572+0000 7ffb60202640 1 -- 172.21.15.94:0/3822271241 wait complete. 2023-10-16T08:52:34.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.574+0000 7ffb60202640 1 Processor -- start 2023-10-16T08:52:34.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.574+0000 7ffb60202640 1 -- start start 2023-10-16T08:52:34.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb60202640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb580c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb60202640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb58158b50 0x7ffb580cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb60202640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580b0fd0 0x7ffb580b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb60202640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5814cea0 con 0x7ffb44003f40 2023-10-16T08:52:34.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb60202640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580c5bb0 con 0x7ffb58158b50 2023-10-16T08:52:34.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb60202640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580c5e90 con 0x7ffb580b0fd0 2023-10-16T08:52:34.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb5df9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb580c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb5df9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb580c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39756/0 (socket says 172.21.15.94:39756) 2023-10-16T08:52:34.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.575+0000 7ffb5df9e640 1 -- 172.21.15.94:0/1037082878 learned_addr learned my addr 172.21.15.94:0/1037082878 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:34.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5e79f640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580b0fd0 0x7ffb580b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb58158b50 0x7ffb580cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5df9e640 1 -- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580b0fd0 msgr2=0x7ffb580b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5df9e640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580b0fd0 0x7ffb580b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5df9e640 1 -- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb58158b50 msgr2=0x7ffb580cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5df9e640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb58158b50 0x7ffb580cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5df9e640 1 -- 172.21.15.94:0/1037082878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580c6170 con 0x7ffb44003f40 2023-10-16T08:52:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb58158b50 0x7ffb580cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb5df9e640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb580c55d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffb540108e0 tx=0x7ffb54010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400eb60 con 0x7ffb44003f40 2023-10-16T08:52:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400ecc0 con 0x7ffb44003f40 2023-10-16T08:52:34.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.576+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5814d0f0 con 0x7ffb44003f40 2023-10-16T08:52:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.577+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5401c400 con 0x7ffb44003f40 2023-10-16T08:52:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.577+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb580ce1b0 con 0x7ffb44003f40 2023-10-16T08:52:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.578+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb580cc350 con 0x7ffb44003f40 2023-10-16T08:52:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.579+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb5401c560 con 0x7ffb44003f40 2023-10-16T08:52:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.579+0000 7ffb4e7fc640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffb3c06aea0 0x7ffb3c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:34.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.580+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb5408a120 con 0x7ffb44003f40 2023-10-16T08:52:34.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.580+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffb3c06aea0 0x7ffb3c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:34.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.581+0000 7ffb5d79d640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffb3c06aea0 0x7ffb3c06d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c160 tx=0x7ffb48007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:34.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.584+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb54054d70 con 0x7ffb44003f40 2023-10-16T08:52:34.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.775+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb58073ef0 con 0x7ffb44003f40 2023-10-16T08:52:34.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.776+0000 7ffb4e7fc640 1 -- 172.21.15.94:0/1037082878 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb54058390 con 0x7ffb44003f40 2023-10-16T08:52:34.777 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:34.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.778+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffb3c06aea0 msgr2=0x7ffb3c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.778+0000 7ffb60202640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffb3c06aea0 0x7ffb3c06d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c160 tx=0x7ffb48007000 comp rx=0 tx=0).stop 2023-10-16T08:52:34.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.778+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 msgr2=0x7ffb580c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:34.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.778+0000 7ffb60202640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb580c55d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffb540108e0 tx=0x7ffb54010da0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.778+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 shutdown_connections 2023-10-16T08:52:34.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.778+0000 7ffb60202640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb580b0fd0 0x7ffb580b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.779+0000 7ffb60202640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffb3c06aea0 0x7ffb3c06d360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.779+0000 7ffb60202640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb58158b50 0x7ffb580cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.779+0000 7ffb60202640 1 --2- 172.21.15.94:0/1037082878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb44003f40 0x7ffb580c55d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.779+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 >> 172.21.15.94:0/1037082878 conn(0x7ffb580b0030 msgr2=0x7ffb580af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:34.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.779+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 shutdown_connections 2023-10-16T08:52:34.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:34.779+0000 7ffb60202640 1 -- 172.21.15.94:0/1037082878 wait complete. 2023-10-16T08:52:34.799 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:35.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.023+0000 7f1a4d846640 1 Processor -- start 2023-10-16T08:52:35.024 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.023+0000 7f1a4d846640 1 -- start start 2023-10-16T08:52:35.025 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.024+0000 7f1a4d846640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a4815ada0 0x7f1a480cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.024+0000 7f1a4d846640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 0x7f1a480cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a4d846640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4815b180 con 0x7f1a480adc10 2023-10-16T08:52:35.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a4d846640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480cdcc0 con 0x7f1a4815ada0 2023-10-16T08:52:35.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a4d846640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480ad480 con 0x7f1a480af7e0 2023-10-16T08:52:35.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a46ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a4815ada0 0x7f1a480cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a467fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 0x7f1a480cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a46ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a4815ada0 0x7f1a480cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:39052/0 (socket says 172.21.15.94:39052) 2023-10-16T08:52:35.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1687871889 learned_addr learned my addr 172.21.15.94:0/1687871889 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:35.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.025+0000 7f1a467fc640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 0x7f1a480cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:41296/0 (socket says 172.21.15.94:41296) 2023-10-16T08:52:35.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.026+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 msgr2=0x7f1a480cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:35.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.026+0000 7f1a46ffd640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 0x7f1a480cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.026+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1687871889 >> v1:172.21.15.130:6789/0 conn(0x7f1a480adc10 legacy=0x7f1a480ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.026+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1687871889 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480ce6e0 con 0x7f1a4815ada0 2023-10-16T08:52:35.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.026+0000 7f1a467fc640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 0x7f1a480cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:52:35.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.028+0000 7f1a46ffd640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a4815ada0 0x7f1a480cee20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009ea0 tx=0x7f1a3802bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12245793d752610b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.028+0000 7f1a45ffb640 1 -- 172.21.15.94:0/1687871889 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3802cab0 con 0x7f1a4815ada0 2023-10-16T08:52:35.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.028+0000 7f1a45ffb640 1 -- 172.21.15.94:0/1687871889 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3802cc10 con 0x7f1a4815ada0 2023-10-16T08:52:35.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.028+0000 7f1a45ffb640 1 -- 172.21.15.94:0/1687871889 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380343f0 con 0x7f1a4815ada0 2023-10-16T08:52:35.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 -- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a4815ada0 msgr2=0x7f1a480cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a4815ada0 0x7f1a480cee20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009ea0 tx=0x7f1a3802bf10 comp rx=0 tx=0).stop 2023-10-16T08:52:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 -- 172.21.15.94:0/1687871889 shutdown_connections 2023-10-16T08:52:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a480af7e0 0x7f1a480cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1687871889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a4815ada0 0x7f1a480cee20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 -- 172.21.15.94:0/1687871889 >> 172.21.15.94:0/1687871889 conn(0x7f1a480d0860 msgr2=0x7f1a480d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:35.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 -- 172.21.15.94:0/1687871889 shutdown_connections 2023-10-16T08:52:35.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.029+0000 7f1a4d846640 1 -- 172.21.15.94:0/1687871889 wait complete. 2023-10-16T08:52:35.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.031+0000 7f1a4d846640 1 Processor -- start 2023-10-16T08:52:35.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.031+0000 7f1a4d846640 1 -- start start 2023-10-16T08:52:35.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a4d846640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 0x7f1a480b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a4d846640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a480af7e0 0x7f1a480c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a4d846640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a4815ada0 0x7f1a480b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a4d846640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480c44d0 con 0x7f1a480adc10 2023-10-16T08:52:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a4d846640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480c47b0 con 0x7f1a480af7e0 2023-10-16T08:52:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a4d846640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480c4a90 con 0x7f1a4815ada0 2023-10-16T08:52:35.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a46ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 0x7f1a480b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a46ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 0x7f1a480b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39762/0 (socket says 172.21.15.94:39762) 2023-10-16T08:52:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.032+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1479434078 learned_addr learned my addr 172.21.15.94:0/1479434078 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a477fe640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a4815ada0 0x7f1a480b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a4815ada0 msgr2=0x7f1a480b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a467fc640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a480af7e0 0x7f1a480c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a46ffd640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a4815ada0 0x7f1a480b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a480af7e0 msgr2=0x7f1a480c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a46ffd640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a480af7e0 0x7f1a480c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a46ffd640 1 -- 172.21.15.94:0/1479434078 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30009400 con 0x7f1a480adc10 2023-10-16T08:52:35.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a477fe640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a4815ada0 0x7f1a480b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:35.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a46ffd640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 0x7f1a480b5bc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1a38036040 tx=0x7f1a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38009510 con 0x7f1a480adc10 2023-10-16T08:52:35.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3803e450 con 0x7f1a480adc10 2023-10-16T08:52:35.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3803e820 con 0x7f1a480adc10 2023-10-16T08:52:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a38009b30 con 0x7f1a480adc10 2023-10-16T08:52:35.040 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.033+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a480c5050 con 0x7f1a480adc10 2023-10-16T08:52:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.035+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a48067180 con 0x7f1a480adc10 2023-10-16T08:52:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.035+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a3803e980 con 0x7f1a480adc10 2023-10-16T08:52:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.036+0000 7f1a3ffff640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1a2806ae70 0x7f1a2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.041 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.036+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a380ac670 con 0x7f1a480adc10 2023-10-16T08:52:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.037+0000 7f1a467fc640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1a2806ae70 0x7f1a2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.037+0000 7f1a467fc640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1a2806ae70 0x7f1a2806d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a480ca490 tx=0x7f1a30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.042+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a380773f0 con 0x7f1a480adc10 2023-10-16T08:52:35.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.230+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a480ce990 con 0x7f1a480adc10 2023-10-16T08:52:35.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.231+0000 7f1a3ffff640 1 -- 172.21.15.94:0/1479434078 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a3807aa10 con 0x7f1a480adc10 2023-10-16T08:52:35.232 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:35.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.233+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1a2806ae70 msgr2=0x7f1a2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.233+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1a2806ae70 0x7f1a2806d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a480ca490 tx=0x7f1a30008040 comp rx=0 tx=0).stop 2023-10-16T08:52:35.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.233+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 msgr2=0x7f1a480b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.233+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 0x7f1a480b5bc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1a38036040 tx=0x7f1a38004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:35.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 shutdown_connections 2023-10-16T08:52:35.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a4815ada0 0x7f1a480b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f1a2806ae70 0x7f1a2806d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a480af7e0 0x7f1a480c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 --2- 172.21.15.94:0/1479434078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a480adc10 0x7f1a480b5bc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 >> 172.21.15.94:0/1479434078 conn(0x7f1a480d0860 msgr2=0x7f1a4806b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:35.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 shutdown_connections 2023-10-16T08:52:35.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.234+0000 7f1a4d846640 1 -- 172.21.15.94:0/1479434078 wait complete. 2023-10-16T08:52:35.254 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:35.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.472+0000 7f10d17a9640 1 Processor -- start 2023-10-16T08:52:35.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.472+0000 7f10d17a9640 1 -- start start 2023-10-16T08:52:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10d17a9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f10cc1611f0 0x7f10cc15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10d17a9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc160730 con 0x7f10cc0cb3b0 2023-10-16T08:52:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10d17a9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc15dd60 con 0x7f10cc15cbf0 2023-10-16T08:52:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10d17a9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc1609f0 con 0x7f10cc1611f0 2023-10-16T08:52:35.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10cb7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f10cc0cb3b0 0x7f10cc15d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56430/0 (socket says 172.21.15.94:56430) 2023-10-16T08:52:35.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10cb7fe640 1 -- 172.21.15.94:0/1566391305 learned_addr learned my addr 172.21.15.94:0/1566391305 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:35.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.474+0000 7f10ca7fc640 1 --2- 172.21.15.94:0/1566391305 >> v2:172.21.15.130:3300/0 conn(0x7f10cc1611f0 0x7f10cc15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.475+0000 7f10c9ffb640 1 -- 172.21.15.94:0/1566391305 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435079458 0 0) 0x7f10cc160730 con 0x7f10cc0cb3b0 2023-10-16T08:52:35.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.475+0000 7f10c9ffb640 1 -- 172.21.15.94:0/1566391305 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b4003520 con 0x7f10cc0cb3b0 2023-10-16T08:52:35.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.475+0000 7f10ca7fc640 1 -- 172.21.15.94:0/1566391305 >> v1:172.21.15.130:6789/0 conn(0x7f10cc15cbf0 legacy=0x7f10cc0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.475+0000 7f10ca7fc640 1 -- 172.21.15.94:0/1566391305 >> v1:172.21.15.94:6789/0 conn(0x7f10cc0cb3b0 legacy=0x7f10cc15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.475+0000 7f10ca7fc640 1 -- 172.21.15.94:0/1566391305 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc160cd0 con 0x7f10cc1611f0 2023-10-16T08:52:35.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.477+0000 7f10ca7fc640 1 --2- 172.21.15.94:0/1566391305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc1611f0 0x7f10cc15cfd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f10c00097a0 tx=0x7f10c002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b0f71e5f9f845c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.477+0000 7f10c9ffb640 1 -- 172.21.15.94:0/1566391305 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0030610 con 0x7f10cc1611f0 2023-10-16T08:52:35.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.477+0000 7f10c9ffb640 1 -- 172.21.15.94:0/1566391305 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0030770 con 0x7f10cc1611f0 2023-10-16T08:52:35.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.477+0000 7f10c9ffb640 1 -- 172.21.15.94:0/1566391305 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0030ae0 con 0x7f10cc1611f0 2023-10-16T08:52:35.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 -- 172.21.15.94:0/1566391305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc1611f0 msgr2=0x7f10cc15cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 --2- 172.21.15.94:0/1566391305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc1611f0 0x7f10cc15cfd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f10c00097a0 tx=0x7f10c002b960 comp rx=0 tx=0).stop 2023-10-16T08:52:35.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 -- 172.21.15.94:0/1566391305 shutdown_connections 2023-10-16T08:52:35.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 --2- 172.21.15.94:0/1566391305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc1611f0 0x7f10cc15cfd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 -- 172.21.15.94:0/1566391305 >> 172.21.15.94:0/1566391305 conn(0x7f10cc0b0030 msgr2=0x7f10cc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:35.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 -- 172.21.15.94:0/1566391305 shutdown_connections 2023-10-16T08:52:35.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.478+0000 7f10d17a9640 1 -- 172.21.15.94:0/1566391305 wait complete. 2023-10-16T08:52:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.480+0000 7f10d17a9640 1 Processor -- start 2023-10-16T08:52:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.480+0000 7f10d17a9640 1 -- start start 2023-10-16T08:52:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10d17a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc0cb3b0 0x7f10cc1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10d17a9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10cc15cbf0 0x7f10cc15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10d17a9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 0x7f10cc141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10d17a9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c13d0 con 0x7f10cc1611f0 2023-10-16T08:52:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10d17a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1459f0 con 0x7f10cc0cb3b0 2023-10-16T08:52:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10d17a9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc15a1e0 con 0x7f10cc15cbf0 2023-10-16T08:52:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10cb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 0x7f10cc141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10cb7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 0x7f10cc141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39778/0 (socket says 172.21.15.94:39778) 2023-10-16T08:52:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10cb7fe640 1 -- 172.21.15.94:0/304878996 learned_addr learned my addr 172.21.15.94:0/304878996 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10ca7fc640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10cc15cbf0 0x7f10cc15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.481+0000 7f10caffd640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc0cb3b0 0x7f10cc1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10cb7fe640 1 -- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10cc15cbf0 msgr2=0x7f10cc15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10cb7fe640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10cc15cbf0 0x7f10cc15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10cb7fe640 1 -- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc0cb3b0 msgr2=0x7f10cc1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10cb7fe640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc0cb3b0 0x7f10cc1454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10cb7fe640 1 -- 172.21.15.94:0/304878996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0009400 con 0x7f10cc1611f0 2023-10-16T08:52:35.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10cb7fe640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 0x7f10cc141450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f10c400cb40 tx=0x7f10c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400aca0 con 0x7f10cc1611f0 2023-10-16T08:52:35.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400ae00 con 0x7f10cc1611f0 2023-10-16T08:52:35.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4012620 con 0x7f10cc1611f0 2023-10-16T08:52:35.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc15a4c0 con 0x7f10cc1611f0 2023-10-16T08:52:35.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.482+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc15aa80 con 0x7f10cc1611f0 2023-10-16T08:52:35.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.484+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc073ef0 con 0x7f10cc1611f0 2023-10-16T08:52:35.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.484+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f10c4007070 con 0x7f10cc1611f0 2023-10-16T08:52:35.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.485+0000 7f10b37fe640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f10b806ae70 0x7f10b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.485+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f10c4089a20 con 0x7f10cc1611f0 2023-10-16T08:52:35.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.486+0000 7f10caffd640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f10b806ae70 0x7f10b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.486+0000 7f10caffd640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f10b806ae70 0x7f10b806d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10bc000f60 tx=0x7f10bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.490+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10c4054710 con 0x7f10cc1611f0 2023-10-16T08:52:35.680 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.679+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f10cc0cc1a0 con 0x7f10cc1611f0 2023-10-16T08:52:35.681 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.680+0000 7f10b37fe640 1 -- 172.21.15.94:0/304878996 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f10c40170a0 con 0x7f10cc1611f0 2023-10-16T08:52:35.681 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.682+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f10b806ae70 msgr2=0x7f10b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.682+0000 7f10d17a9640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f10b806ae70 0x7f10b806d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10bc000f60 tx=0x7f10bc009040 comp rx=0 tx=0).stop 2023-10-16T08:52:35.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.682+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 msgr2=0x7f10cc141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.682+0000 7f10d17a9640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 0x7f10cc141450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f10c400cb40 tx=0x7f10c400a060 comp rx=0 tx=0).stop 2023-10-16T08:52:35.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 shutdown_connections 2023-10-16T08:52:35.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10cc1611f0 0x7f10cc141450 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10cc15cbf0 0x7f10cc15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f10b806ae70 0x7f10b806d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 --2- 172.21.15.94:0/304878996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10cc0cb3b0 0x7f10cc1454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 >> 172.21.15.94:0/304878996 conn(0x7f10cc0b0030 msgr2=0x7f10cc15cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:35.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 shutdown_connections 2023-10-16T08:52:35.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.683+0000 7f10d17a9640 1 -- 172.21.15.94:0/304878996 wait complete. 2023-10-16T08:52:35.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:35.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.914+0000 7fa7cf3f0640 1 Processor -- start 2023-10-16T08:52:35.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.915+0000 7fa7cf3f0640 1 -- start start 2023-10-16T08:52:35.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.916+0000 7fa7cf3f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.916+0000 7fa7cf3f0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7c8161310 0x7fa7c80ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.916+0000 7fa7cf3f0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa7c80b01b0 0x7fa7c80b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.916+0000 7fa7cf3f0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80b0b80 con 0x7fa7c8161310 2023-10-16T08:52:35.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.916+0000 7fa7cf3f0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80c9c70 con 0x7fa7c80b01b0 2023-10-16T08:52:35.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.916+0000 7fa7cf3f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80cca90 con 0x7fa7c815cc20 2023-10-16T08:52:35.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7c8161310 0x7fa7c80ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7c8161310 0x7fa7c80ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39788/0 (socket says 172.21.15.94:39788) 2023-10-16T08:52:35.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 -- 172.21.15.94:0/2859260856 learned_addr learned my addr 172.21.15.94:0/2859260856 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:35.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cd18c640 1 --2- 172.21.15.94:0/2859260856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cd98d640 1 --2- 172.21.15.94:0/2859260856 >> v2:172.21.15.130:3300/0 conn(0x7fa7c80b01b0 0x7fa7c80b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 -- 172.21.15.94:0/2859260856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 msgr2=0x7fa7c80c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:35.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 --2- 172.21.15.94:0/2859260856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 -- 172.21.15.94:0/2859260856 >> v2:172.21.15.130:3300/0 conn(0x7fa7c80b01b0 msgr2=0x7fa7c80b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:35.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 --2- 172.21.15.94:0/2859260856 >> v2:172.21.15.130:3300/0 conn(0x7fa7c80b01b0 0x7fa7c80b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.917+0000 7fa7cc98b640 1 -- 172.21.15.94:0/2859260856 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c815d000 con 0x7fa7c8161310 2023-10-16T08:52:35.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.918+0000 7fa7cc98b640 1 --2- 172.21.15.94:0/2859260856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80ab860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80adc40 tx=0x7fa7b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9905300a6317ab0a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7bffff640 1 -- 172.21.15.94:0/2859260856 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8031870 con 0x7fa7c8161310 2023-10-16T08:52:35.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7bffff640 1 -- 172.21.15.94:0/2859260856 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b80319d0 con 0x7fa7c8161310 2023-10-16T08:52:35.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7bffff640 1 -- 172.21.15.94:0/2859260856 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8031d60 con 0x7fa7c8161310 2023-10-16T08:52:35.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/2859260856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 msgr2=0x7fa7c80ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/2859260856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80ab860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80adc40 tx=0x7fa7b802b910 comp rx=0 tx=0).stop 2023-10-16T08:52:35.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/2859260856 shutdown_connections 2023-10-16T08:52:35.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/2859260856 >> v2:172.21.15.130:3300/0 conn(0x7fa7c80b01b0 0x7fa7c80b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/2859260856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80ab860 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/2859260856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/2859260856 >> 172.21.15.94:0/2859260856 conn(0x7fa7c80cb1b0 msgr2=0x7fa7c80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:35.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/2859260856 shutdown_connections 2023-10-16T08:52:35.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.919+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/2859260856 wait complete. 2023-10-16T08:52:35.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.921+0000 7fa7cf3f0640 1 Processor -- start 2023-10-16T08:52:35.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.921+0000 7fa7cf3f0640 1 -- start start 2023-10-16T08:52:35.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.922+0000 7fa7cf3f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7c80b01b0 0x7fa7c815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.922+0000 7fa7cf3f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.922+0000 7fa7cf3f0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.922+0000 7fa7cf3f0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80b13f0 con 0x7fa7c8161310 2023-10-16T08:52:35.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.922+0000 7fa7cf3f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80b1690 con 0x7fa7c80b01b0 2023-10-16T08:52:35.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.922+0000 7fa7cf3f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80b1970 con 0x7fa7c815cc20 2023-10-16T08:52:35.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39802/0 (socket says 172.21.15.94:39802) 2023-10-16T08:52:35.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 -- 172.21.15.94:0/103700377 learned_addr learned my addr 172.21.15.94:0/103700377 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:35.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cc98b640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd18c640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7c80b01b0 0x7fa7c815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 -- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 msgr2=0x7fa7c80b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 -- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7c80b01b0 msgr2=0x7fa7c815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:35.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7c80b01b0 0x7fa7c815e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:35.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 -- 172.21.15.94:0/103700377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80094d0 con 0x7fa7c8161310 2023-10-16T08:52:35.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cc98b640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:35.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.923+0000 7fa7cd98d640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80b33a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007e40 tx=0x7fa7c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.924+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0014620 con 0x7fa7c8161310 2023-10-16T08:52:35.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.924+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000ee90 con 0x7fa7c8161310 2023-10-16T08:52:35.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.924+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00149e0 con 0x7fa7c8161310 2023-10-16T08:52:35.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.924+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c80b1c50 con 0x7fa7c8161310 2023-10-16T08:52:35.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.924+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c815ee30 con 0x7fa7c8161310 2023-10-16T08:52:35.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.925+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c80b1e40 con 0x7fa7c8161310 2023-10-16T08:52:35.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.926+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7c0014b40 con 0x7fa7c8161310 2023-10-16T08:52:35.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.927+0000 7fa7bdffb640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa7ac06ae70 0x7fa7ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:35.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.927+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa7c008a400 con 0x7fa7c8161310 2023-10-16T08:52:35.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.927+0000 7fa7cd18c640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa7ac06ae70 0x7fa7ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:35.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.928+0000 7fa7cd18c640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa7ac06ae70 0x7fa7ac06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4006fd0 tx=0x7fa7c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:35.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:35.932+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7c00550e0 con 0x7fa7c8161310 2023-10-16T08:52:36.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.142+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7c8073ef0 con 0x7fa7c8161310 2023-10-16T08:52:36.143 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.143+0000 7fa7bdffb640 1 -- 172.21.15.94:0/103700377 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa7c0058700 con 0x7fa7c8161310 2023-10-16T08:52:36.144 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:36.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.145+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa7ac06ae70 msgr2=0x7fa7ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.145+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa7ac06ae70 0x7fa7ac06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4006fd0 tx=0x7fa7c4008040 comp rx=0 tx=0).stop 2023-10-16T08:52:36.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.145+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 msgr2=0x7fa7c80b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.145+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80b33a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007e40 tx=0x7fa7c000e4b0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 shutdown_connections 2023-10-16T08:52:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c8161310 0x7fa7c80b33a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7c815cc20 0x7fa7c80b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa7ac06ae70 0x7fa7ac06d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 --2- 172.21.15.94:0/103700377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7c80b01b0 0x7fa7c815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 >> 172.21.15.94:0/103700377 conn(0x7fa7c80cb1b0 msgr2=0x7fa7c80ac280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:36.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 shutdown_connections 2023-10-16T08:52:36.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.146+0000 7fa7cf3f0640 1 -- 172.21.15.94:0/103700377 wait complete. 2023-10-16T08:52:36.165 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:52:36.166 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:36.227 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.443+0000 7febbd4e7640 1 Processor -- start 2023-10-16T08:52:36.445 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.443+0000 7febbd4e7640 1 -- start start 2023-10-16T08:52:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.444+0000 7febbd4e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7febb815ad00 0x7febb80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.444+0000 7febbd4e7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7febb815f040 0x7febb815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.444+0000 7febbd4e7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb80707f0 con 0x7febb80b0010 2023-10-16T08:52:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.444+0000 7febbd4e7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb8070ad0 con 0x7febb815ad00 2023-10-16T08:52:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.444+0000 7febbd4e7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb815b1d0 con 0x7febb815f040 2023-10-16T08:52:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7febb815ad00 0x7febb80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7febb815ad00 0x7febb80701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39814/0 (socket says 172.21.15.94:39814) 2023-10-16T08:52:36.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 -- 172.21.15.94:0/3170306326 learned_addr learned my addr 172.21.15.94:0/3170306326 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febb77fe640 1 --2- 172.21.15.94:0/3170306326 >> v2:172.21.15.130:3300/0 conn(0x7febb815f040 0x7febb815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 -- 172.21.15.94:0/3170306326 >> v2:172.21.15.130:3300/0 conn(0x7febb815f040 msgr2=0x7febb815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 --2- 172.21.15.94:0/3170306326 >> v2:172.21.15.130:3300/0 conn(0x7febb815f040 0x7febb815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 -- 172.21.15.94:0/3170306326 >> v1:172.21.15.130:6789/0 conn(0x7febb80b0010 legacy=0x7febb80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:36.449 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.445+0000 7febae7fc640 1 -- 172.21.15.94:0/3170306326 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb815b4b0 con 0x7febb815ad00 2023-10-16T08:52:36.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.446+0000 7febae7fc640 1 --2- 172.21.15.94:0/3170306326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815ad00 0x7febb80701a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7febb80adf80 tx=0x7feba002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db89d1f67c4b466f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:36.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febb67fc640 1 -- 172.21.15.94:0/3170306326 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0031870 con 0x7febb815ad00 2023-10-16T08:52:36.451 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febb67fc640 1 -- 172.21.15.94:0/3170306326 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba00319d0 con 0x7febb815ad00 2023-10-16T08:52:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febb67fc640 1 -- 172.21.15.94:0/3170306326 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0031d60 con 0x7febb815ad00 2023-10-16T08:52:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 -- 172.21.15.94:0/3170306326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815ad00 msgr2=0x7febb80701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3170306326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815ad00 0x7febb80701a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7febb80adf80 tx=0x7feba002b910 comp rx=0 tx=0).stop 2023-10-16T08:52:36.452 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 -- 172.21.15.94:0/3170306326 shutdown_connections 2023-10-16T08:52:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3170306326 >> v2:172.21.15.130:3300/0 conn(0x7febb815f040 0x7febb815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3170306326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815ad00 0x7febb80701a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 -- 172.21.15.94:0/3170306326 >> 172.21.15.94:0/3170306326 conn(0x7febb806c1c0 msgr2=0x7febb806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 -- 172.21.15.94:0/3170306326 shutdown_connections 2023-10-16T08:52:36.453 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.447+0000 7febbd4e7640 1 -- 172.21.15.94:0/3170306326 wait complete. 2023-10-16T08:52:36.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.449+0000 7febbd4e7640 1 Processor -- start 2023-10-16T08:52:36.454 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.449+0000 7febbd4e7640 1 -- start start 2023-10-16T08:52:36.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febbd4e7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80b0010 0x7febb80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.456 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febbd4e7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb815ad00 0x7febb8157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febbd4e7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 0x7febb80c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febbd4e7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb8157f90 con 0x7febb815f040 2023-10-16T08:52:36.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febbd4e7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80acc10 con 0x7febb80b0010 2023-10-16T08:52:36.457 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febbd4e7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb80acef0 con 0x7febb815ad00 2023-10-16T08:52:36.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febb77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 0x7febb80c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febb77fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 0x7febb80c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39820/0 (socket says 172.21.15.94:39820) 2023-10-16T08:52:36.458 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.450+0000 7febb77fe640 1 -- 172.21.15.94:0/3716011965 learned_addr learned my addr 172.21.15.94:0/3716011965 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:36.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb77fe640 1 -- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb815ad00 msgr2=0x7febb8157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb6ffd640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80b0010 0x7febb80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febae7fc640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb815ad00 0x7febb8157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb77fe640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb815ad00 0x7febb8157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb77fe640 1 -- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80b0010 msgr2=0x7febb80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.459 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb77fe640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80b0010 0x7febb80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb77fe640 1 -- 172.21.15.94:0/3716011965 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00094d0 con 0x7febb815f040 2023-10-16T08:52:36.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febae7fc640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb815ad00 0x7febb8157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:36.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febb77fe640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 0x7febb80c5660 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7febb0007e60 tx=0x7febb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:36.460 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0014420 con 0x7febb815f040 2023-10-16T08:52:36.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb00145a0 con 0x7febb815f040 2023-10-16T08:52:36.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0014950 con 0x7febb815f040 2023-10-16T08:52:36.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.451+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb80ad1d0 con 0x7febb815f040 2023-10-16T08:52:36.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.452+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb80c7c60 con 0x7febb815f040 2023-10-16T08:52:36.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.453+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb80c7e50 con 0x7febb815f040 2023-10-16T08:52:36.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.454+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7febb0014ab0 con 0x7febb815f040 2023-10-16T08:52:36.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.454+0000 7febaffff640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feb9806ae70 0x7feb9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.454+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febb008a330 con 0x7febb815f040 2023-10-16T08:52:36.462 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.455+0000 7febb6ffd640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feb9806ae70 0x7feb9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.455+0000 7febb6ffd640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feb9806ae70 0x7feb9806d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feba80015d0 tx=0x7feba8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:36.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.459+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febb0055020 con 0x7febb815f040 2023-10-16T08:52:36.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.649+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febb8073ef0 con 0x7febb815f040 2023-10-16T08:52:36.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.650+0000 7febaffff640 1 -- 172.21.15.94:0/3716011965 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7febb0058640 con 0x7febb815f040 2023-10-16T08:52:36.652 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:36.653 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.652+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feb9806ae70 msgr2=0x7feb9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.652+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feb9806ae70 0x7feb9806d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feba80015d0 tx=0x7feba8009040 comp rx=0 tx=0).stop 2023-10-16T08:52:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 msgr2=0x7febb80c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 0x7febb80c5660 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7febb0007e60 tx=0x7febb000e4b0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 shutdown_connections 2023-10-16T08:52:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febb815f040 0x7febb80c5660 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb815ad00 0x7febb8157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7feb9806ae70 0x7feb9806d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 --2- 172.21.15.94:0/3716011965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80b0010 0x7febb80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 >> 172.21.15.94:0/3716011965 conn(0x7febb806c1c0 msgr2=0x7febb80ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 shutdown_connections 2023-10-16T08:52:36.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.653+0000 7febbd4e7640 1 -- 172.21.15.94:0/3716011965 wait complete. 2023-10-16T08:52:36.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:36.675 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:36.888 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.886+0000 7f9442ed7640 1 Processor -- start 2023-10-16T08:52:36.889 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.887+0000 7f9442ed7640 1 -- start start 2023-10-16T08:52:36.890 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f9442ed7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f943c0b1a30 0x7f943c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f9442ed7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f943c0d0cd0 0x7f943c0d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f9442ed7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c06b570 0x7f943c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f9442ed7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c06bf40 con 0x7f943c0d0cd0 2023-10-16T08:52:36.891 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f9442ed7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0d1620 con 0x7f943c0b1a30 2023-10-16T08:52:36.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f9442ed7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0cfc20 con 0x7f943c06b570 2023-10-16T08:52:36.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f94416d4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f943c0d0cd0 0x7f943c0d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f94416d4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f943c0d0cd0 0x7f943c0d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39828/0 (socket says 172.21.15.94:39828) 2023-10-16T08:52:36.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.888+0000 7f94416d4640 1 -- 172.21.15.94:0/2804390030 learned_addr learned my addr 172.21.15.94:0/2804390030 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:36.892 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f9441ed5640 1 --2- 172.21.15.94:0/2804390030 >> v2:172.21.15.130:3300/0 conn(0x7f943c0b1a30 0x7f943c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94416d4640 1 -- 172.21.15.94:0/2804390030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c06b570 msgr2=0x7f943c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:36.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94426d6640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c06b570 0x7f943c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94416d4640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c06b570 0x7f943c06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94416d4640 1 -- 172.21.15.94:0/2804390030 >> v2:172.21.15.130:3300/0 conn(0x7f943c0b1a30 msgr2=0x7f943c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:36.893 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94416d4640 1 --2- 172.21.15.94:0/2804390030 >> v2:172.21.15.130:3300/0 conn(0x7f943c0b1a30 0x7f943c0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94416d4640 1 -- 172.21.15.94:0/2804390030 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0cd4a0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f9441ed5640 1 --2- 172.21.15.94:0/2804390030 >> v2:172.21.15.130:3300/0 conn(0x7f943c0b1a30 0x7f943c0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:36.894 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.889+0000 7f94426d6640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c06b570 0x7f943c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.890+0000 7f94416d4640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0d10e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f943c0d37f0 tx=0x7f942c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7347c6f70d94fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.890+0000 7f9440ed3640 1 -- 172.21.15.94:0/2804390030 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c031860 con 0x7f943c0d0cd0 2023-10-16T08:52:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.890+0000 7f9440ed3640 1 -- 172.21.15.94:0/2804390030 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0319c0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.890+0000 7f9440ed3640 1 -- 172.21.15.94:0/2804390030 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c031d50 con 0x7f943c0d0cd0 2023-10-16T08:52:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 -- 172.21.15.94:0/2804390030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 msgr2=0x7f943c0d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0d10e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f943c0d37f0 tx=0x7f942c02b900 comp rx=0 tx=0).stop 2023-10-16T08:52:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 -- 172.21.15.94:0/2804390030 shutdown_connections 2023-10-16T08:52:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c06b570 0x7f943c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 --2- 172.21.15.94:0/2804390030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0d10e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 --2- 172.21.15.94:0/2804390030 >> v2:172.21.15.130:3300/0 conn(0x7f943c0b1a30 0x7f943c0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 -- 172.21.15.94:0/2804390030 >> 172.21.15.94:0/2804390030 conn(0x7f943c08c140 msgr2=0x7f943c09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 -- 172.21.15.94:0/2804390030 shutdown_connections 2023-10-16T08:52:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.891+0000 7f9442ed7640 1 -- 172.21.15.94:0/2804390030 wait complete. 2023-10-16T08:52:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.893+0000 7f9442ed7640 1 Processor -- start 2023-10-16T08:52:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.893+0000 7f9442ed7640 1 -- start start 2023-10-16T08:52:36.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f9442ed7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f943c06b570 0x7f943c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f9442ed7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c0b1a30 0x7f943c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f9442ed7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f9442ed7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0b5830 con 0x7f943c0d0cd0 2023-10-16T08:52:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f9442ed7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15b6f0 con 0x7f943c06b570 2023-10-16T08:52:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f9442ed7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15a240 con 0x7f943c0b1a30 2023-10-16T08:52:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f94426d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f94426d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39840/0 (socket says 172.21.15.94:39840) 2023-10-16T08:52:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.894+0000 7f94426d6640 1 -- 172.21.15.94:0/3580882284 learned_addr learned my addr 172.21.15.94:0/3580882284 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94416d4640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c0b1a30 0x7f943c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94426d6640 1 -- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c0b1a30 msgr2=0x7f943c159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94426d6640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c0b1a30 0x7f943c159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94426d6640 1 -- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f943c06b570 msgr2=0x7f943c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94426d6640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f943c06b570 0x7f943c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94426d6640 1 -- 172.21.15.94:0/3580882284 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0094d0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94426d6640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0af860 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f943400cd10 tx=0x7f943400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400f680 con 0x7f943c0d0cd0 2023-10-16T08:52:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400f800 con 0x7f943c0d0cd0 2023-10-16T08:52:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400fbb0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0b7e30 con 0x7f943c0d0cd0 2023-10-16T08:52:36.905 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.895+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0b83f0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.897+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c0b85e0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.898+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f943400b040 con 0x7f943c0d0cd0 2023-10-16T08:52:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.898+0000 7f94327fc640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f942006aea0 0x7f942006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.899+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f943408a2e0 con 0x7f943c0d0cd0 2023-10-16T08:52:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.899+0000 7f9441ed5640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f942006aea0 0x7f942006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.899+0000 7f9441ed5640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f942006aea0 0x7f942006d360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9438006fd0 tx=0x7f9438008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:36.903+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9434054fc0 con 0x7f943c0d0cd0 2023-10-16T08:52:37.096 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.094+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f943c04e9b0 con 0x7f943c0d0cd0 2023-10-16T08:52:37.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.095+0000 7f94327fc640 1 -- 172.21.15.94:0/3580882284 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94340585e0 con 0x7f943c0d0cd0 2023-10-16T08:52:37.097 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f942006aea0 msgr2=0x7f942006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f942006aea0 0x7f942006d360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9438006fd0 tx=0x7f9438008040 comp rx=0 tx=0).stop 2023-10-16T08:52:37.100 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 msgr2=0x7f943c0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0af860 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f943400cd10 tx=0x7f943400a650 comp rx=0 tx=0).stop 2023-10-16T08:52:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 shutdown_connections 2023-10-16T08:52:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f943c0d0cd0 0x7f943c0af860 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f943c0b1a30 0x7f943c159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.101 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f942006aea0 0x7f942006d360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.102 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 --2- 172.21.15.94:0/3580882284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f943c06b570 0x7f943c0b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.102 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 >> 172.21.15.94:0/3580882284 conn(0x7f943c08c140 msgr2=0x7f943c0b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:37.102 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 shutdown_connections 2023-10-16T08:52:37.102 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.098+0000 7f9442ed7640 1 -- 172.21.15.94:0/3580882284 wait complete. 2023-10-16T08:52:37.118 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.333+0000 7ff9f26d7640 1 Processor -- start 2023-10-16T08:52:37.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.333+0000 7ff9f26d7640 1 -- start start 2023-10-16T08:52:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9f26d7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff9ec15cbf0 0x7ff9ec0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9f26d7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9ec1611f0 0x7ff9ec0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9f26d7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec160730 con 0x7ff9ec15cfd0 2023-10-16T08:52:37.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9f26d7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cb720 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9f26d7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec15db50 con 0x7ff9ec1611f0 2023-10-16T08:52:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9ebfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff9ec15cbf0 0x7ff9ec0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9ebfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff9ec15cbf0 0x7ff9ec0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39854/0 (socket says 172.21.15.94:39854) 2023-10-16T08:52:37.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9ebfff640 1 -- 172.21.15.94:0/92732105 learned_addr learned my addr 172.21.15.94:0/92732105 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:37.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.335+0000 7ff9f0c74640 1 --1- 172.21.15.94:0/92732105 >> v1:172.21.15.94:6789/0 conn(0x7ff9ec15cfd0 0x7ff9ec15d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56446/0 (socket says 172.21.15.94:56446) 2023-10-16T08:52:37.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9eb7fe640 1 --2- 172.21.15.94:0/92732105 >> v2:172.21.15.130:3300/0 conn(0x7ff9ec1611f0 0x7ff9ec0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9ebfff640 1 -- 172.21.15.94:0/92732105 >> v2:172.21.15.130:3300/0 conn(0x7ff9ec1611f0 msgr2=0x7ff9ec0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9ebfff640 1 --2- 172.21.15.94:0/92732105 >> v2:172.21.15.130:3300/0 conn(0x7ff9ec1611f0 0x7ff9ec0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9ebfff640 1 -- 172.21.15.94:0/92732105 >> v1:172.21.15.94:6789/0 conn(0x7ff9ec15cfd0 legacy=0x7ff9ec15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9ebfff640 1 -- 172.21.15.94:0/92732105 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec15dd60 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9eaffd640 1 -- 172.21.15.94:0/92732105 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797107558 0 0) 0x7ff9ec160730 con 0x7ff9ec15cfd0 2023-10-16T08:52:37.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.336+0000 7ff9eb7fe640 1 --2- 172.21.15.94:0/92732105 >> v2:172.21.15.130:3300/0 conn(0x7ff9ec1611f0 0x7ff9ec0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.337+0000 7ff9ebfff640 1 --2- 172.21.15.94:0/92732105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0caca0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec06d670 tx=0x7ff9dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2c8f0788138260 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.337+0000 7ff9eaffd640 1 -- 172.21.15.94:0/92732105 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc031870 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.337+0000 7ff9eaffd640 1 -- 172.21.15.94:0/92732105 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0319d0 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.337+0000 7ff9eaffd640 1 -- 172.21.15.94:0/92732105 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc031d60 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 -- 172.21.15.94:0/92732105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 msgr2=0x7ff9ec0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/92732105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0caca0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec06d670 tx=0x7ff9dc02b910 comp rx=0 tx=0).stop 2023-10-16T08:52:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 -- 172.21.15.94:0/92732105 shutdown_connections 2023-10-16T08:52:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/92732105 >> v2:172.21.15.130:3300/0 conn(0x7ff9ec1611f0 0x7ff9ec0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/92732105 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0caca0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 -- 172.21.15.94:0/92732105 >> 172.21.15.94:0/92732105 conn(0x7ff9ec0b0030 msgr2=0x7ff9ec0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 -- 172.21.15.94:0/92732105 shutdown_connections 2023-10-16T08:52:37.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.338+0000 7ff9f26d7640 1 -- 172.21.15.94:0/92732105 wait complete. 2023-10-16T08:52:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.340+0000 7ff9f26d7640 1 Processor -- start 2023-10-16T08:52:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.340+0000 7ff9f26d7640 1 -- start start 2023-10-16T08:52:37.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9f26d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9f26d7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9ec15cfd0 0x7ff9ec0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9f26d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9ec1611f0 0x7ff9ec0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9f26d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec144850 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9f26d7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec143bd0 con 0x7ff9ec15cfd0 2023-10-16T08:52:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9f26d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec143eb0 con 0x7ff9ec1611f0 2023-10-16T08:52:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39870/0 (socket says 172.21.15.94:39870) 2023-10-16T08:52:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 -- 172.21.15.94:0/3216660226 learned_addr learned my addr 172.21.15.94:0/3216660226 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:37.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 -- 172.21.15.94:0/3216660226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9ec1611f0 msgr2=0x7ff9ec0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9ec1611f0 0x7ff9ec0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 -- 172.21.15.94:0/3216660226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9ec15cfd0 msgr2=0x7ff9ec0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9ec15cfd0 0x7ff9ec0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.341+0000 7ff9ebfff640 1 -- 172.21.15.94:0/3216660226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0094d0 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.342+0000 7ff9ebfff640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0c5fc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc02b950 tx=0x7ff9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.342+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc031860 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.342+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0443f0 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.342+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0447a0 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.342+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec144190 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.342+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec0c6500 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.343+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec144990 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.344+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff9dc04d450 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.345+0000 7ff9e8ff9640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff9d806ae70 0x7ff9d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.345+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9dc02d040 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.345+0000 7ff9eb7fe640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff9d806ae70 0x7ff9d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.346+0000 7ff9eb7fe640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff9d806ae70 0x7ff9d806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006fd0 tx=0x7ff9e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:37.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.350+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9dc076ea0 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.543+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9ec073ef0 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.544+0000 7ff9e8ff9640 1 -- 172.21.15.94:0/3216660226 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9dc035020 con 0x7ff9ec15cbf0 2023-10-16T08:52:37.547 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:37.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff9d806ae70 msgr2=0x7ff9d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff9d806ae70 0x7ff9d806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006fd0 tx=0x7ff9e0008040 comp rx=0 tx=0).stop 2023-10-16T08:52:37.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 msgr2=0x7ff9ec0c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0c5fc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc02b950 tx=0x7ff9dc0046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 shutdown_connections 2023-10-16T08:52:37.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9ec1611f0 0x7ff9ec0c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff9d806ae70 0x7ff9d806d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9ec15cfd0 0x7ff9ec0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 --2- 172.21.15.94:0/3216660226 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9ec15cbf0 0x7ff9ec0c5fc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 >> 172.21.15.94:0/3216660226 conn(0x7ff9ec0b0030 msgr2=0x7ff9ec15ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:37.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 shutdown_connections 2023-10-16T08:52:37.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.549+0000 7ff9f26d7640 1 -- 172.21.15.94:0/3216660226 wait complete. 2023-10-16T08:52:37.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:37.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.775+0000 7fbeeab90640 1 Processor -- start 2023-10-16T08:52:37.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.775+0000 7fbeeab90640 1 -- start start 2023-10-16T08:52:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbeeab90640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbee415a830 0x7fbee40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbeeab90640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbee40ca550 0x7fbee4070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbeeab90640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee40cf040 con 0x7fbee4070860 2023-10-16T08:52:37.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbeeab90640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee4070cf0 con 0x7fbee40ca550 2023-10-16T08:52:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbeeab90640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee40ca9e0 con 0x7fbee415a830 2023-10-16T08:52:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbee3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbee40ca550 0x7fbee4070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbee3fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbee40ca550 0x7fbee4070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39872/0 (socket says 172.21.15.94:39872) 2023-10-16T08:52:37.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbee3fff640 1 -- 172.21.15.94:0/54161322 learned_addr learned my addr 172.21.15.94:0/54161322 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:37.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.777+0000 7fbee892c640 1 --2- 172.21.15.94:0/54161322 >> v2:172.21.15.130:3300/0 conn(0x7fbee415a830 0x7fbee40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.778+0000 7fbee3fff640 1 -- 172.21.15.94:0/54161322 >> v2:172.21.15.130:3300/0 conn(0x7fbee415a830 msgr2=0x7fbee40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:37.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.778+0000 7fbee3fff640 1 --2- 172.21.15.94:0/54161322 >> v2:172.21.15.130:3300/0 conn(0x7fbee415a830 0x7fbee40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.778+0000 7fbee3fff640 1 -- 172.21.15.94:0/54161322 >> v1:172.21.15.94:6789/0 conn(0x7fbee4070860 legacy=0x7fbee415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.778+0000 7fbee3fff640 1 -- 172.21.15.94:0/54161322 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40ce430 con 0x7fbee40ca550 2023-10-16T08:52:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.778+0000 7fbee892c640 1 --2- 172.21.15.94:0/54161322 >> v2:172.21.15.130:3300/0 conn(0x7fbee415a830 0x7fbee40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.779+0000 7fbee3fff640 1 --2- 172.21.15.94:0/54161322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee40ca550 0x7fbee4070320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbee40cf570 tx=0x7fbed002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783af942ee9b19f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:37.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.779+0000 7fbee37fe640 1 -- 172.21.15.94:0/54161322 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0030870 con 0x7fbee40ca550 2023-10-16T08:52:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.779+0000 7fbee37fe640 1 -- 172.21.15.94:0/54161322 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed00309d0 con 0x7fbee40ca550 2023-10-16T08:52:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.779+0000 7fbee37fe640 1 -- 172.21.15.94:0/54161322 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0030d60 con 0x7fbee40ca550 2023-10-16T08:52:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 -- 172.21.15.94:0/54161322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee40ca550 msgr2=0x7fbee4070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 --2- 172.21.15.94:0/54161322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee40ca550 0x7fbee4070320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbee40cf570 tx=0x7fbed002b9b0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 -- 172.21.15.94:0/54161322 shutdown_connections 2023-10-16T08:52:37.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 --2- 172.21.15.94:0/54161322 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee40ca550 0x7fbee4070320 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 --2- 172.21.15.94:0/54161322 >> v2:172.21.15.130:3300/0 conn(0x7fbee415a830 0x7fbee40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 -- 172.21.15.94:0/54161322 >> 172.21.15.94:0/54161322 conn(0x7fbee40b0030 msgr2=0x7fbee40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:37.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 -- 172.21.15.94:0/54161322 shutdown_connections 2023-10-16T08:52:37.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.780+0000 7fbeeab90640 1 -- 172.21.15.94:0/54161322 wait complete. 2023-10-16T08:52:37.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.782+0000 7fbeeab90640 1 Processor -- start 2023-10-16T08:52:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.782+0000 7fbeeab90640 1 -- start start 2023-10-16T08:52:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbeeab90640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 0x7fbee4158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbeeab90640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca550 0x7fbee415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbeeab90640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee415a830 0x7fbee415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.788 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbeeab90640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41efee0 con 0x7fbee4070860 2023-10-16T08:52:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbeeab90640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4159230 con 0x7fbee415a830 2023-10-16T08:52:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbeeab90640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40c86b0 con 0x7fbee40ca550 2023-10-16T08:52:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 0x7fbee4158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 0x7fbee4158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39882/0 (socket says 172.21.15.94:39882) 2023-10-16T08:52:37.789 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 -- 172.21.15.94:0/3016599542 learned_addr learned my addr 172.21.15.94:0/3016599542 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 -- 172.21.15.94:0/3016599542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca550 msgr2=0x7fbee415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca550 0x7fbee415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 -- 172.21.15.94:0/3016599542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee415a830 msgr2=0x7fbee415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee415a830 0x7fbee415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.790 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.783+0000 7fbee892c640 1 -- 172.21.15.94:0/3016599542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00094d0 con 0x7fbee4070860 2023-10-16T08:52:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.784+0000 7fbee892c640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 0x7fbee4158cf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c7f0 tx=0x7fbed800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.784+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8007820 con 0x7fbee4070860 2023-10-16T08:52:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.784+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8007980 con 0x7fbee4070860 2023-10-16T08:52:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.784+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee40c8990 con 0x7fbee4070860 2023-10-16T08:52:37.791 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.784+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8007cf0 con 0x7fbee4070860 2023-10-16T08:52:37.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.784+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee40c8f50 con 0x7fbee4070860 2023-10-16T08:52:37.792 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.785+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee4073ef0 con 0x7fbee4070860 2023-10-16T08:52:37.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.787+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbed80113f0 con 0x7fbee4070860 2023-10-16T08:52:37.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.788+0000 7fbee17fa640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbec806ae70 0x7fbec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:37.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.788+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbed8089cf0 con 0x7fbee4070860 2023-10-16T08:52:37.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.788+0000 7fbee3fff640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbec806ae70 0x7fbec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:37.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.789+0000 7fbee3fff640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbec806ae70 0x7fbec806d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbed0036000 tx=0x7fbed003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:37.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.793+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbed80549d0 con 0x7fbee4070860 2023-10-16T08:52:37.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.979+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbee40c1d90 con 0x7fbee4070860 2023-10-16T08:52:37.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.980+0000 7fbee17fa640 1 -- 172.21.15.94:0/3016599542 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbed801f0a0 con 0x7fbee4070860 2023-10-16T08:52:37.983 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:37.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbec806ae70 msgr2=0x7fbec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbec806ae70 0x7fbec806d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbed0036000 tx=0x7fbed003b040 comp rx=0 tx=0).stop 2023-10-16T08:52:37.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 msgr2=0x7fbee4158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:37.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 0x7fbee4158cf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c7f0 tx=0x7fbed800ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 shutdown_connections 2023-10-16T08:52:37.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbec806ae70 0x7fbec806d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbee415a830 0x7fbee415d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbee40ca550 0x7fbee415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 --2- 172.21.15.94:0/3016599542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbee4070860 0x7fbee4158cf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:37.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 >> 172.21.15.94:0/3016599542 conn(0x7fbee40b0030 msgr2=0x7fbee40b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:37.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 shutdown_connections 2023-10-16T08:52:37.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:37.983+0000 7fbeeab90640 1 -- 172.21.15.94:0/3016599542 wait complete. 2023-10-16T08:52:38.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:38.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.204+0000 7f7d60f3c640 1 Processor -- start 2023-10-16T08:52:38.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.204+0000 7f7d60f3c640 1 -- start start 2023-10-16T08:52:38.207 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.205+0000 7f7d60f3c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d5c15cbf0 0x7f7d5c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.205+0000 7f7d60f3c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d5c0b8400 0x7f7d5c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.205+0000 7f7d60f3c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c15cfd0 con 0x7f7d5c0b4410 2023-10-16T08:52:38.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.205+0000 7f7d60f3c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0d0dc0 con 0x7f7d5c15cbf0 2023-10-16T08:52:38.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.205+0000 7f7d60f3c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0d30b0 con 0x7f7d5c0b8400 2023-10-16T08:52:38.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d5c15cbf0 0x7f7d5c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7d5c15cbf0 0x7f7d5c0d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39888/0 (socket says 172.21.15.94:39888) 2023-10-16T08:52:38.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 -- 172.21.15.94:0/300557203 learned_addr learned my addr 172.21.15.94:0/300557203 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:38.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d59d9b640 1 --2- 172.21.15.94:0/300557203 >> v2:172.21.15.130:3300/0 conn(0x7f7d5c0b8400 0x7f7d5c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 -- 172.21.15.94:0/300557203 >> v2:172.21.15.130:3300/0 conn(0x7f7d5c0b8400 msgr2=0x7f7d5c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:38.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 --2- 172.21.15.94:0/300557203 >> v2:172.21.15.130:3300/0 conn(0x7f7d5c0b8400 0x7f7d5c0d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 -- 172.21.15.94:0/300557203 >> v1:172.21.15.130:6789/0 conn(0x7f7d5c0b4410 legacy=0x7f7d5c0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:38.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.206+0000 7f7d5a59c640 1 -- 172.21.15.94:0/300557203 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0d0700 con 0x7f7d5c15cbf0 2023-10-16T08:52:38.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.207+0000 7f7d5a59c640 1 --2- 172.21.15.94:0/300557203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c0d29d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c06c040 tx=0x7f7d4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf6ca1448c16463 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:38.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.207+0000 7f7d5959a640 1 -- 172.21.15.94:0/300557203 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44031870 con 0x7f7d5c15cbf0 2023-10-16T08:52:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d5959a640 1 -- 172.21.15.94:0/300557203 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440319d0 con 0x7f7d5c15cbf0 2023-10-16T08:52:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d5959a640 1 -- 172.21.15.94:0/300557203 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44031d60 con 0x7f7d5c15cbf0 2023-10-16T08:52:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d60f3c640 1 -- 172.21.15.94:0/300557203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c15cbf0 msgr2=0x7f7d5c0d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/300557203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c0d29d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c06c040 tx=0x7f7d4402b910 comp rx=0 tx=0).stop 2023-10-16T08:52:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d60f3c640 1 -- 172.21.15.94:0/300557203 shutdown_connections 2023-10-16T08:52:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/300557203 >> v2:172.21.15.130:3300/0 conn(0x7f7d5c0b8400 0x7f7d5c0d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/300557203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c0d29d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.208+0000 7f7d60f3c640 1 -- 172.21.15.94:0/300557203 >> 172.21.15.94:0/300557203 conn(0x7f7d5c071900 msgr2=0x7f7d5c071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.209+0000 7f7d60f3c640 1 -- 172.21.15.94:0/300557203 shutdown_connections 2023-10-16T08:52:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.209+0000 7f7d60f3c640 1 -- 172.21.15.94:0/300557203 wait complete. 2023-10-16T08:52:38.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.210+0000 7f7d60f3c640 1 Processor -- start 2023-10-16T08:52:38.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.210+0000 7f7d60f3c640 1 -- start start 2023-10-16T08:52:38.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.211+0000 7f7d60f3c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 0x7f7d5c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.211+0000 7f7d60f3c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d5c0b8400 0x7f7d5c0a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.211+0000 7f7d60f3c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.211+0000 7f7d60f3c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c6670 con 0x7f7d5c0b4410 2023-10-16T08:52:38.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.211+0000 7f7d60f3c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c15ec30 con 0x7f7d5c15cbf0 2023-10-16T08:52:38.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.211+0000 7f7d60f3c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c15fbb0 con 0x7f7d5c0b8400 2023-10-16T08:52:38.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 0x7f7d5c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.217 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 0x7f7d5c15f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39900/0 (socket says 172.21.15.94:39900) 2023-10-16T08:52:38.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 -- 172.21.15.94:0/3028821912 learned_addr learned my addr 172.21.15.94:0/3028821912 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:38.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d59d9b640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d5c0b8400 0x7f7d5c0a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 -- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d5c0b8400 msgr2=0x7f7d5c0a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d5c0b8400 0x7f7d5c0a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 -- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d5c15cbf0 msgr2=0x7f7d5c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5ad9d640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 -- 172.21.15.94:0/3028821912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440094d0 con 0x7f7d5c0b4410 2023-10-16T08:52:38.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5ad9d640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:38.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.212+0000 7f7d5a59c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 0x7f7d5c15f670 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7d4402b950 tx=0x7f7d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:38.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.213+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44031840 con 0x7f7d5c0b4410 2023-10-16T08:52:38.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.213+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440443f0 con 0x7f7d5c0b4410 2023-10-16T08:52:38.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.213+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440447a0 con 0x7f7d5c0b4410 2023-10-16T08:52:38.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.213+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0c6880 con 0x7f7d5c0b4410 2023-10-16T08:52:38.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.213+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c15ee70 con 0x7f7d5c0b4410 2023-10-16T08:52:38.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.214+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c073ef0 con 0x7f7d5c0b4410 2023-10-16T08:52:38.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.215+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7d44044900 con 0x7f7d5c0b4410 2023-10-16T08:52:38.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.216+0000 7f7d52ffd640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d3c06ae70 0x7f7d3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.216+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d4402d040 con 0x7f7d5c0b4410 2023-10-16T08:52:38.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.216+0000 7f7d59d9b640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d3c06ae70 0x7f7d3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.217+0000 7f7d59d9b640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d3c06ae70 0x7f7d3c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0cc4d0 tx=0x7f7d4c008440 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:38.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.220+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d44077050 con 0x7f7d5c0b4410 2023-10-16T08:52:38.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.409+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7d5c0b2c00 con 0x7f7d5c0b4410 2023-10-16T08:52:38.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.410+0000 7f7d52ffd640 1 -- 172.21.15.94:0/3028821912 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7d4407a670 con 0x7f7d5c0b4410 2023-10-16T08:52:38.412 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:38.414 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d3c06ae70 msgr2=0x7f7d3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.414 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d3c06ae70 0x7f7d3c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0cc4d0 tx=0x7f7d4c008440 comp rx=0 tx=0).stop 2023-10-16T08:52:38.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 msgr2=0x7f7d5c15f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 0x7f7d5c15f670 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7d4402b950 tx=0x7f7d440046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 shutdown_connections 2023-10-16T08:52:38.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f7d3c06ae70 0x7f7d3c06d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d5c15cbf0 0x7f7d5c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d5c0b8400 0x7f7d5c0a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 --2- 172.21.15.94:0/3028821912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7d5c0b4410 0x7f7d5c15f670 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 >> 172.21.15.94:0/3028821912 conn(0x7f7d5c071900 msgr2=0x7f7d5c15bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:38.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.412+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 shutdown_connections 2023-10-16T08:52:38.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.413+0000 7f7d60f3c640 1 -- 172.21.15.94:0/3028821912 wait complete. 2023-10-16T08:52:38.433 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:38.641 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.639+0000 7f36e4ec2640 1 Processor -- start 2023-10-16T08:52:38.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.640+0000 7f36e4ec2640 1 -- start start 2023-10-16T08:52:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.641+0000 7f36e4ec2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f36e015a740 0x7f36e00c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.641+0000 7f36e4ec2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e0069de0 0x7f36e00c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.641+0000 7f36e4ec2640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e006af90 con 0x7f36e015e370 2023-10-16T08:52:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.641+0000 7f36e4ec2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e006a380 con 0x7f36e015a740 2023-10-16T08:52:38.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.641+0000 7f36e4ec2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e006a660 con 0x7f36e0069de0 2023-10-16T08:52:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.642+0000 7f36de59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f36e015a740 0x7f36e00c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.642+0000 7f36de59c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f36e015a740 0x7f36e00c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:39200/0 (socket says 172.21.15.94:39200) 2023-10-16T08:52:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.642+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e0069de0 0x7f36e00c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.642+0000 7f36de59c640 1 -- 172.21.15.94:0/1041682638 learned_addr learned my addr 172.21.15.94:0/1041682638 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.643+0000 7f36de59c640 1 -- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e0069de0 msgr2=0x7f36e00c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:38.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.643+0000 7f36de59c640 1 --2- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e0069de0 0x7f36e00c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.643+0000 7f36de59c640 1 -- 172.21.15.94:0/1041682638 >> v1:172.21.15.130:6789/0 conn(0x7f36e015e370 legacy=0x7f36e006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.643+0000 7f36de59c640 1 -- 172.21.15.94:0/1041682638 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e006a940 con 0x7f36e015a740 2023-10-16T08:52:38.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.643+0000 7f36ded9d640 1 --2- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e0069de0 0x7f36e00c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:52:38.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.644+0000 7f36de59c640 1 --2- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e015a740 0x7f36e00c3c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009e50 tx=0x7f36d002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9979aee5a1b1fef server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36dd59a640 1 -- 172.21.15.94:0/1041682638 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d002cb00 con 0x7f36e015a740 2023-10-16T08:52:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36dd59a640 1 -- 172.21.15.94:0/1041682638 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d002cc60 con 0x7f36e015a740 2023-10-16T08:52:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36dd59a640 1 -- 172.21.15.94:0/1041682638 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00343f0 con 0x7f36e015a740 2023-10-16T08:52:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e015a740 msgr2=0x7f36e00c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e015a740 0x7f36e00c3c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009e50 tx=0x7f36d002bf60 comp rx=0 tx=0).stop 2023-10-16T08:52:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1041682638 shutdown_connections 2023-10-16T08:52:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e0069de0 0x7f36e00c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1041682638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e015a740 0x7f36e00c3c90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.645+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1041682638 >> 172.21.15.94:0/1041682638 conn(0x7f36e00cb830 msgr2=0x7f36e00cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:38.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.646+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1041682638 shutdown_connections 2023-10-16T08:52:38.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.646+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1041682638 wait complete. 2023-10-16T08:52:38.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.648+0000 7f36e4ec2640 1 Processor -- start 2023-10-16T08:52:38.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.648+0000 7f36e4ec2640 1 -- start start 2023-10-16T08:52:38.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36e4ec2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e0069de0 0x7f36e00b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36e4ec2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e015a740 0x7f36e00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36e4ec2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 0x7f36e014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36e4ec2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01f2e30 con 0x7f36e015e370 2023-10-16T08:52:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36e4ec2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01f3090 con 0x7f36e0069de0 2023-10-16T08:52:38.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36e4ec2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01f3350 con 0x7f36e015a740 2023-10-16T08:52:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 0x7f36e014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36ded9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 0x7f36e014e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39908/0 (socket says 172.21.15.94:39908) 2023-10-16T08:52:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.649+0000 7f36ded9d640 1 -- 172.21.15.94:0/1669303966 learned_addr learned my addr 172.21.15.94:0/1669303966 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ddd9b640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e015a740 0x7f36e00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.655 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36de59c640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e0069de0 0x7f36e00b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ded9d640 1 -- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e015a740 msgr2=0x7f36e00ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ded9d640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e015a740 0x7f36e00ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ded9d640 1 -- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e0069de0 msgr2=0x7f36e00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.656 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ded9d640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e0069de0 0x7f36e00b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ded9d640 1 -- 172.21.15.94:0/1669303966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8009400 con 0x7f36e015e370 2023-10-16T08:52:38.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36de59c640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e0069de0 0x7f36e00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:38.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ddd9b640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e015a740 0x7f36e00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:38.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36ded9d640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 0x7f36e014e210 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e930 tx=0x7f36d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:38.657 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.650+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8009700 con 0x7f36e015e370 2023-10-16T08:52:38.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.651+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d800ca00 con 0x7f36e015e370 2023-10-16T08:52:38.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.651+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800cd90 con 0x7f36e015e370 2023-10-16T08:52:38.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.651+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d0009b30 con 0x7f36e015e370 2023-10-16T08:52:38.658 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.651+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e01f3910 con 0x7f36e015e370 2023-10-16T08:52:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.652+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e00c4150 con 0x7f36e015e370 2023-10-16T08:52:38.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.653+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36d8013470 con 0x7f36e015e370 2023-10-16T08:52:38.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.653+0000 7f36d6ffd640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f36c006aea0 0x7f36c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:38.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.654+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36d8089630 con 0x7f36e015e370 2023-10-16T08:52:38.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.654+0000 7f36de59c640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f36c006aea0 0x7f36c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:38.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.654+0000 7f36de59c640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f36c006aea0 0x7f36c006d360 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f36d0035000 tx=0x7f36d0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:38.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.658+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36d8054340 con 0x7f36e015e370 2023-10-16T08:52:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.847+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f36e00b07d0 con 0x7f36e015e370 2023-10-16T08:52:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.848+0000 7f36d6ffd640 1 -- 172.21.15.94:0/1669303966 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f36d8057960 con 0x7f36e015e370 2023-10-16T08:52:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.850+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f36c006aea0 msgr2=0x7f36c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.850+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f36c006aea0 0x7f36c006d360 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f36d0035000 tx=0x7f36d0030000 comp rx=0 tx=0).stop 2023-10-16T08:52:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.850+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 msgr2=0x7f36e014e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.850+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 0x7f36e014e210 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e930 tx=0x7f36d800edf0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 shutdown_connections 2023-10-16T08:52:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36e015e370 0x7f36e014e210 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36e015a740 0x7f36e00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f36c006aea0 0x7f36c006d360 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 --2- 172.21.15.94:0/1669303966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36e0069de0 0x7f36e00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:38.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 >> 172.21.15.94:0/1669303966 conn(0x7f36e00cb830 msgr2=0x7f36e00b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:38.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 shutdown_connections 2023-10-16T08:52:38.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:38.851+0000 7f36e4ec2640 1 -- 172.21.15.94:0/1669303966 wait complete. 2023-10-16T08:52:38.871 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2023-10-16T08:52:38.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:38.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-16T08:52:38.982 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:52:38.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:52:38.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:38.983 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T08:52:39.039 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:52:39.040 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:39.097 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:52:39.098 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:39.150 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:39.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.410+0000 7fb81d325640 1 Processor -- start 2023-10-16T08:52:39.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.411+0000 7fb81d325640 1 -- start start 2023-10-16T08:52:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.412+0000 7fb81d325640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb81815ad00 0x7fb8180701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb81d325640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180707f0 con 0x7fb81815f040 2023-10-16T08:52:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb81d325640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb818070ad0 con 0x7fb8180b0010 2023-10-16T08:52:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb81d325640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81815b1d0 con 0x7fb81815ad00 2023-10-16T08:52:39.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb80e7fc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb81815ad00 0x7fb8180701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb8177fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb81815f040 0x7fb81815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56464/0 (socket says 172.21.15.94:56464) 2023-10-16T08:52:39.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb8177fe640 1 -- 172.21.15.94:0/1953467154 learned_addr learned my addr 172.21.15.94:0/1953467154 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:39.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb80e7fc640 1 -- 172.21.15.94:0/1953467154 >> v1:172.21.15.130:6789/0 conn(0x7fb8180b0010 legacy=0x7fb8180b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:39.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb80e7fc640 1 -- 172.21.15.94:0/1953467154 >> v1:172.21.15.94:6789/0 conn(0x7fb81815f040 legacy=0x7fb81815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb80e7fc640 1 -- 172.21.15.94:0/1953467154 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81815b4b0 con 0x7fb81815ad00 2023-10-16T08:52:39.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.413+0000 7fb8167fc640 1 -- 172.21.15.94:0/1953467154 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492066841 0 0) 0x7fb8180707f0 con 0x7fb81815f040 2023-10-16T08:52:39.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.415+0000 7fb80e7fc640 1 --2- 172.21.15.94:0/1953467154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb81815ad00 0x7fb8180701a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb8000097a0 tx=0x7fb80002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ce4a84f5c7639d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:39.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.415+0000 7fb8167fc640 1 -- 172.21.15.94:0/1953467154 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800031830 con 0x7fb81815ad00 2023-10-16T08:52:39.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.415+0000 7fb8167fc640 1 -- 172.21.15.94:0/1953467154 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800031990 con 0x7fb81815ad00 2023-10-16T08:52:39.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.415+0000 7fb8167fc640 1 -- 172.21.15.94:0/1953467154 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800031d20 con 0x7fb81815ad00 2023-10-16T08:52:39.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 -- 172.21.15.94:0/1953467154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb81815ad00 msgr2=0x7fb8180701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 --2- 172.21.15.94:0/1953467154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb81815ad00 0x7fb8180701a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb8000097a0 tx=0x7fb80002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 -- 172.21.15.94:0/1953467154 shutdown_connections 2023-10-16T08:52:39.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 --2- 172.21.15.94:0/1953467154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb81815ad00 0x7fb8180701a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 -- 172.21.15.94:0/1953467154 >> 172.21.15.94:0/1953467154 conn(0x7fb81806c1c0 msgr2=0x7fb81806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:39.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 -- 172.21.15.94:0/1953467154 shutdown_connections 2023-10-16T08:52:39.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.416+0000 7fb81d325640 1 -- 172.21.15.94:0/1953467154 wait complete. 2023-10-16T08:52:39.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.418+0000 7fb81d325640 1 Processor -- start 2023-10-16T08:52:39.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.418+0000 7fb81d325640 1 -- start start 2023-10-16T08:52:39.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb81d325640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 0x7fb8180c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb81d325640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb81815ad00 0x7fb8181579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb81d325640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb81815f040 0x7fb818158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb81d325640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180ccf80 con 0x7fb8180b0010 2023-10-16T08:52:39.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb81d325640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180c6a40 con 0x7fb81815f040 2023-10-16T08:52:39.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb81d325640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180cc300 con 0x7fb81815ad00 2023-10-16T08:52:39.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 0x7fb8180c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 0x7fb8180c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39926/0 (socket says 172.21.15.94:39926) 2023-10-16T08:52:39.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 -- 172.21.15.94:0/1188097926 learned_addr learned my addr 172.21.15.94:0/1188097926 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:39.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 -- 172.21.15.94:0/1188097926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb81815ad00 msgr2=0x7fb8181579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb81815ad00 0x7fb8181579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 -- 172.21.15.94:0/1188097926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb81815f040 msgr2=0x7fb818158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb81815f040 0x7fb818158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.419+0000 7fb816ffd640 1 -- 172.21.15.94:0/1188097926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009400 con 0x7fb8180b0010 2023-10-16T08:52:39.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.420+0000 7fb816ffd640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 0x7fb8180c6500 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c7c0 tx=0x7fb80800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:39.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.420+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800aa50 con 0x7fb8180b0010 2023-10-16T08:52:39.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.420+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800abb0 con 0x7fb8180b0010 2023-10-16T08:52:39.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.420+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808012420 con 0x7fb8180b0010 2023-10-16T08:52:39.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.420+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8180cc5e0 con 0x7fb8180b0010 2023-10-16T08:52:39.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.420+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8180ccba0 con 0x7fb8180b0010 2023-10-16T08:52:39.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.421+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818073ef0 con 0x7fb8180b0010 2023-10-16T08:52:39.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.422+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb808012580 con 0x7fb8180b0010 2023-10-16T08:52:39.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.423+0000 7fb80ffff640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb7f806ae70 0x7fb7f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.423+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb808089950 con 0x7fb8180b0010 2023-10-16T08:52:39.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.423+0000 7fb80e7fc640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb7f806ae70 0x7fb7f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.424+0000 7fb80e7fc640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb7f806ae70 0x7fb7f806d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb800036000 tx=0x7fb800030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:39.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.427+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb808054630 con 0x7fb8180b0010 2023-10-16T08:52:39.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.621+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb81815c0b0 con 0x7fb8180b0010 2023-10-16T08:52:39.626 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.624+0000 7fb80ffff640 1 -- 172.21.15.94:0/1188097926 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7fb808057c50 con 0x7fb8180b0010 2023-10-16T08:52:39.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:39.627 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:39.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb7f806ae70 msgr2=0x7fb7f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb7f806ae70 0x7fb7f806d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb800036000 tx=0x7fb800030000 comp rx=0 tx=0).stop 2023-10-16T08:52:39.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 msgr2=0x7fb8180c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 0x7fb8180c6500 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c7c0 tx=0x7fb80800cc80 comp rx=0 tx=0).stop 2023-10-16T08:52:39.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 shutdown_connections 2023-10-16T08:52:39.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb7f806ae70 0x7fb7f806d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb81815f040 0x7fb818158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb81815ad00 0x7fb8181579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 --2- 172.21.15.94:0/1188097926 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8180b0010 0x7fb8180c6500 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 >> 172.21.15.94:0/1188097926 conn(0x7fb81806c1c0 msgr2=0x7fb8180acc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:39.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 shutdown_connections 2023-10-16T08:52:39.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.627+0000 7fb81d325640 1 -- 172.21.15.94:0/1188097926 wait complete. 2023-10-16T08:52:39.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:39.649 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.860+0000 7f7390ec2640 1 Processor -- start 2023-10-16T08:52:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.861+0000 7f7390ec2640 1 -- start start 2023-10-16T08:52:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f7390ec2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c15a830 0x7f738c0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f7390ec2640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f738c070a30 0x7f738c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f7390ec2640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c0cf040 con 0x7f738c0ca550 2023-10-16T08:52:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f7390ec2640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0ce430 con 0x7f738c070a30 2023-10-16T08:52:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f7390ec2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ce710 con 0x7f738c15a830 2023-10-16T08:52:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f738ad9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f738c070a30 0x7f738c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f738ad9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f738c070a30 0x7f738c0c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39938/0 (socket says 172.21.15.94:39938) 2023-10-16T08:52:39.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.862+0000 7f738ad9d640 1 -- 172.21.15.94:0/1196794150 learned_addr learned my addr 172.21.15.94:0/1196794150 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.863+0000 7f738a59c640 1 --2- 172.21.15.94:0/1196794150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c15a830 0x7f738c0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.863+0000 7f738ad9d640 1 -- 172.21.15.94:0/1196794150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c15a830 msgr2=0x7f738c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.863+0000 7f738ad9d640 1 --2- 172.21.15.94:0/1196794150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c15a830 0x7f738c0cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.863+0000 7f738ad9d640 1 -- 172.21.15.94:0/1196794150 >> v1:172.21.15.94:6789/0 conn(0x7f738c0ca550 legacy=0x7f738c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.863+0000 7f738ad9d640 1 -- 172.21.15.94:0/1196794150 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0ce9f0 con 0x7f738c070a30 2023-10-16T08:52:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.864+0000 7f738ad9d640 1 --2- 172.21.15.94:0/1196794150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c070a30 0x7f738c0c8b50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7384009e50 tx=0x7f738402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748d9c1827d126bc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:39.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.864+0000 7f7389d9b640 1 -- 172.21.15.94:0/1196794150 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738402cb00 con 0x7f738c070a30 2023-10-16T08:52:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.864+0000 7f7389d9b640 1 -- 172.21.15.94:0/1196794150 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738402cc60 con 0x7f738c070a30 2023-10-16T08:52:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.864+0000 7f7389d9b640 1 -- 172.21.15.94:0/1196794150 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840343f0 con 0x7f738c070a30 2023-10-16T08:52:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 -- 172.21.15.94:0/1196794150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c070a30 msgr2=0x7f738c0c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 --2- 172.21.15.94:0/1196794150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c070a30 0x7f738c0c8b50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7384009e50 tx=0x7f738402bf60 comp rx=0 tx=0).stop 2023-10-16T08:52:39.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 -- 172.21.15.94:0/1196794150 shutdown_connections 2023-10-16T08:52:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 --2- 172.21.15.94:0/1196794150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c070a30 0x7f738c0c8b50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 --2- 172.21.15.94:0/1196794150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c15a830 0x7f738c0cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 -- 172.21.15.94:0/1196794150 >> 172.21.15.94:0/1196794150 conn(0x7f738c0b0030 msgr2=0x7f738c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 -- 172.21.15.94:0/1196794150 shutdown_connections 2023-10-16T08:52:39.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.865+0000 7f7390ec2640 1 -- 172.21.15.94:0/1196794150 wait complete. 2023-10-16T08:52:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.867+0000 7f7390ec2640 1 Processor -- start 2023-10-16T08:52:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.867+0000 7f7390ec2640 1 -- start start 2023-10-16T08:52:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7390ec2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c070a30 0x7f738c0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7390ec2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 0x7f738c0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7390ec2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15a830 0x7f738c1f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7390ec2640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c1f3390 con 0x7f738c0ca550 2023-10-16T08:52:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7390ec2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ac310 con 0x7f738c15a830 2023-10-16T08:52:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7390ec2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c148270 con 0x7f738c070a30 2023-10-16T08:52:39.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7383fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 0x7f738c0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7383fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 0x7f738c0c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39954/0 (socket says 172.21.15.94:39954) 2023-10-16T08:52:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7383fff640 1 -- 172.21.15.94:0/3770611295 learned_addr learned my addr 172.21.15.94:0/3770611295 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f7383fff640 1 -- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c070a30 msgr2=0x7f738c0c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.868+0000 7f738a59c640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c070a30 0x7f738c0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f738ad9d640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15a830 0x7f738c1f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7383fff640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c070a30 0x7f738c0c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7383fff640 1 -- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15a830 msgr2=0x7f738c1f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:39.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7383fff640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15a830 0x7f738c1f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:39.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7383fff640 1 -- 172.21.15.94:0/3770611295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009b30 con 0x7f738c0ca550 2023-10-16T08:52:39.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7383fff640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 0x7f738c0c5b10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f737400c450 tx=0x7f737400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:39.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740052d0 con 0x7f738c0ca550 2023-10-16T08:52:39.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7374005430 con 0x7f738c0ca550 2023-10-16T08:52:39.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c0ab9e0 con 0x7f738c0ca550 2023-10-16T08:52:39.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374012870 con 0x7f738c0ca550 2023-10-16T08:52:39.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.869+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c0abfa0 con 0x7f738c0ca550 2023-10-16T08:52:39.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.870+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0c8780 con 0x7f738c0ca550 2023-10-16T08:52:39.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.871+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f73740129d0 con 0x7f738c0ca550 2023-10-16T08:52:39.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.872+0000 7f7382ffd640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f736c06ae70 0x7f736c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:39.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.872+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7374089510 con 0x7f738c0ca550 2023-10-16T08:52:39.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.873+0000 7f738a59c640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f736c06ae70 0x7f736c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:39.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.873+0000 7f738a59c640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f736c06ae70 0x7f736c06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:39.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:39.877+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7374054200 con 0x7f738c0ca550 2023-10-16T08:52:40.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.067+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f738c073ef0 con 0x7f738c0ca550 2023-10-16T08:52:40.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.067+0000 7f7382ffd640 1 -- 172.21.15.94:0/3770611295 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7374057820 con 0x7f738c0ca550 2023-10-16T08:52:40.070 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:40.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f736c06ae70 msgr2=0x7f736c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f736c06ae70 0x7f736c06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c008040 comp rx=0 tx=0).stop 2023-10-16T08:52:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 msgr2=0x7f738c0c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 0x7f738c0c5b10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f737400c450 tx=0x7f737400c910 comp rx=0 tx=0).stop 2023-10-16T08:52:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 shutdown_connections 2023-10-16T08:52:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f736c06ae70 0x7f736c06d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c15a830 0x7f738c1f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f738c0ca550 0x7f738c0c5b10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 --2- 172.21.15.94:0/3770611295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f738c070a30 0x7f738c0c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 >> 172.21.15.94:0/3770611295 conn(0x7f738c0b0030 msgr2=0x7f738c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:40.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.070+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 shutdown_connections 2023-10-16T08:52:40.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.071+0000 7f7390ec2640 1 -- 172.21.15.94:0/3770611295 wait complete. 2023-10-16T08:52:40.094 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:40.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.310+0000 7f00329d0640 1 Processor -- start 2023-10-16T08:52:40.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.310+0000 7f00329d0640 1 -- start start 2023-10-16T08:52:40.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.311+0000 7f00329d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.311+0000 7f00329d0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f002c0ca550 0x7f002c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.311+0000 7f00329d0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c0cf040 con 0x7f002c15a830 2023-10-16T08:52:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.311+0000 7f00329d0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0ca9e0 con 0x7f002c0ca550 2023-10-16T08:52:40.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.311+0000 7f00329d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0ce430 con 0x7f002c070a30 2023-10-16T08:52:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.312+0000 7f0030f6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f002c0ca550 0x7f002c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.312+0000 7f002b7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.312+0000 7f002bfff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f002c15a830 0x7f002c070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:57058/0 (socket says 172.21.15.94:57058) 2023-10-16T08:52:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.312+0000 7f0030f6d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f002c0ca550 0x7f002c0c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:39240/0 (socket says 172.21.15.94:39240) 2023-10-16T08:52:40.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.312+0000 7f002bfff640 1 -- 172.21.15.94:0/3276140100 learned_addr learned my addr 172.21.15.94:0/3276140100 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:40.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.313+0000 7f0030f6d640 1 -- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 msgr2=0x7f002c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:40.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.313+0000 7f0030f6d640 1 --2- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c0cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.313+0000 7f0030f6d640 1 -- 172.21.15.94:0/3276140100 >> v1:172.21.15.130:6789/0 conn(0x7f002c15a830 legacy=0x7f002c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.313+0000 7f0030f6d640 1 -- 172.21.15.94:0/3276140100 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c0ce710 con 0x7f002c0ca550 2023-10-16T08:52:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.314+0000 7f0030f6d640 1 --2- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0ca550 0x7f002c0c8b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0024009d90 tx=0x7f002402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa619d953403ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.315+0000 7f002affd640 1 -- 172.21.15.94:0/3276140100 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002402cc50 con 0x7f002c0ca550 2023-10-16T08:52:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.315+0000 7f002affd640 1 -- 172.21.15.94:0/3276140100 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002402cdb0 con 0x7f002c0ca550 2023-10-16T08:52:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.315+0000 7f002affd640 1 -- 172.21.15.94:0/3276140100 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024034660 con 0x7f002c0ca550 2023-10-16T08:52:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 -- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0ca550 msgr2=0x7f002c0c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 --2- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0ca550 0x7f002c0c8b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0024009d90 tx=0x7f002402bea0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 -- 172.21.15.94:0/3276140100 shutdown_connections 2023-10-16T08:52:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 --2- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0ca550 0x7f002c0c8b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 --2- 172.21.15.94:0/3276140100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c0cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 -- 172.21.15.94:0/3276140100 >> 172.21.15.94:0/3276140100 conn(0x7f002c0b0030 msgr2=0x7f002c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 -- 172.21.15.94:0/3276140100 shutdown_connections 2023-10-16T08:52:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.316+0000 7f00329d0640 1 -- 172.21.15.94:0/3276140100 wait complete. 2023-10-16T08:52:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.318+0000 7f00329d0640 1 Processor -- start 2023-10-16T08:52:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.318+0000 7f00329d0640 1 -- start start 2023-10-16T08:52:40.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f00329d0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f00329d0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 0x7f002c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f00329d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c15a830 0x7f002c14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f00329d0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0c6f80 con 0x7f002c0ca550 2023-10-16T08:52:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f00329d0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0c9c70 con 0x7f002c15a830 2023-10-16T08:52:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f00329d0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0c6300 con 0x7f002c070a30 2023-10-16T08:52:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 0x7f002c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 0x7f002c14f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39966/0 (socket says 172.21.15.94:39966) 2023-10-16T08:52:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 -- 172.21.15.94:0/655750745 learned_addr learned my addr 172.21.15.94:0/655750745 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002bfff640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 -- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 msgr2=0x7f002c14c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c14c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 -- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c15a830 msgr2=0x7f002c14fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c15a830 0x7f002c14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.319+0000 7f002b7fe640 1 -- 172.21.15.94:0/655750745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009a70 con 0x7f002c0ca550 2023-10-16T08:52:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.320+0000 7f002b7fe640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 0x7f002c14f940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f002000e9b0 tx=0x7f002000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.320+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020009670 con 0x7f002c0ca550 2023-10-16T08:52:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.320+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002000c9a0 con 0x7f002c0ca550 2023-10-16T08:52:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.320+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002000cd50 con 0x7f002c0ca550 2023-10-16T08:52:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.320+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c0c65e0 con 0x7f002c0ca550 2023-10-16T08:52:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.320+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c0c6ba0 con 0x7f002c0ca550 2023-10-16T08:52:40.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.321+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c073ef0 con 0x7f002c0ca550 2023-10-16T08:52:40.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.322+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0020013470 con 0x7f002c0ca550 2023-10-16T08:52:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.323+0000 7f0028ff9640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f001806ae70 0x7f001806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.323+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0020089c90 con 0x7f002c0ca550 2023-10-16T08:52:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.323+0000 7f002bfff640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f001806ae70 0x7f001806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.324+0000 7f002bfff640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f001806ae70 0x7f001806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f001c000f60 tx=0x7f001c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:40.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.327+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0020054970 con 0x7f002c0ca550 2023-10-16T08:52:40.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.516+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f002c0ce9c0 con 0x7f002c0ca550 2023-10-16T08:52:40.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.517+0000 7f0028ff9640 1 -- 172.21.15.94:0/655750745 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0020017020 con 0x7f002c0ca550 2023-10-16T08:52:40.519 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:40.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f001806ae70 msgr2=0x7f001806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f001806ae70 0x7f001806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f001c000f60 tx=0x7f001c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:40.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 msgr2=0x7f002c14f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 0x7f002c14f940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f002000e9b0 tx=0x7f002000ee70 comp rx=0 tx=0).stop 2023-10-16T08:52:40.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 shutdown_connections 2023-10-16T08:52:40.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f001806ae70 0x7f001806d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c15a830 0x7f002c14fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f002c0ca550 0x7f002c14f940 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 --2- 172.21.15.94:0/655750745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c070a30 0x7f002c14c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 >> 172.21.15.94:0/655750745 conn(0x7f002c0b0030 msgr2=0x7f002c0b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:40.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 shutdown_connections 2023-10-16T08:52:40.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.520+0000 7f00329d0640 1 -- 172.21.15.94:0/655750745 wait complete. 2023-10-16T08:52:40.541 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.760+0000 7f1287610640 1 Processor -- start 2023-10-16T08:52:40.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.761+0000 7f1287610640 1 -- start start 2023-10-16T08:52:40.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.762+0000 7f1287610640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 0x7f1280071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.762+0000 7f1287610640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f12800ca570 0x7f128015db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.762+0000 7f1287610640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1280072480 con 0x7f12800ca110 2023-10-16T08:52:40.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.762+0000 7f1287610640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12800cd0c0 con 0x7f12800ca570 2023-10-16T08:52:40.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.762+0000 7f1287610640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12800cc540 con 0x7f1280159890 2023-10-16T08:52:40.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f1284bab640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f12800ca110 0x7f128015d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56484/0 (socket says 172.21.15.94:56484) 2023-10-16T08:52:40.765 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f1284bab640 1 -- 172.21.15.94:0/1746414604 learned_addr learned my addr 172.21.15.94:0/1746414604 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:40.768 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f12853ac640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 0x7f1280071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f1285bad640 1 --2- 172.21.15.94:0/1746414604 >> v2:172.21.15.130:3300/0 conn(0x7f12800ca570 0x7f128015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637436249 0 0) 0x7f1280072480 con 0x7f12800ca110 2023-10-16T08:52:40.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1268003520 con 0x7f12800ca110 2023-10-16T08:52:40.769 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2579978936 0 0) 0x7f1268003520 con 0x7f12800ca110 2023-10-16T08:52:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 msgr2=0x7f1280071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 0x7f1280071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.770 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 >> v2:172.21.15.130:3300/0 conn(0x7f12800ca570 msgr2=0x7f128015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 --2- 172.21.15.94:0/1746414604 >> v2:172.21.15.130:3300/0 conn(0x7f12800ca570 0x7f128015db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800cc820 con 0x7f12800ca110 2023-10-16T08:52:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.763+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f1274001670 con 0x7f12800ca110 2023-10-16T08:52:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 >> v1:172.21.15.94:6789/0 conn(0x7f12800ca110 legacy=0x7f128015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.771 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1268003970 0x7f1268003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12680047c0 0x7f1268004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 0x7f1268005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12800cd0c0 con 0x7f12680047c0 2023-10-16T08:52:40.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12800cc540 con 0x7f1268003970 2023-10-16T08:52:40.772 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126800dbe0 con 0x7f1280159890 2023-10-16T08:52:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1284bab640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12680047c0 0x7f1268004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1285bad640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 0x7f1268005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f12853ac640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1268003970 0x7f1268003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.773 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1284bab640 1 -- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 msgr2=0x7f1268005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:40.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1284bab640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1280159890 0x7f1268005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1284bab640 1 -- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1268003970 msgr2=0x7f1268003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:40.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1284bab640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1268003970 0x7f1268003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.774 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.764+0000 7f1284bab640 1 -- 172.21.15.94:0/1746414604 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268003520 con 0x7f12680047c0 2023-10-16T08:52:40.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.765+0000 7f1284bab640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12680047c0 0x7f1268004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f127400c110 tx=0x7f12680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81bd00cf38394cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:40.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274005ad0 con 0x7f12680047c0 2023-10-16T08:52:40.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274005c50 con 0x7f12680047c0 2023-10-16T08:52:40.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f127ffff640 1 -- 172.21.15.94:0/1746414604 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127402c830 con 0x7f12680047c0 2023-10-16T08:52:40.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1287610640 1 -- 172.21.15.94:0/1746414604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12680047c0 msgr2=0x7f1268004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1287610640 1 --2- 172.21.15.94:0/1746414604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12680047c0 0x7f1268004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f127400c110 tx=0x7f12680057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1285bad640 1 -- 172.21.15.94:0/1746414604 reap_dead start 2023-10-16T08:52:40.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1287610640 1 -- 172.21.15.94:0/1746414604 shutdown_connections 2023-10-16T08:52:40.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1287610640 1 -- 172.21.15.94:0/1746414604 >> 172.21.15.94:0/1746414604 conn(0x7f12800b0030 msgr2=0x7f12800b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:40.776 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1287610640 1 -- 172.21.15.94:0/1746414604 shutdown_connections 2023-10-16T08:52:40.777 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.766+0000 7f1287610640 1 -- 172.21.15.94:0/1746414604 wait complete. 2023-10-16T08:52:40.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.768+0000 7f1287610640 1 Processor -- start 2023-10-16T08:52:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.768+0000 7f1287610640 1 -- start start 2023-10-16T08:52:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1287610640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12680047c0 0x7f12800accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1287610640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 0x7f12800c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1287610640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12800abad0 0x7f12801496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1287610640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12800c71d0 con 0x7f1280159c70 2023-10-16T08:52:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1287610640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280156f20 con 0x7f12800abad0 2023-10-16T08:52:40.781 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1287610640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12800c6830 con 0x7f12680047c0 2023-10-16T08:52:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.769+0000 7f1284bab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 0x7f12800c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 0x7f12800c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39982/0 (socket says 172.21.15.94:39982) 2023-10-16T08:52:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 -- 172.21.15.94:0/493648128 learned_addr learned my addr 172.21.15.94:0/493648128 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f12853ac640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12680047c0 0x7f12800accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.782 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1285bad640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12800abad0 0x7f12801496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 -- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12680047c0 msgr2=0x7f12800accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12680047c0 0x7f12800accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 -- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12800abad0 msgr2=0x7f12801496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.783 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12800abad0 0x7f12801496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 -- 172.21.15.94:0/493648128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800c6b10 con 0x7f1280159c70 2023-10-16T08:52:40.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.770+0000 7f1284bab640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 0x7f12800c29d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f127400c110 tx=0x7f1274001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:40.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.771+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127403c040 con 0x7f1280159c70 2023-10-16T08:52:40.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.771+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127402cc40 con 0x7f1280159c70 2023-10-16T08:52:40.784 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.771+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12800c6df0 con 0x7f1280159c70 2023-10-16T08:52:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.771+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274007070 con 0x7f1280159c70 2023-10-16T08:52:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.771+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12800ac130 con 0x7f1280159c70 2023-10-16T08:52:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.772+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12800c6970 con 0x7f1280159c70 2023-10-16T08:52:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.773+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1274032070 con 0x7f1280159c70 2023-10-16T08:52:40.785 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.774+0000 7f127dffb640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f126c06aea0 0x7f126c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:40.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.774+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12740aa910 con 0x7f1280159c70 2023-10-16T08:52:40.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.775+0000 7f12853ac640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f126c06aea0 0x7f126c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:40.786 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.775+0000 7f12853ac640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f126c06aea0 0x7f126c06d360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1270006fd0 tx=0x7f1270008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:40.787 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.779+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12800c6970 con 0x7f1280159c70 2023-10-16T08:52:40.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.968+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12800c6970 con 0x7f1280159c70 2023-10-16T08:52:40.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.969+0000 7f127dffb640 1 -- 172.21.15.94:0/493648128 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1274045020 con 0x7f1280159c70 2023-10-16T08:52:40.971 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:40.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f126c06aea0 msgr2=0x7f126c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f126c06aea0 0x7f126c06d360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1270006fd0 tx=0x7f1270008040 comp rx=0 tx=0).stop 2023-10-16T08:52:40.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 msgr2=0x7f12800c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:40.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 0x7f12800c29d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f127400c110 tx=0x7f1274001930 comp rx=0 tx=0).stop 2023-10-16T08:52:40.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 shutdown_connections 2023-10-16T08:52:40.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f126c06aea0 0x7f126c06d360 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12800abad0 0x7f12801496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1280159c70 0x7f12800c29d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 --2- 172.21.15.94:0/493648128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f12680047c0 0x7f12800accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 >> 172.21.15.94:0/493648128 conn(0x7f12800b0030 msgr2=0x7f12800ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 shutdown_connections 2023-10-16T08:52:40.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:40.971+0000 7f1287610640 1 -- 172.21.15.94:0/493648128 wait complete. 2023-10-16T08:52:40.993 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:41.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.204+0000 7fd743cd0640 1 Processor -- start 2023-10-16T08:52:41.207 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.205+0000 7fd743cd0640 1 -- start start 2023-10-16T08:52:41.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.206+0000 7fd743cd0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd73c159890 0x7fd73c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.206+0000 7fd743cd0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c0ca5a0 0x7fd73c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.206+0000 7fd743cd0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c072480 con 0x7fd73c0ca110 2023-10-16T08:52:41.208 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.206+0000 7fd743cd0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0cd0c0 con 0x7fd73c159890 2023-10-16T08:52:41.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.206+0000 7fd743cd0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0caa30 con 0x7fd73c0ca5a0 2023-10-16T08:52:41.209 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.207+0000 7fd74226d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c0ca5a0 0x7fd73c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.207+0000 7fd741a6c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd73c159890 0x7fd73c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.207+0000 7fd741a6c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd73c159890 0x7fd73c071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:39292/0 (socket says 172.21.15.94:39292) 2023-10-16T08:52:41.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.207+0000 7fd741a6c640 1 -- 172.21.15.94:0/4265011516 learned_addr learned my addr 172.21.15.94:0/4265011516 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:41.210 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.207+0000 7fd74226d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c0ca5a0 0x7fd73c15db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:41510/0 (socket says 172.21.15.94:41510) 2023-10-16T08:52:41.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.208+0000 7fd741a6c640 1 -- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c0ca5a0 msgr2=0x7fd73c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:41.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.208+0000 7fd741a6c640 1 --2- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c0ca5a0 0x7fd73c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.208+0000 7fd741a6c640 1 -- 172.21.15.94:0/4265011516 >> v1:172.21.15.130:6789/0 conn(0x7fd73c0ca110 legacy=0x7fd73c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.211 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.208+0000 7fd741a6c640 1 -- 172.21.15.94:0/4265011516 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0cc540 con 0x7fd73c159890 2023-10-16T08:52:41.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.209+0000 7fd741a6c640 1 --2- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c159890 0x7fd73c071f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd738009870 tx=0x7fd73802db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f2fd1ba3c4938 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:41.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.209+0000 7fd740a6a640 1 -- 172.21.15.94:0/4265011516 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73802e940 con 0x7fd73c159890 2023-10-16T08:52:41.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd740a6a640 1 -- 172.21.15.94:0/4265011516 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73802eaa0 con 0x7fd73c159890 2023-10-16T08:52:41.214 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd740a6a640 1 -- 172.21.15.94:0/4265011516 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73802ee30 con 0x7fd73c159890 2023-10-16T08:52:41.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 -- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c159890 msgr2=0x7fd73c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 --2- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c159890 0x7fd73c071f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd738009870 tx=0x7fd73802db90 comp rx=0 tx=0).stop 2023-10-16T08:52:41.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 -- 172.21.15.94:0/4265011516 shutdown_connections 2023-10-16T08:52:41.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 --2- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c0ca5a0 0x7fd73c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.215 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 --2- 172.21.15.94:0/4265011516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c159890 0x7fd73c071f40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 -- 172.21.15.94:0/4265011516 >> 172.21.15.94:0/4265011516 conn(0x7fd73c0b0030 msgr2=0x7fd73c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:41.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 -- 172.21.15.94:0/4265011516 shutdown_connections 2023-10-16T08:52:41.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.210+0000 7fd743cd0640 1 -- 172.21.15.94:0/4265011516 wait complete. 2023-10-16T08:52:41.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.212+0000 7fd743cd0640 1 Processor -- start 2023-10-16T08:52:41.216 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.212+0000 7fd743cd0640 1 -- start start 2023-10-16T08:52:41.218 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.213+0000 7fd743cd0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 0x7fd73c147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.213+0000 7fd743cd0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c0ca5a0 0x7fd73c0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.213+0000 7fd743cd0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c159890 0x7fd73c071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.213+0000 7fd743cd0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c2380 con 0x7fd73c0ca110 2023-10-16T08:52:41.219 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.213+0000 7fd743cd0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c2660 con 0x7fd73c0ca5a0 2023-10-16T08:52:41.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.213+0000 7fd743cd0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c2940 con 0x7fd73c159890 2023-10-16T08:52:41.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 0x7fd73c147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 0x7fd73c147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39984/0 (socket says 172.21.15.94:39984) 2023-10-16T08:52:41.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 -- 172.21.15.94:0/3105027605 learned_addr learned my addr 172.21.15.94:0/3105027605 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:41.220 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd74226d640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c159890 0x7fd73c071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 -- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c159890 msgr2=0x7fd73c071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd74126b640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c0ca5a0 0x7fd73c0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c159890 0x7fd73c071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 -- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c0ca5a0 msgr2=0x7fd73c0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c0ca5a0 0x7fd73c0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.221 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 -- 172.21.15.94:0/3105027605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094d0 con 0x7fd73c0ca110 2023-10-16T08:52:41.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd74126b640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c0ca5a0 0x7fd73c0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:41.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.214+0000 7fd741a6c640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 0x7fd73c147ac0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:41.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.215+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738044070 con 0x7fd73c0ca110 2023-10-16T08:52:41.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.215+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd738040400 con 0x7fd73c0ca110 2023-10-16T08:52:41.222 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.215+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738040790 con 0x7fd73c0ca110 2023-10-16T08:52:41.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.215+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c0c2c20 con 0x7fd73c0ca110 2023-10-16T08:52:41.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.215+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c153d30 con 0x7fd73c0ca110 2023-10-16T08:52:41.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.216+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c0c6cf0 con 0x7fd73c0ca110 2023-10-16T08:52:41.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.217+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd738049410 con 0x7fd73c0ca110 2023-10-16T08:52:41.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.218+0000 7fd7327fc640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd72006ae70 0x7fd72006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.224 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.218+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7380aba30 con 0x7fd73c0ca110 2023-10-16T08:52:41.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.218+0000 7fd74126b640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd72006ae70 0x7fd72006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.219+0000 7fd74126b640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd72006ae70 0x7fd72006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0cb4d0 tx=0x7fd72c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:41.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.223+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd73c0c6cf0 con 0x7fd73c0ca110 2023-10-16T08:52:41.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.410+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd73c0ccdb0 con 0x7fd73c0ca110 2023-10-16T08:52:41.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.411+0000 7fd7327fc640 1 -- 172.21.15.94:0/3105027605 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd738076680 con 0x7fd73c0ca110 2023-10-16T08:52:41.413 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:41.415 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.413+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd72006ae70 msgr2=0x7fd72006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.413+0000 7fd743cd0640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd72006ae70 0x7fd72006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0cb4d0 tx=0x7fd72c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:41.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.413+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 msgr2=0x7fd73c147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.413+0000 7fd743cd0640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 0x7fd73c147ac0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd7380046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 shutdown_connections 2023-10-16T08:52:41.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd73c159890 0x7fd73c071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd72006ae70 0x7fd72006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd73c0ca5a0 0x7fd73c0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 --2- 172.21.15.94:0/3105027605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd73c0ca110 0x7fd73c147ac0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 >> 172.21.15.94:0/3105027605 conn(0x7fd73c0b0030 msgr2=0x7fd73c0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:41.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 shutdown_connections 2023-10-16T08:52:41.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.414+0000 7fd743cd0640 1 -- 172.21.15.94:0/3105027605 wait complete. 2023-10-16T08:52:41.434 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:41.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.635+0000 7f4875632640 1 Processor -- start 2023-10-16T08:52:41.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.635+0000 7f4875632640 1 -- start start 2023-10-16T08:52:41.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.636+0000 7f4875632640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4870160100 0x7f487006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f4875632640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f48700caec0 0x7f48701610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f4875632640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4870161610 con 0x7f48700b21d0 2023-10-16T08:52:41.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f4875632640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48701604e0 con 0x7f4870160100 2023-10-16T08:52:41.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f4875632640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700ce450 con 0x7f48700caec0 2023-10-16T08:52:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486effd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4870160100 0x7f487006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486f7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f48700b21d0 0x7f48700b25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56496/0 (socket says 172.21.15.94:56496) 2023-10-16T08:52:41.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486f7fe640 1 -- 172.21.15.94:0/3734895683 learned_addr learned my addr 172.21.15.94:0/3734895683 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486effd640 1 -- 172.21.15.94:0/3734895683 >> v2:172.21.15.130:3300/0 conn(0x7f48700caec0 msgr2=0x7f48701610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486e7fc640 1 --2- 172.21.15.94:0/3734895683 >> v2:172.21.15.130:3300/0 conn(0x7f48700caec0 0x7f48701610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486effd640 1 --2- 172.21.15.94:0/3734895683 >> v2:172.21.15.130:3300/0 conn(0x7f48700caec0 0x7f48701610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.642 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486effd640 1 -- 172.21.15.94:0/3734895683 >> v1:172.21.15.94:6789/0 conn(0x7f48700b21d0 legacy=0x7f48700b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486dffb640 1 -- 172.21.15.94:0/3734895683 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369915027 0 0) 0x7f4868001490 con 0x7f48700b21d0 2023-10-16T08:52:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486effd640 1 -- 172.21.15.94:0/3734895683 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700ce730 con 0x7f4870160100 2023-10-16T08:52:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.637+0000 7f486e7fc640 1 --2- 172.21.15.94:0/3734895683 >> v2:172.21.15.130:3300/0 conn(0x7f48700caec0 0x7f48701610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.639+0000 7f486effd640 1 --2- 172.21.15.94:0/3734895683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4870160100 0x7f487006c840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4870070df0 tx=0x7f486002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1ff8b9a7883504 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:41.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.639+0000 7f486dffb640 1 -- 172.21.15.94:0/3734895683 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860031830 con 0x7f4870160100 2023-10-16T08:52:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.639+0000 7f486dffb640 1 -- 172.21.15.94:0/3734895683 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860031990 con 0x7f4870160100 2023-10-16T08:52:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.639+0000 7f486dffb640 1 -- 172.21.15.94:0/3734895683 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860031d20 con 0x7f4870160100 2023-10-16T08:52:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 -- 172.21.15.94:0/3734895683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4870160100 msgr2=0x7f487006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 --2- 172.21.15.94:0/3734895683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4870160100 0x7f487006c840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4870070df0 tx=0x7f486002b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 -- 172.21.15.94:0/3734895683 shutdown_connections 2023-10-16T08:52:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 --2- 172.21.15.94:0/3734895683 >> v2:172.21.15.130:3300/0 conn(0x7f48700caec0 0x7f48701610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 --2- 172.21.15.94:0/3734895683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4870160100 0x7f487006c840 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 -- 172.21.15.94:0/3734895683 >> 172.21.15.94:0/3734895683 conn(0x7f48700cd1d0 msgr2=0x7f48700cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 -- 172.21.15.94:0/3734895683 shutdown_connections 2023-10-16T08:52:41.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.640+0000 7f4875632640 1 -- 172.21.15.94:0/3734895683 wait complete. 2023-10-16T08:52:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.642+0000 7f4875632640 1 Processor -- start 2023-10-16T08:52:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.642+0000 7f4875632640 1 -- start start 2023-10-16T08:52:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f4875632640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 0x7f487014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f4875632640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48700caec0 0x7f487015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f4875632640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4870160100 0x7f487015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f4875632640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487015d2e0 con 0x7f48700b21d0 2023-10-16T08:52:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f4875632640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487014c270 con 0x7f48700caec0 2023-10-16T08:52:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f4875632640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487015ca40 con 0x7f4870160100 2023-10-16T08:52:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f486effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 0x7f487014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f486effd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 0x7f487014bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40004/0 (socket says 172.21.15.94:40004) 2023-10-16T08:52:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.643+0000 7f486effd640 1 -- 172.21.15.94:0/3974540872 learned_addr learned my addr 172.21.15.94:0/3974540872 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486e7fc640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48700caec0 0x7f487015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486f7fe640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4870160100 0x7f487015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486effd640 1 -- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4870160100 msgr2=0x7f487015db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486effd640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4870160100 0x7f487015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486effd640 1 -- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48700caec0 msgr2=0x7f487015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486effd640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48700caec0 0x7f487015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486effd640 1 -- 172.21.15.94:0/3974540872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009400 con 0x7f48700b21d0 2023-10-16T08:52:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486e7fc640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48700caec0 0x7f487015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:41.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f486effd640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 0x7f487014bd30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4860000c00 tx=0x7f48600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486003aa60 con 0x7f48700b21d0 2023-10-16T08:52:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486003abe0 con 0x7f48700b21d0 2023-10-16T08:52:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600443f0 con 0x7f48700b21d0 2023-10-16T08:52:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.644+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487015cd20 con 0x7f48700b21d0 2023-10-16T08:52:41.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.645+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700c79c0 con 0x7f48700b21d0 2023-10-16T08:52:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.646+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700c7800 con 0x7f48700b21d0 2023-10-16T08:52:41.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.647+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f486004d450 con 0x7f48700b21d0 2023-10-16T08:52:41.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.648+0000 7f48577fe640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f485c06ae70 0x7f485c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:41.654 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.648+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f48600abc20 con 0x7f48700b21d0 2023-10-16T08:52:41.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.648+0000 7f486e7fc640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f485c06ae70 0x7f485c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:41.659 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.649+0000 7f486e7fc640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f485c06ae70 0x7f485c06d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4864006fd0 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:41.660 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.653+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4860076910 con 0x7f48700b21d0 2023-10-16T08:52:41.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.858+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48700b2d00 con 0x7f48700b21d0 2023-10-16T08:52:41.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.859+0000 7f48577fe640 1 -- 172.21.15.94:0/3974540872 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4860035070 con 0x7f48700b21d0 2023-10-16T08:52:41.861 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:41.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f485c06ae70 msgr2=0x7f485c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f485c06ae70 0x7f485c06d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4864006fd0 tx=0x7f4864008040 comp rx=0 tx=0).stop 2023-10-16T08:52:41.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 msgr2=0x7f487014bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 0x7f487014bd30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4860000c00 tx=0x7f48600046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 shutdown_connections 2023-10-16T08:52:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4870160100 0x7f487015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f485c06ae70 0x7f485c06d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48700caec0 0x7f487015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 --2- 172.21.15.94:0/3974540872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48700b21d0 0x7f487014bd30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 >> 172.21.15.94:0/3974540872 conn(0x7f48700cd1d0 msgr2=0x7f48700b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 shutdown_connections 2023-10-16T08:52:41.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:41.862+0000 7f4875632640 1 -- 172.21.15.94:0/3974540872 wait complete. 2023-10-16T08:52:41.881 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:52:41.882 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:41.926 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:42.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.149+0000 7fd973fa4640 1 Processor -- start 2023-10-16T08:52:42.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.149+0000 7fd973fa4640 1 -- start start 2023-10-16T08:52:42.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd973fa4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd973fa4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd96c0ca1e0 0x7fd96c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd973fa4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd96c071630 0x7fd96c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd973fa4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0cde00 con 0x7fd96c0ca1e0 2023-10-16T08:52:42.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd973fa4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c071e40 con 0x7fd96c071630 2023-10-16T08:52:42.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd973fa4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c072120 con 0x7fd96c0c9e00 2023-10-16T08:52:42.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd97153f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd96c0ca1e0 0x7fd96c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd97153f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd96c0ca1e0 0x7fd96c0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40016/0 (socket says 172.21.15.94:40016) 2023-10-16T08:52:42.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.150+0000 7fd97153f640 1 -- 172.21.15.94:0/4067659725 learned_addr learned my addr 172.21.15.94:0/4067659725 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:42.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd971d40640 1 --2- 172.21.15.94:0/4067659725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd972541640 1 --2- 172.21.15.94:0/4067659725 >> v2:172.21.15.130:3300/0 conn(0x7fd96c071630 0x7fd96c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd97153f640 1 -- 172.21.15.94:0/4067659725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 msgr2=0x7fd96c0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:42.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd97153f640 1 --2- 172.21.15.94:0/4067659725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd97153f640 1 -- 172.21.15.94:0/4067659725 >> v2:172.21.15.130:3300/0 conn(0x7fd96c071630 msgr2=0x7fd96c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd97153f640 1 --2- 172.21.15.94:0/4067659725 >> v2:172.21.15.130:3300/0 conn(0x7fd96c071630 0x7fd96c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd97153f640 1 -- 172.21.15.94:0/4067659725 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c072400 con 0x7fd96c0ca1e0 2023-10-16T08:52:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.151+0000 7fd972541640 1 --2- 172.21.15.94:0/4067659725 >> v2:172.21.15.130:3300/0 conn(0x7fd96c071630 0x7fd96c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:42.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.152+0000 7fd97153f640 1 --2- 172.21.15.94:0/4067659725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c0710f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0c55f0 tx=0x7fd95c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2191c3e24b5feb0f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.152+0000 7fd970d3e640 1 -- 172.21.15.94:0/4067659725 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c031870 con 0x7fd96c0ca1e0 2023-10-16T08:52:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.152+0000 7fd970d3e640 1 -- 172.21.15.94:0/4067659725 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0319d0 con 0x7fd96c0ca1e0 2023-10-16T08:52:42.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.152+0000 7fd970d3e640 1 -- 172.21.15.94:0/4067659725 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c031d60 con 0x7fd96c0ca1e0 2023-10-16T08:52:42.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 -- 172.21.15.94:0/4067659725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c0ca1e0 msgr2=0x7fd96c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 --2- 172.21.15.94:0/4067659725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c0710f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0c55f0 tx=0x7fd95c02b910 comp rx=0 tx=0).stop 2023-10-16T08:52:42.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 -- 172.21.15.94:0/4067659725 shutdown_connections 2023-10-16T08:52:42.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 --2- 172.21.15.94:0/4067659725 >> v2:172.21.15.130:3300/0 conn(0x7fd96c071630 0x7fd96c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 --2- 172.21.15.94:0/4067659725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c0710f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 --2- 172.21.15.94:0/4067659725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 -- 172.21.15.94:0/4067659725 >> 172.21.15.94:0/4067659725 conn(0x7fd96c06c1c0 msgr2=0x7fd96c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 -- 172.21.15.94:0/4067659725 shutdown_connections 2023-10-16T08:52:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.153+0000 7fd973fa4640 1 -- 172.21.15.94:0/4067659725 wait complete. 2023-10-16T08:52:42.162 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.155+0000 7fd973fa4640 1 Processor -- start 2023-10-16T08:52:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.155+0000 7fd973fa4640 1 -- start start 2023-10-16T08:52:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd973fa4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 0x7fd96c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd973fa4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd973fa4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd973fa4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0c2fc0 con 0x7fd96c071630 2023-10-16T08:52:42.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd973fa4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0c3b40 con 0x7fd96c0ca1e0 2023-10-16T08:52:42.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd973fa4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0c3210 con 0x7fd96c0c9e00 2023-10-16T08:52:42.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.156+0000 7fd971d40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 0x7fd96c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 0x7fd96c153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40028/0 (socket says 172.21.15.94:40028) 2023-10-16T08:52:42.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 -- 172.21.15.94:0/2910827100 learned_addr learned my addr 172.21.15.94:0/2910827100 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:42.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd97153f640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd972541640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 -- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 msgr2=0x7fd96c1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c1f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 -- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd96c0ca1e0 msgr2=0x7fd96c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 -- 172.21.15.94:0/2910827100 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0094d0 con 0x7fd96c071630 2023-10-16T08:52:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd972541640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd971d40640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 0x7fd96c153e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d5f0 tx=0x7fd96800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.157+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680125f0 con 0x7fd96c071630 2023-10-16T08:52:42.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.158+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968012750 con 0x7fd96c071630 2023-10-16T08:52:42.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.158+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968012b00 con 0x7fd96c071630 2023-10-16T08:52:42.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.158+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c0c34f0 con 0x7fd96c071630 2023-10-16T08:52:42.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.158+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c156fb0 con 0x7fd96c071630 2023-10-16T08:52:42.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.159+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c073ef0 con 0x7fd96c071630 2023-10-16T08:52:42.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.160+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd968012c60 con 0x7fd96c071630 2023-10-16T08:52:42.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.161+0000 7fd9627fc640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd95006ae70 0x7fd95006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.161+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd968089d80 con 0x7fd96c071630 2023-10-16T08:52:42.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.161+0000 7fd97153f640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd95006ae70 0x7fd95006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.162+0000 7fd97153f640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd95006ae70 0x7fd95006d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd95c036000 tx=0x7fd95c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.165+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd968054b00 con 0x7fd96c071630 2023-10-16T08:52:42.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.349+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd96c071410 con 0x7fd96c071630 2023-10-16T08:52:42.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.351+0000 7fd9627fc640 1 -- 172.21.15.94:0/2910827100 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7fd968058120 con 0x7fd96c071630 2023-10-16T08:52:42.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:42.354 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd95006ae70 msgr2=0x7fd95006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd95006ae70 0x7fd95006d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd95c036000 tx=0x7fd95c03c040 comp rx=0 tx=0).stop 2023-10-16T08:52:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 msgr2=0x7fd96c153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 0x7fd96c153e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d5f0 tx=0x7fd96800dab0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 shutdown_connections 2023-10-16T08:52:42.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd95006ae70 0x7fd95006d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd96c0ca1e0 0x7fd96c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd96c0c9e00 0x7fd96c1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 --2- 172.21.15.94:0/2910827100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd96c071630 0x7fd96c153e20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 >> 172.21.15.94:0/2910827100 conn(0x7fd96c06c1c0 msgr2=0x7fd96c0c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 shutdown_connections 2023-10-16T08:52:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.354+0000 7fd973fa4640 1 -- 172.21.15.94:0/2910827100 wait complete. 2023-10-16T08:52:42.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:42.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:42.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.571+0000 7ffaa3047640 1 Processor -- start 2023-10-16T08:52:42.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.571+0000 7ffaa3047640 1 -- start start 2023-10-16T08:52:42.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.572+0000 7ffaa3047640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa9c0b1a30 0x7ffa9c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.572+0000 7ffaa3047640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c06b570 0x7ffa9c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.572+0000 7ffaa3047640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c06bf40 con 0x7ffa9c0d0cd0 2023-10-16T08:52:42.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.572+0000 7ffaa3047640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0cfc20 con 0x7ffa9c0b1a30 2023-10-16T08:52:42.575 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.572+0000 7ffaa3047640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0cd4a0 con 0x7ffa9c06b570 2023-10-16T08:52:42.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa2045640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa9c0b1a30 0x7ffa9c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa1844640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ffa9c0d0cd0 0x7ffa9c0d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56502/0 (socket says 172.21.15.94:56502) 2023-10-16T08:52:42.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa1844640 1 -- 172.21.15.94:0/1069617996 learned_addr learned my addr 172.21.15.94:0/1069617996 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:42.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa2045640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa9c0b1a30 0x7ffa9c0cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40036/0 (socket says 172.21.15.94:40036) 2023-10-16T08:52:42.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa2045640 1 -- 172.21.15.94:0/1069617996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c06b570 msgr2=0x7ffa9c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:42.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa2045640 1 --2- 172.21.15.94:0/1069617996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c06b570 0x7ffa9c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa2045640 1 -- 172.21.15.94:0/1069617996 >> v1:172.21.15.94:6789/0 conn(0x7ffa9c0d0cd0 legacy=0x7ffa9c0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.573+0000 7ffaa2045640 1 -- 172.21.15.94:0/1069617996 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0cd780 con 0x7ffa9c0b1a30 2023-10-16T08:52:42.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.574+0000 7ffaa2045640 1 --2- 172.21.15.94:0/1069617996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c0cdf80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097a0 tx=0x7ffa9802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375897aad5391480 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.574+0000 7ffaa1043640 1 -- 172.21.15.94:0/1069617996 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9802d040 con 0x7ffa9c0b1a30 2023-10-16T08:52:42.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.574+0000 7ffaa1043640 1 -- 172.21.15.94:0/1069617996 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98031810 con 0x7ffa9c0b1a30 2023-10-16T08:52:42.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.574+0000 7ffaa1043640 1 -- 172.21.15.94:0/1069617996 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031ba0 con 0x7ffa9c0b1a30 2023-10-16T08:52:42.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 -- 172.21.15.94:0/1069617996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c0b1a30 msgr2=0x7ffa9c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 --2- 172.21.15.94:0/1069617996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c0cdf80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffa980097a0 tx=0x7ffa9802b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 -- 172.21.15.94:0/1069617996 shutdown_connections 2023-10-16T08:52:42.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 --2- 172.21.15.94:0/1069617996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c06b570 0x7ffa9c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 --2- 172.21.15.94:0/1069617996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c0cdf80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 -- 172.21.15.94:0/1069617996 >> 172.21.15.94:0/1069617996 conn(0x7ffa9c08c140 msgr2=0x7ffa9c09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:42.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 -- 172.21.15.94:0/1069617996 shutdown_connections 2023-10-16T08:52:42.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.575+0000 7ffaa3047640 1 -- 172.21.15.94:0/1069617996 wait complete. 2023-10-16T08:52:42.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.577+0000 7ffaa3047640 1 Processor -- start 2023-10-16T08:52:42.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.577+0000 7ffaa3047640 1 -- start start 2023-10-16T08:52:42.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.577+0000 7ffaa3047640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 0x7ffa9c0b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.577+0000 7ffaa3047640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.577+0000 7ffaa3047640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c0d0cd0 0x7ffa9c0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa3047640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0cc270 con 0x7ffa9c06b570 2023-10-16T08:52:42.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa3047640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c158250 con 0x7ffa9c0b1a30 2023-10-16T08:52:42.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa3047640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0cb5f0 con 0x7ffa9c0d0cd0 2023-10-16T08:52:42.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 0x7ffa9c0b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 0x7ffa9c0b7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40050/0 (socket says 172.21.15.94:40050) 2023-10-16T08:52:42.585 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 -- 172.21.15.94:0/341677389 learned_addr learned my addr 172.21.15.94:0/341677389 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:42.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2846640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c0d0cd0 0x7ffa9c0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa1844640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 -- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c0d0cd0 msgr2=0x7ffa9c0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c0d0cd0 0x7ffa9c0c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 -- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa9c0b1a30 msgr2=0x7ffa9c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa2045640 1 -- 172.21.15.94:0/341677389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009400 con 0x7ffa9c06b570 2023-10-16T08:52:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.578+0000 7ffaa1844640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.579+0000 7ffaa2045640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 0x7ffa9c0b7d00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffa980098c0 tx=0x7ffa980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.579+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9803ad60 con 0x7ffa9c06b570 2023-10-16T08:52:42.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.579+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980443f0 con 0x7ffa9c06b570 2023-10-16T08:52:42.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.579+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c0cb8d0 con 0x7ffa9c06b570 2023-10-16T08:52:42.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.579+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980447a0 con 0x7ffa9c06b570 2023-10-16T08:52:42.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.579+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c0cbe90 con 0x7ffa9c06b570 2023-10-16T08:52:42.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.580+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c06ba00 con 0x7ffa9c06b570 2023-10-16T08:52:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.581+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa9804d450 con 0x7ffa9c06b570 2023-10-16T08:52:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.582+0000 7ffa92ffd640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffa8006ae70 0x7ffa8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.582+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa980abd80 con 0x7ffa9c06b570 2023-10-16T08:52:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.582+0000 7ffaa1844640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffa8006ae70 0x7ffa8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.583+0000 7ffaa1844640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffa8006ae70 0x7ffa8006d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c007fd0 tx=0x7ffa8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.586+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa98076b00 con 0x7ffa9c06b570 2023-10-16T08:52:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.773+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa9c04e9b0 con 0x7ffa9c06b570 2023-10-16T08:52:42.775 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.773+0000 7ffa92ffd640 1 -- 172.21.15.94:0/341677389 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa98035020 con 0x7ffa9c06b570 2023-10-16T08:52:42.776 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:42.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffa8006ae70 msgr2=0x7ffa8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.778 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffa8006ae70 0x7ffa8006d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c007fd0 tx=0x7ffa8c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:42.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 msgr2=0x7ffa9c0b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 0x7ffa9c0b7d00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffa980098c0 tx=0x7ffa980046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 shutdown_connections 2023-10-16T08:52:42.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa9c0d0cd0 0x7ffa9c0c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.779 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ffa8006ae70 0x7ffa8006d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa9c0b1a30 0x7ffa9c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 --2- 172.21.15.94:0/341677389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa9c06b570 0x7ffa9c0b7d00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 >> 172.21.15.94:0/341677389 conn(0x7ffa9c08c140 msgr2=0x7ffa9c072980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:42.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 shutdown_connections 2023-10-16T08:52:42.780 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.776+0000 7ffaa3047640 1 -- 172.21.15.94:0/341677389 wait complete. 2023-10-16T08:52:42.795 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:42.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.988+0000 7f9329f1d640 1 Processor -- start 2023-10-16T08:52:42.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.988+0000 7f9329f1d640 1 -- start start 2023-10-16T08:52:42.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.989+0000 7f9329f1d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9324159890 0x7f9324071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.989+0000 7f9329f1d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f93240ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.989+0000 7f9329f1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f932415d3f0 0x7f932415d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:42.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.989+0000 7f9329f1d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93240caab0 con 0x7f9324159890 2023-10-16T08:52:42.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.989+0000 7f9329f1d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9324072480 con 0x7f932415d3f0 2023-10-16T08:52:42.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.989+0000 7f9329f1d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93240cd0c0 con 0x7f93240ca110 2023-10-16T08:52:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9324159890 0x7f9324071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9324159890 0x7f9324071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40064/0 (socket says 172.21.15.94:40064) 2023-10-16T08:52:42.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 -- 172.21.15.94:0/3301111126 learned_addr learned my addr 172.21.15.94:0/3301111126 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:42.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f931bfff640 1 --2- 172.21.15.94:0/3301111126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f93240ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 -- 172.21.15.94:0/3301111126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 msgr2=0x7f93240ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:42.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 --2- 172.21.15.94:0/3301111126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f93240ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 -- 172.21.15.94:0/3301111126 >> v2:172.21.15.130:3300/0 conn(0x7f932415d3f0 msgr2=0x7f932415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f9323fff640 1 --2- 172.21.15.94:0/3301111126 >> v2:172.21.15.130:3300/0 conn(0x7f932415d3f0 0x7f932415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 --2- 172.21.15.94:0/3301111126 >> v2:172.21.15.130:3300/0 conn(0x7f932415d3f0 0x7f932415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f93237fe640 1 -- 172.21.15.94:0/3301111126 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240cc540 con 0x7f9324159890 2023-10-16T08:52:42.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.990+0000 7f9323fff640 1 --2- 172.21.15.94:0/3301111126 >> v2:172.21.15.130:3300/0 conn(0x7f932415d3f0 0x7f932415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:42.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.991+0000 7f93237fe640 1 --2- 172.21.15.94:0/3301111126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f9324071f40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f93240cd9d0 tx=0x7f931402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89dc170379998a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:42.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.991+0000 7f9322ffd640 1 -- 172.21.15.94:0/3301111126 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314031860 con 0x7f9324159890 2023-10-16T08:52:42.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9322ffd640 1 -- 172.21.15.94:0/3301111126 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93140319c0 con 0x7f9324159890 2023-10-16T08:52:42.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9322ffd640 1 -- 172.21.15.94:0/3301111126 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314031d50 con 0x7f9324159890 2023-10-16T08:52:42.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 -- 172.21.15.94:0/3301111126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 msgr2=0x7f9324071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:42.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 --2- 172.21.15.94:0/3301111126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f9324071f40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f93240cd9d0 tx=0x7f931402b900 comp rx=0 tx=0).stop 2023-10-16T08:52:42.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 -- 172.21.15.94:0/3301111126 shutdown_connections 2023-10-16T08:52:42.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 --2- 172.21.15.94:0/3301111126 >> v2:172.21.15.130:3300/0 conn(0x7f932415d3f0 0x7f932415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 --2- 172.21.15.94:0/3301111126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f93240ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 --2- 172.21.15.94:0/3301111126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f9324071f40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:42.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 -- 172.21.15.94:0/3301111126 >> 172.21.15.94:0/3301111126 conn(0x7f93240b0030 msgr2=0x7f93240b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:42.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 -- 172.21.15.94:0/3301111126 shutdown_connections 2023-10-16T08:52:42.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.992+0000 7f9329f1d640 1 -- 172.21.15.94:0/3301111126 wait complete. 2023-10-16T08:52:43.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.994+0000 7f9329f1d640 1 Processor -- start 2023-10-16T08:52:43.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.994+0000 7f9329f1d640 1 -- start start 2023-10-16T08:52:43.002 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f9329f1d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f9324148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f9329f1d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f93240af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f9329f1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f932415d3f0 0x7f9324156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f9329f1d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ae020 con 0x7f9324159890 2023-10-16T08:52:43.003 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f9329f1d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ae300 con 0x7f932415d3f0 2023-10-16T08:52:43.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f9329f1d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ae5e0 con 0x7f93240ca110 2023-10-16T08:52:43.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f931bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f93240af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f931bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f93240af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40078/0 (socket says 172.21.15.94:40078) 2023-10-16T08:52:43.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f931bfff640 1 -- 172.21.15.94:0/999265940 learned_addr learned my addr 172.21.15.94:0/999265940 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:43.004 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f93237fe640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f9324148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f931bfff640 1 -- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 msgr2=0x7f9324148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.995+0000 7f931bfff640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f9324148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9323fff640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f932415d3f0 0x7f9324156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.005 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f931bfff640 1 -- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f932415d3f0 msgr2=0x7f9324156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f931bfff640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f932415d3f0 0x7f9324156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f931bfff640 1 -- 172.21.15.94:0/999265940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140094d0 con 0x7f9324159890 2023-10-16T08:52:43.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9323fff640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f932415d3f0 0x7f9324156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:43.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f931bfff640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f93240af0c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f930c00c7f0 tx=0x7f930c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.006 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c004220 con 0x7f9324159890 2023-10-16T08:52:43.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c004380 con 0x7f9324159890 2023-10-16T08:52:43.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c007840 con 0x7f9324159890 2023-10-16T08:52:43.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93240ae8c0 con 0x7f9324159890 2023-10-16T08:52:43.007 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.996+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9324148e60 con 0x7f9324159890 2023-10-16T08:52:43.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.997+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9324073ef0 con 0x7f9324159890 2023-10-16T08:52:43.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.998+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f930c007bb0 con 0x7f9324159890 2023-10-16T08:52:43.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.999+0000 7f9320ff9640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f930406ae70 0x7f930406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.999+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f930c089940 con 0x7f9324159890 2023-10-16T08:52:43.008 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:42.999+0000 7f93237fe640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f930406ae70 0x7f930406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.000+0000 7f93237fe640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f930406ae70 0x7f930406d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9314036000 tx=0x7f931403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.009 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.003+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f930c054620 con 0x7f9324159890 2023-10-16T08:52:43.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.195+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93240cd290 con 0x7f9324159890 2023-10-16T08:52:43.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.196+0000 7f9320ff9640 1 -- 172.21.15.94:0/999265940 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f930c01e020 con 0x7f9324159890 2023-10-16T08:52:43.198 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.198+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f930406ae70 msgr2=0x7f930406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.198+0000 7f9329f1d640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f930406ae70 0x7f930406d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9314036000 tx=0x7f931403c040 comp rx=0 tx=0).stop 2023-10-16T08:52:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 msgr2=0x7f93240af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f93240af0c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f930c00c7f0 tx=0x7f930c00ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 shutdown_connections 2023-10-16T08:52:43.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f930406ae70 0x7f930406d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f932415d3f0 0x7f9324156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9324159890 0x7f93240af0c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 --2- 172.21.15.94:0/999265940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f93240ca110 0x7f9324148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 >> 172.21.15.94:0/999265940 conn(0x7f93240b0030 msgr2=0x7f9324155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:43.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 shutdown_connections 2023-10-16T08:52:43.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.199+0000 7f9329f1d640 1 -- 172.21.15.94:0/999265940 wait complete. 2023-10-16T08:52:43.219 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:43.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.417+0000 7f126bfff640 1 Processor -- start 2023-10-16T08:52:43.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.417+0000 7f126bfff640 1 -- start start 2023-10-16T08:52:43.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 0x7f126c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126bfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f126c06d360 0x7f126c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126bfff640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c1550f0 con 0x7f126c154d10 2023-10-16T08:52:43.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126bfff640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c06db50 con 0x7f126c06d360 2023-10-16T08:52:43.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126bfff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0b13f0 con 0x7f126c0cf030 2023-10-16T08:52:43.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126a7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 0x7f126c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f126c06d360 0x7f126c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126a7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 0x7f126c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:41606/0 (socket says 172.21.15.94:41606) 2023-10-16T08:52:43.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.419+0000 7f126a7fc640 1 -- 172.21.15.94:0/3682024397 learned_addr learned my addr 172.21.15.94:0/3682024397 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:43.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.420+0000 7f126a7fc640 1 -- 172.21.15.94:0/3682024397 >> v2:172.21.15.130:3300/0 conn(0x7f126c06d360 msgr2=0x7f126c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:43.423 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.420+0000 7f126a7fc640 1 --2- 172.21.15.94:0/3682024397 >> v2:172.21.15.130:3300/0 conn(0x7f126c06d360 0x7f126c0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.420+0000 7f126a7fc640 1 -- 172.21.15.94:0/3682024397 >> v1:172.21.15.130:6789/0 conn(0x7f126c154d10 legacy=0x7f126c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.424 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.420+0000 7f126a7fc640 1 -- 172.21.15.94:0/3682024397 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0b16d0 con 0x7f126c0cf030 2023-10-16T08:52:43.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.422+0000 7f126a7fc640 1 --2- 172.21.15.94:0/3682024397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 0x7f126c06ce20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1260009870 tx=0x7f126002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa0e3e4b72015ff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.425 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.422+0000 7f1269ffb640 1 -- 172.21.15.94:0/3682024397 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260030840 con 0x7f126c0cf030 2023-10-16T08:52:43.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.422+0000 7f1269ffb640 1 -- 172.21.15.94:0/3682024397 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12600309a0 con 0x7f126c0cf030 2023-10-16T08:52:43.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.422+0000 7f1269ffb640 1 -- 172.21.15.94:0/3682024397 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260030d30 con 0x7f126c0cf030 2023-10-16T08:52:43.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 -- 172.21.15.94:0/3682024397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 msgr2=0x7f126c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 --2- 172.21.15.94:0/3682024397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 0x7f126c06ce20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1260009870 tx=0x7f126002b980 comp rx=0 tx=0).stop 2023-10-16T08:52:43.426 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 -- 172.21.15.94:0/3682024397 shutdown_connections 2023-10-16T08:52:43.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 --2- 172.21.15.94:0/3682024397 >> v2:172.21.15.130:3300/0 conn(0x7f126c06d360 0x7f126c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 --2- 172.21.15.94:0/3682024397 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c0cf030 0x7f126c06ce20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 -- 172.21.15.94:0/3682024397 >> 172.21.15.94:0/3682024397 conn(0x7f126c06a200 msgr2=0x7f126c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:43.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 -- 172.21.15.94:0/3682024397 shutdown_connections 2023-10-16T08:52:43.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.423+0000 7f126bfff640 1 -- 172.21.15.94:0/3682024397 wait complete. 2023-10-16T08:52:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.425+0000 7f126bfff640 1 Processor -- start 2023-10-16T08:52:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.425+0000 7f126bfff640 1 -- start start 2023-10-16T08:52:43.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f126c06d360 0x7f126c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 0x7f126c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126bfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c154d10 0x7f126c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126bfff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c153ad0 con 0x7f126c0cf030 2023-10-16T08:52:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126bfff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0c1e60 con 0x7f126c06d360 2023-10-16T08:52:43.431 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126bfff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0c6d40 con 0x7f126c154d10 2023-10-16T08:52:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 0x7f126c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126a7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 0x7f126c159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40090/0 (socket says 172.21.15.94:40090) 2023-10-16T08:52:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126a7fc640 1 -- 172.21.15.94:0/3823198119 learned_addr learned my addr 172.21.15.94:0/3823198119 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126b7fe640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c154d10 0x7f126c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126affd640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f126c06d360 0x7f126c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126a7fc640 1 -- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c154d10 msgr2=0x7f126c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.426+0000 7f126a7fc640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c154d10 0x7f126c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126a7fc640 1 -- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f126c06d360 msgr2=0x7f126c153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126a7fc640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f126c06d360 0x7f126c153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126a7fc640 1 -- 172.21.15.94:0/3823198119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600094d0 con 0x7f126c0cf030 2023-10-16T08:52:43.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126b7fe640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c154d10 0x7f126c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:43.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126affd640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f126c06d360 0x7f126c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:43.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126a7fc640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 0x7f126c159d40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1260000c00 tx=0x7f1260004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260039c90 con 0x7f126c0cf030 2023-10-16T08:52:43.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260039df0 con 0x7f126c0cf030 2023-10-16T08:52:43.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c15c2f0 con 0x7f126c0cf030 2023-10-16T08:52:43.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260043640 con 0x7f126c0cf030 2023-10-16T08:52:43.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.427+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c15c8b0 con 0x7f126c0cf030 2023-10-16T08:52:43.436 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.428+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c04e9b0 con 0x7f126c0cf030 2023-10-16T08:52:43.436 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.429+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f12600437a0 con 0x7f126c0cf030 2023-10-16T08:52:43.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.430+0000 7f12537fe640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f125806aea0 0x7f125806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.430+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f126003e070 con 0x7f126c0cf030 2023-10-16T08:52:43.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.430+0000 7f126affd640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f125806aea0 0x7f125806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.431+0000 7f126affd640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f125806aea0 0x7f125806d360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f125c0015e0 tx=0x7f125c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.434+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12600776e0 con 0x7f126c0cf030 2023-10-16T08:52:43.610 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.608+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f126c0c8810 con 0x7f126c0cf030 2023-10-16T08:52:43.611 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.609+0000 7f12537fe640 1 -- 172.21.15.94:0/3823198119 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f126007ad00 con 0x7f126c0cf030 2023-10-16T08:52:43.611 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:43.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f125806aea0 msgr2=0x7f125806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f125806aea0 0x7f125806d360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f125c0015e0 tx=0x7f125c009040 comp rx=0 tx=0).stop 2023-10-16T08:52:43.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 msgr2=0x7f126c159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.614 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 0x7f126c159d40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1260000c00 tx=0x7f1260004730 comp rx=0 tx=0).stop 2023-10-16T08:52:43.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 shutdown_connections 2023-10-16T08:52:43.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f126c154d10 0x7f126c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f126c0cf030 0x7f126c159d40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f125806aea0 0x7f125806d360 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 --2- 172.21.15.94:0/3823198119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f126c06d360 0x7f126c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.611+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 >> 172.21.15.94:0/3823198119 conn(0x7f126c06a200 msgr2=0x7f126c0ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:43.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.612+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 shutdown_connections 2023-10-16T08:52:43.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.612+0000 7f126bfff640 1 -- 172.21.15.94:0/3823198119 wait complete. 2023-10-16T08:52:43.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:43.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.841+0000 7f4d59246640 1 Processor -- start 2023-10-16T08:52:43.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.841+0000 7f4d59246640 1 -- start start 2023-10-16T08:52:43.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.842+0000 7f4d59246640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d5406bff0 0x7f4d540cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.842+0000 7f4d59246640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5406b6a0 con 0x7f4d540d1380 2023-10-16T08:52:43.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.842+0000 7f4d59246640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5406b3c0 con 0x7f4d540c6cc0 2023-10-16T08:52:43.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.842+0000 7f4d59246640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540caf50 con 0x7f4d5406bff0 2023-10-16T08:52:43.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.843+0000 7f4d5359e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4d540d1380 0x7f4d540cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56506/0 (socket says 172.21.15.94:56506) 2023-10-16T08:52:43.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.843+0000 7f4d5359e640 1 -- 172.21.15.94:0/47451124 learned_addr learned my addr 172.21.15.94:0/47451124 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:43.847 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.843+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464362912 0 0) 0x7f4d5406b6a0 con 0x7f4d540d1380 2023-10-16T08:52:43.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.843+0000 7f4d5259c640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d5406bff0 0x7f4d540cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.843+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003520 con 0x7f4d540d1380 2023-10-16T08:52:43.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1027897575 0 0) 0x7f4d40003520 con 0x7f4d540d1380 2023-10-16T08:52:43.848 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d5406bff0 msgr2=0x7f4d540cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:43.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d5406bff0 0x7f4d540cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 >> v1:172.21.15.130:6789/0 conn(0x7f4d540c6cc0 legacy=0x7f4d5406b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540cb230 con 0x7f4d540d1380 2023-10-16T08:52:43.849 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f4d4c001670 con 0x7f4d540d1380 2023-10-16T08:52:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 >> v1:172.21.15.94:6789/0 conn(0x7f4d540d1380 legacy=0x7f4d540cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d400039a0 0x7f4d40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400047c0 0x7f4d40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d400051d0 0x7f4d4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.850 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540caf50 con 0x7f4d400039a0 2023-10-16T08:52:43.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000c0d0 con 0x7f4d400051d0 2023-10-16T08:52:43.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4000c290 con 0x7f4d400047c0 2023-10-16T08:52:43.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d5259c640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d5406bff0 0x7f4d540cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:43.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d400039a0 0x7f4d40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.851 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d52d9d640 1 -- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400047c0 msgr2=0x7f4d40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400047c0 0x7f4d40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d52d9d640 1 -- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d400051d0 msgr2=0x7f4d4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d400051d0 0x7f4d4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.844+0000 7f4d52d9d640 1 -- 172.21.15.94:0/47451124 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40003520 con 0x7f4d400039a0 2023-10-16T08:52:43.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.845+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d400039a0 0x7f4d40003dc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c001770 tx=0x7f4d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6629d8daf38c2e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0052d0 con 0x7f4d400039a0 2023-10-16T08:52:43.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c02e050 con 0x7f4d400039a0 2023-10-16T08:52:43.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d51d9b640 1 -- 172.21.15.94:0/47451124 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c003640 con 0x7f4d400039a0 2023-10-16T08:52:43.856 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d59246640 1 -- 172.21.15.94:0/47451124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d400039a0 msgr2=0x7f4d40003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.856 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d59246640 1 --2- 172.21.15.94:0/47451124 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d400039a0 0x7f4d40003dc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c001770 tx=0x7f4d400057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.856 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d5359e640 1 -- 172.21.15.94:0/47451124 reap_dead start 2023-10-16T08:52:43.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d59246640 1 -- 172.21.15.94:0/47451124 shutdown_connections 2023-10-16T08:52:43.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d59246640 1 -- 172.21.15.94:0/47451124 >> 172.21.15.94:0/47451124 conn(0x7f4d540d0860 msgr2=0x7f4d540d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:43.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.846+0000 7f4d59246640 1 -- 172.21.15.94:0/47451124 shutdown_connections 2023-10-16T08:52:43.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.847+0000 7f4d59246640 1 -- 172.21.15.94:0/47451124 wait complete. 2023-10-16T08:52:43.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.848+0000 7f4d59246640 1 Processor -- start 2023-10-16T08:52:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.848+0000 7f4d59246640 1 -- start start 2023-10-16T08:52:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d59246640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400039a0 0x7f4d5414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d59246640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 0x7f4d540b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d59246640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d540b5b20 0x7f4d541f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d59246640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540b5fb0 con 0x7f4d541f67d0 2023-10-16T08:52:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d59246640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540b0b50 con 0x7f4d540b5b20 2023-10-16T08:52:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d59246640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541f3520 con 0x7f4d400039a0 2023-10-16T08:52:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.849+0000 7f4d5259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 0x7f4d540b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 0x7f4d540b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40106/0 (socket says 172.21.15.94:40106) 2023-10-16T08:52:43.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 -- 172.21.15.94:0/129943947 learned_addr learned my addr 172.21.15.94:0/129943947 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400039a0 0x7f4d5414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5359e640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d540b5b20 0x7f4d541f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 -- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400039a0 msgr2=0x7f4d5414f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400039a0 0x7f4d5414f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 -- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d540b5b20 msgr2=0x7f4d541f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d540b5b20 0x7f4d541f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 -- 172.21.15.94:0/129943947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d541f6340 con 0x7f4d541f67d0 2023-10-16T08:52:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d5259c640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 0x7f4d540b55e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009fd0 tx=0x7f4d4400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.850+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44003990 con 0x7f4d541f67d0 2023-10-16T08:52:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.851+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400f040 con 0x7f4d541f67d0 2023-10-16T08:52:43.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.851+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44003d50 con 0x7f4d541f67d0 2023-10-16T08:52:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.851+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d541f3240 con 0x7f4d541f67d0 2023-10-16T08:52:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.851+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541f5fd0 con 0x7f4d541f67d0 2023-10-16T08:52:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.852+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d541f5b50 con 0x7f4d541f67d0 2023-10-16T08:52:43.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.853+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d44004030 con 0x7f4d541f67d0 2023-10-16T08:52:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.854+0000 7f4d4b7fe640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3406aea0 0x7f4d3406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.854+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d44089b20 con 0x7f4d541f67d0 2023-10-16T08:52:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.854+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3406aea0 0x7f4d3406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:43.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.855+0000 7f4d52d9d640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3406aea0 0x7f4d3406d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c033000 tx=0x7f4d3c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:43.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:43.858+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d541f5b50 con 0x7f4d541f67d0 2023-10-16T08:52:44.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.050+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d541f5b50 con 0x7f4d541f67d0 2023-10-16T08:52:44.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.051+0000 7f4d4b7fe640 1 -- 172.21.15.94:0/129943947 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d541f5b50 con 0x7f4d541f67d0 2023-10-16T08:52:44.053 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:44.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3406aea0 msgr2=0x7f4d3406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.056 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3406aea0 0x7f4d3406d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c033000 tx=0x7f4d3c009030 comp rx=0 tx=0).stop 2023-10-16T08:52:44.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 msgr2=0x7f4d540b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 0x7f4d540b55e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009fd0 tx=0x7f4d4400d4a0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 shutdown_connections 2023-10-16T08:52:44.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4d3406aea0 0x7f4d3406d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d540b5b20 0x7f4d541f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4d541f67d0 0x7f4d540b55e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 --2- 172.21.15.94:0/129943947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d400039a0 0x7f4d5414f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 >> 172.21.15.94:0/129943947 conn(0x7f4d540d0860 msgr2=0x7f4d540c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:44.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.054+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 shutdown_connections 2023-10-16T08:52:44.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.055+0000 7f4d59246640 1 -- 172.21.15.94:0/129943947 wait complete. 2023-10-16T08:52:44.077 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:44.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.292+0000 7fe14e021640 1 Processor -- start 2023-10-16T08:52:44.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.292+0000 7fe14e021640 1 -- start start 2023-10-16T08:52:44.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.293+0000 7fe14e021640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 0x7fe14806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe14e021640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14815ae40 con 0x7fe1480b08c0 2023-10-16T08:52:44.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe14e021640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1480b1580 con 0x7fe14815aa60 2023-10-16T08:52:44.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe14e021640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480c96f0 con 0x7fe1480c9260 2023-10-16T08:52:44.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe146ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe1480b08c0 0x7fe1480b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56518/0 (socket says 172.21.15.94:56518) 2023-10-16T08:52:44.297 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe146ffd640 1 -- 172.21.15.94:0/3576395708 learned_addr learned my addr 172.21.15.94:0/3576395708 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142989313 0 0) 0x7fe14815ae40 con 0x7fe1480b08c0 2023-10-16T08:52:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe134003520 con 0x7fe1480b08c0 2023-10-16T08:52:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.294+0000 7fe147fff640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 0x7fe14806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427518172 0 0) 0x7fe134003520 con 0x7fe1480b08c0 2023-10-16T08:52:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 msgr2=0x7fe14806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 0x7fe14806c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 >> v1:172.21.15.130:6789/0 conn(0x7fe14815aa60 legacy=0x7fe1480b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480c98f0 con 0x7fe1480b08c0 2023-10-16T08:52:44.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fe130001670 con 0x7fe1480b08c0 2023-10-16T08:52:44.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 >> v1:172.21.15.94:6789/0 conn(0x7fe1480b08c0 legacy=0x7fe1480b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 0x7fe1340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134004020 0x7fe1340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe134004d00 0x7fe134005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480c96f0 con 0x7fe134004d00 2023-10-16T08:52:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13400bc60 con 0x7fe134004020 2023-10-16T08:52:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13400be20 con 0x7fe1480c9260 2023-10-16T08:52:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe147fff640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe134004d00 0x7fe134005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.295+0000 7fe1477fe640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 0x7fe1340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.296+0000 7fe146ffd640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134004020 0x7fe1340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.296+0000 7fe147fff640 1 -- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 msgr2=0x7fe1340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.296+0000 7fe147fff640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1480c9260 0x7fe1340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.296+0000 7fe147fff640 1 -- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134004020 msgr2=0x7fe1340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.296+0000 7fe147fff640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134004020 0x7fe1340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.296+0000 7fe147fff640 1 -- 172.21.15.94:0/3576395708 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134003520 con 0x7fe134004d00 2023-10-16T08:52:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.297+0000 7fe147fff640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe134004d00 0x7fe134005180 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe14000ba30 tx=0x7fe1340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b790cee22a812f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.297+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140032660 con 0x7fe134004d00 2023-10-16T08:52:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.297+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1400327c0 con 0x7fe134004d00 2023-10-16T08:52:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.297+0000 7fe1467fc640 1 -- 172.21.15.94:0/3576395708 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140032b50 con 0x7fe134004d00 2023-10-16T08:52:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe14e021640 1 -- 172.21.15.94:0/3576395708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe134004d00 msgr2=0x7fe134005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe14e021640 1 --2- 172.21.15.94:0/3576395708 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe134004d00 0x7fe134005180 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe14000ba30 tx=0x7fe1340057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe147fff640 1 -- 172.21.15.94:0/3576395708 reap_dead start 2023-10-16T08:52:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe14e021640 1 -- 172.21.15.94:0/3576395708 shutdown_connections 2023-10-16T08:52:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe14e021640 1 -- 172.21.15.94:0/3576395708 >> 172.21.15.94:0/3576395708 conn(0x7fe1480cb1b0 msgr2=0x7fe1480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:44.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe14e021640 1 -- 172.21.15.94:0/3576395708 shutdown_connections 2023-10-16T08:52:44.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.298+0000 7fe14e021640 1 -- 172.21.15.94:0/3576395708 wait complete. 2023-10-16T08:52:44.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.300+0000 7fe14e021640 1 Processor -- start 2023-10-16T08:52:44.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.300+0000 7fe14e021640 1 -- start start 2023-10-16T08:52:44.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe14e021640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe134004d00 0x7fe1481f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe14e021640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 0x7fe14815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe14e021640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1480cdfc0 0x7fe14815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe14e021640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148152740 con 0x7fe1480cdb40 2023-10-16T08:52:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe14e021640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148152a20 con 0x7fe1480cdfc0 2023-10-16T08:52:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe14e021640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148152d00 con 0x7fe134004d00 2023-10-16T08:52:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 0x7fe14815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 0x7fe14815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40116/0 (socket says 172.21.15.94:40116) 2023-10-16T08:52:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 -- 172.21.15.94:0/2470870677 learned_addr learned my addr 172.21.15.94:0/2470870677 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 -- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe134004d00 msgr2=0x7fe1481f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe1477fe640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe134004d00 0x7fe1481f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe147fff640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1480cdfc0 0x7fe14815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe134004d00 0x7fe1481f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 -- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1480cdfc0 msgr2=0x7fe14815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1480cdfc0 0x7fe14815d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.301+0000 7fe146ffd640 1 -- 172.21.15.94:0/2470870677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148152fe0 con 0x7fe1480cdb40 2023-10-16T08:52:44.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.302+0000 7fe146ffd640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 0x7fe14815cf90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe13000e7d0 tx=0x7fe13000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:44.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.302+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000eee0 con 0x7fe1480cdb40 2023-10-16T08:52:44.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.302+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13000c8d0 con 0x7fe1480cdb40 2023-10-16T08:52:44.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.302+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1481532c0 con 0x7fe1480cdb40 2023-10-16T08:52:44.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.302+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000cc80 con 0x7fe1480cdb40 2023-10-16T08:52:44.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.302+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1481f1d60 con 0x7fe1480cdb40 2023-10-16T08:52:44.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.303+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1480cafb0 con 0x7fe1480cdb40 2023-10-16T08:52:44.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.304+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe13001d460 con 0x7fe1480cdb40 2023-10-16T08:52:44.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.305+0000 7fe13ffff640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe12806aea0 0x7fe12806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:44.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.305+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe130089a30 con 0x7fe1480cdb40 2023-10-16T08:52:44.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.305+0000 7fe1477fe640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe12806aea0 0x7fe12806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:44.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.306+0000 7fe1477fe640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe12806aea0 0x7fe12806d360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe138001cd0 tx=0x7fe138009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:44.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.309+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe130054710 con 0x7fe1480cdb40 2023-10-16T08:52:44.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.512+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1480ab860 con 0x7fe1480cdb40 2023-10-16T08:52:44.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.513+0000 7fe13ffff640 1 -- 172.21.15.94:0/2470870677 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe130057d30 con 0x7fe1480cdb40 2023-10-16T08:52:44.515 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:44.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.515+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe12806aea0 msgr2=0x7fe12806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.515+0000 7fe14e021640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe12806aea0 0x7fe12806d360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe138001cd0 tx=0x7fe138009040 comp rx=0 tx=0).stop 2023-10-16T08:52:44.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.515+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 msgr2=0x7fe14815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:44.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.515+0000 7fe14e021640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 0x7fe14815cf90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe13000e7d0 tx=0x7fe13000ec90 comp rx=0 tx=0).stop 2023-10-16T08:52:44.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 shutdown_connections 2023-10-16T08:52:44.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe12806aea0 0x7fe12806d360 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1480cdfc0 0x7fe14815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1480cdb40 0x7fe14815cf90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 --2- 172.21.15.94:0/2470870677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe134004d00 0x7fe1481f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:44.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 >> 172.21.15.94:0/2470870677 conn(0x7fe1480cb1b0 msgr2=0x7fe1480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:44.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 shutdown_connections 2023-10-16T08:52:44.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:44.516+0000 7fe14e021640 1 -- 172.21.15.94:0/2470870677 wait complete. 2023-10-16T08:52:44.536 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2023-10-16T08:52:44.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:44.537 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-16T08:52:44.640 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:52:44.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T08:52:44.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:44.641 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T08:52:44.694 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:52:44.694 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:44.754 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:52:44.755 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:44.809 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:45.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.027+0000 7fb9d3bce640 1 Processor -- start 2023-10-16T08:52:45.029 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.027+0000 7fb9d3bce640 1 -- start start 2023-10-16T08:52:45.030 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.028+0000 7fb9d3bce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 0x7fb9cc0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d3bce640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc0707f0 con 0x7fb9cc15ad00 2023-10-16T08:52:45.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d3bce640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc070ad0 con 0x7fb9cc15f040 2023-10-16T08:52:45.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d3bce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc15b1d0 con 0x7fb9cc0b0010 2023-10-16T08:52:45.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d1169640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb9cc15ad00 0x7fb9cc0b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60390/0 (socket says 172.21.15.94:60390) 2023-10-16T08:52:45.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d1169640 1 -- 172.21.15.94:0/419880682 learned_addr learned my addr 172.21.15.94:0/419880682 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:45.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d196a640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 0x7fb9cc0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223267584 0 0) 0x7fb9cc0707f0 con 0x7fb9cc15ad00 2023-10-16T08:52:45.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.029+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b8003520 con 0x7fb9cc15ad00 2023-10-16T08:52:45.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917474118 0 0) 0x7fb9b8003520 con 0x7fb9cc15ad00 2023-10-16T08:52:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 msgr2=0x7fb9cc0701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 0x7fb9cc0701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 >> v1:172.21.15.130:6789/0 conn(0x7fb9cc15f040 legacy=0x7fb9cc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc15b4b0 con 0x7fb9cc15ad00 2023-10-16T08:52:45.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fb9bc001670 con 0x7fb9cc15ad00 2023-10-16T08:52:45.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 >> v1:172.21.15.94:6789/0 conn(0x7fb9cc15ad00 legacy=0x7fb9cc0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9b8003a10 0x7fb9b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 0x7fb9b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b8004d00 0x7fb9b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc15b1d0 con 0x7fb9b8004d00 2023-10-16T08:52:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b800ba90 con 0x7fb9b8003a10 2023-10-16T08:52:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b800bc50 con 0x7fb9cc0b0010 2023-10-16T08:52:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.030+0000 7fb9d216b640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b8004d00 0x7fb9b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d196a640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9b8003a10 0x7fb9b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d1169640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 0x7fb9b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d216b640 1 -- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 msgr2=0x7fb9b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d216b640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0b0010 0x7fb9b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d216b640 1 -- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9b8003a10 msgr2=0x7fb9b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d216b640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9b8003a10 0x7fb9b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.031+0000 7fb9d216b640 1 -- 172.21.15.94:0/419880682 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8003520 con 0x7fb9b8004d00 2023-10-16T08:52:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.032+0000 7fb9d216b640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b8004d00 0x7fb9b8005180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001e20 tx=0x7fb9b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b20816cd9a1842b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.032+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4003b70 con 0x7fb9b8004d00 2023-10-16T08:52:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.032+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c4003cd0 con 0x7fb9b8004d00 2023-10-16T08:52:45.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.032+0000 7fb9d0968640 1 -- 172.21.15.94:0/419880682 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4005310 con 0x7fb9b8004d00 2023-10-16T08:52:45.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d3bce640 1 -- 172.21.15.94:0/419880682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b8004d00 msgr2=0x7fb9b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/419880682 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9b8004d00 0x7fb9b8005180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4001e20 tx=0x7fb9b80057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d216b640 1 -- 172.21.15.94:0/419880682 reap_dead start 2023-10-16T08:52:45.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d3bce640 1 -- 172.21.15.94:0/419880682 shutdown_connections 2023-10-16T08:52:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d3bce640 1 -- 172.21.15.94:0/419880682 >> 172.21.15.94:0/419880682 conn(0x7fb9cc06c1c0 msgr2=0x7fb9cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d3bce640 1 -- 172.21.15.94:0/419880682 shutdown_connections 2023-10-16T08:52:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.033+0000 7fb9d3bce640 1 -- 172.21.15.94:0/419880682 wait complete. 2023-10-16T08:52:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.034+0000 7fb9d3bce640 1 Processor -- start 2023-10-16T08:52:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.035+0000 7fb9d3bce640 1 -- start start 2023-10-16T08:52:45.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.035+0000 7fb9d3bce640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 0x7fb9cc0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d3bce640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0aeee0 0x7fb9cc0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d3bce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9cc1f3570 0x7fb9cc1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d3bce640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc158000 con 0x7fb9cc155cb0 2023-10-16T08:52:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d3bce640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0af8a0 con 0x7fb9cc1f3570 2023-10-16T08:52:45.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d3bce640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc1579b0 con 0x7fb9cc0aeee0 2023-10-16T08:52:45.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 0x7fb9cc0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 0x7fb9cc0b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40764/0 (socket says 172.21.15.94:40764) 2023-10-16T08:52:45.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 -- 172.21.15.94:0/251610239 learned_addr learned my addr 172.21.15.94:0/251610239 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:45.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 -- 172.21.15.94:0/251610239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0aeee0 msgr2=0x7fb9cc0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0aeee0 0x7fb9cc0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 -- 172.21.15.94:0/251610239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9cc1f3570 msgr2=0x7fb9cc1f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9cc1f3570 0x7fb9cc1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 -- 172.21.15.94:0/251610239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0c48a0 con 0x7fb9cc155cb0 2023-10-16T08:52:45.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.036+0000 7fb9d196a640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 0x7fb9cc0b11b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8011600 tx=0x7fb9c8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.037+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8015870 con 0x7fb9cc155cb0 2023-10-16T08:52:45.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.037+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c80159d0 con 0x7fb9cc155cb0 2023-10-16T08:52:45.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.037+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8015d40 con 0x7fb9cc155cb0 2023-10-16T08:52:45.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.037+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc0c4b80 con 0x7fb9cc155cb0 2023-10-16T08:52:45.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.037+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc0b16f0 con 0x7fb9cc155cb0 2023-10-16T08:52:45.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.038+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc073ef0 con 0x7fb9cc155cb0 2023-10-16T08:52:45.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.039+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb9c800f490 con 0x7fb9cc155cb0 2023-10-16T08:52:45.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.040+0000 7fb9c27fc640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb9b006ae70 0x7fb9b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.040+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb9c8089dd0 con 0x7fb9cc155cb0 2023-10-16T08:52:45.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.040+0000 7fb9d1169640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb9b006ae70 0x7fb9b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.041+0000 7fb9d1169640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb9b006ae70 0x7fb9b006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc001c90 tx=0x7fb9bc001c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.049 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.045+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9c8054b50 con 0x7fb9cc155cb0 2023-10-16T08:52:45.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.235+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9cc0ca440 con 0x7fb9cc155cb0 2023-10-16T08:52:45.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.238+0000 7fb9c27fc640 1 -- 172.21.15.94:0/251610239 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7fb9c8022090 con 0x7fb9cc155cb0 2023-10-16T08:52:45.240 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:45.241 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:45.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb9b006ae70 msgr2=0x7fb9b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb9b006ae70 0x7fb9b006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc001c90 tx=0x7fb9bc001c20 comp rx=0 tx=0).stop 2023-10-16T08:52:45.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 msgr2=0x7fb9cc0b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 0x7fb9cc0b11b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8011600 tx=0x7fb9c8011ac0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 shutdown_connections 2023-10-16T08:52:45.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb9b006ae70 0x7fb9b006d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9cc1f3570 0x7fb9cc1f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9cc0aeee0 0x7fb9cc0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 --2- 172.21.15.94:0/251610239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9cc155cb0 0x7fb9cc0b11b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 >> 172.21.15.94:0/251610239 conn(0x7fb9cc06c1c0 msgr2=0x7fb9cc15e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:45.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 shutdown_connections 2023-10-16T08:52:45.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.241+0000 7fb9d3bce640 1 -- 172.21.15.94:0/251610239 wait complete. 2023-10-16T08:52:45.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:45.264 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.473+0000 7f612e161640 1 Processor -- start 2023-10-16T08:52:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.473+0000 7f612e161640 1 -- start start 2023-10-16T08:52:45.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f612e161640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6128070a30 0x7f61280cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f612e161640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f61280c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f612e161640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61280cf040 con 0x7f612815a830 2023-10-16T08:52:45.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f612e161640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280ca9e0 con 0x7f6128070a30 2023-10-16T08:52:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f612e161640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280ce430 con 0x7f61280ca550 2023-10-16T08:52:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f6126ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6128070a30 0x7f61280cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f6126ffd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6128070a30 0x7f61280cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40774/0 (socket says 172.21.15.94:40774) 2023-10-16T08:52:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.475+0000 7f6126ffd640 1 -- 172.21.15.94:0/2923566836 learned_addr learned my addr 172.21.15.94:0/2923566836 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.476+0000 7f6127fff640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f61280c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.476+0000 7f6126ffd640 1 -- 172.21.15.94:0/2923566836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 msgr2=0x7f61280c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.476+0000 7f6126ffd640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f61280c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.476+0000 7f6126ffd640 1 -- 172.21.15.94:0/2923566836 >> v1:172.21.15.130:6789/0 conn(0x7f612815a830 legacy=0x7f6128070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.476+0000 7f6126ffd640 1 -- 172.21.15.94:0/2923566836 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280ce710 con 0x7f6128070a30 2023-10-16T08:52:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.476+0000 7f6127fff640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f61280c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.477+0000 7f6126ffd640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6128070a30 0x7f61280cb640 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f611c009870 tx=0x7f611c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142ba1692835b9b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.477+0000 7f61267fc640 1 -- 172.21.15.94:0/2923566836 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c031640 con 0x7f6128070a30 2023-10-16T08:52:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.477+0000 7f61267fc640 1 -- 172.21.15.94:0/2923566836 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c0317a0 con 0x7f6128070a30 2023-10-16T08:52:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.477+0000 7f61267fc640 1 -- 172.21.15.94:0/2923566836 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c031b30 con 0x7f6128070a30 2023-10-16T08:52:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 -- 172.21.15.94:0/2923566836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6128070a30 msgr2=0x7f61280cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6128070a30 0x7f61280cb640 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f611c009870 tx=0x7f611c02b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 -- 172.21.15.94:0/2923566836 shutdown_connections 2023-10-16T08:52:45.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f61280c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 --2- 172.21.15.94:0/2923566836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6128070a30 0x7f61280cb640 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 -- 172.21.15.94:0/2923566836 >> 172.21.15.94:0/2923566836 conn(0x7f61280b0030 msgr2=0x7f61280b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:45.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 -- 172.21.15.94:0/2923566836 shutdown_connections 2023-10-16T08:52:45.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.478+0000 7f612e161640 1 -- 172.21.15.94:0/2923566836 wait complete. 2023-10-16T08:52:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.480+0000 7f612e161640 1 Processor -- start 2023-10-16T08:52:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.480+0000 7f612e161640 1 -- start start 2023-10-16T08:52:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f612e161640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6128070a30 0x7f6128154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f612e161640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f6128159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f612e161640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 0x7f61280c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f612e161640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281550d0 con 0x7f612815a830 2023-10-16T08:52:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f612e161640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280c7060 con 0x7f6128070a30 2023-10-16T08:52:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f612e161640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280c7340 con 0x7f61280ca550 2023-10-16T08:52:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 0x7f61280c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 0x7f61280c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40776/0 (socket says 172.21.15.94:40776) 2023-10-16T08:52:45.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 -- 172.21.15.94:0/111825012 learned_addr learned my addr 172.21.15.94:0/111825012 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 -- 172.21.15.94:0/111825012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 msgr2=0x7f6128159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f6128159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 -- 172.21.15.94:0/111825012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6128070a30 msgr2=0x7f6128154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6128070a30 0x7f6128154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.481+0000 7f6127fff640 1 -- 172.21.15.94:0/111825012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0094d0 con 0x7f612815a830 2023-10-16T08:52:45.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.482+0000 7f6127fff640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 0x7f61280c8280 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f612000c7f0 tx=0x7f612000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.482+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120007820 con 0x7f612815a830 2023-10-16T08:52:45.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.482+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120007980 con 0x7f612815a830 2023-10-16T08:52:45.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.482+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61280c7620 con 0x7f612815a830 2023-10-16T08:52:45.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.482+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120007d70 con 0x7f612815a830 2023-10-16T08:52:45.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.482+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61280c7be0 con 0x7f612815a830 2023-10-16T08:52:45.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.483+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612815f380 con 0x7f612815a830 2023-10-16T08:52:45.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.484+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f61200113f0 con 0x7f612815a830 2023-10-16T08:52:45.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.486+0000 7f610ffff640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f611406ae70 0x7f611406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.486+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6120089db0 con 0x7f612815a830 2023-10-16T08:52:45.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.486+0000 7f61277fe640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f611406ae70 0x7f611406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.487+0000 7f61277fe640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f611406ae70 0x7f611406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61280c48b0 tx=0x7f6118009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.490+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6120054aa0 con 0x7f612815a830 2023-10-16T08:52:45.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.680+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61280ceca0 con 0x7f612815a830 2023-10-16T08:52:45.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.681+0000 7f610ffff640 1 -- 172.21.15.94:0/111825012 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f612001f0a0 con 0x7f612815a830 2023-10-16T08:52:45.683 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:45.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f611406ae70 msgr2=0x7f611406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f611406ae70 0x7f611406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61280c48b0 tx=0x7f6118009230 comp rx=0 tx=0).stop 2023-10-16T08:52:45.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 msgr2=0x7f61280c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 0x7f61280c8280 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f612000c7f0 tx=0x7f612000ccb0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 shutdown_connections 2023-10-16T08:52:45.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f612815a830 0x7f61280c8280 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f61280ca550 0x7f6128159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f611406ae70 0x7f611406d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 --2- 172.21.15.94:0/111825012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6128070a30 0x7f6128154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.683+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 >> 172.21.15.94:0/111825012 conn(0x7f61280b0030 msgr2=0x7f61280adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:45.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.684+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 shutdown_connections 2023-10-16T08:52:45.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.684+0000 7f612e161640 1 -- 172.21.15.94:0/111825012 wait complete. 2023-10-16T08:52:45.704 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:45.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.917+0000 7f951c6e7640 1 Processor -- start 2023-10-16T08:52:45.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.917+0000 7f951c6e7640 1 -- start start 2023-10-16T08:52:45.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951c6e7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f951415a830 0x7f95140cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951c6e7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9514070a30 0x7f95140c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951c6e7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95140cf040 con 0x7f95140ca550 2023-10-16T08:52:45.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951c6e7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95140ca9e0 con 0x7f951415a830 2023-10-16T08:52:45.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951c6e7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95140ce430 con 0x7f9514070a30 2023-10-16T08:52:45.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f951415a830 0x7f95140cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f951415a830 0x7f95140cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40792/0 (socket says 172.21.15.94:40792) 2023-10-16T08:52:45.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 -- 172.21.15.94:0/3799024817 learned_addr learned my addr 172.21.15.94:0/3799024817 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:45.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 -- 172.21.15.94:0/3799024817 >> v2:172.21.15.130:3300/0 conn(0x7f9514070a30 msgr2=0x7f95140c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951ac84640 1 --2- 172.21.15.94:0/3799024817 >> v2:172.21.15.130:3300/0 conn(0x7f9514070a30 0x7f95140c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 --2- 172.21.15.94:0/3799024817 >> v2:172.21.15.130:3300/0 conn(0x7f9514070a30 0x7f95140c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 -- 172.21.15.94:0/3799024817 >> v1:172.21.15.130:6789/0 conn(0x7f95140ca550 legacy=0x7f9514070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:45.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.919+0000 7f951a483640 1 -- 172.21.15.94:0/3799024817 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140ce710 con 0x7f951415a830 2023-10-16T08:52:45.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.920+0000 7f951a483640 1 --2- 172.21.15.94:0/3799024817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f951415a830 0x7f95140cb640 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95140cefb0 tx=0x7f951002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e17f095730972d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.921+0000 7f9519481640 1 -- 172.21.15.94:0/3799024817 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510031870 con 0x7f951415a830 2023-10-16T08:52:45.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.921+0000 7f9519481640 1 -- 172.21.15.94:0/3799024817 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100319d0 con 0x7f951415a830 2023-10-16T08:52:45.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.921+0000 7f9519481640 1 -- 172.21.15.94:0/3799024817 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510031d60 con 0x7f951415a830 2023-10-16T08:52:45.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.921+0000 7f951c6e7640 1 -- 172.21.15.94:0/3799024817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f951415a830 msgr2=0x7f95140cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.921+0000 7f951c6e7640 1 --2- 172.21.15.94:0/3799024817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f951415a830 0x7f95140cb640 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95140cefb0 tx=0x7f951002b910 comp rx=0 tx=0).stop 2023-10-16T08:52:45.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.922+0000 7f951c6e7640 1 -- 172.21.15.94:0/3799024817 shutdown_connections 2023-10-16T08:52:45.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.922+0000 7f951c6e7640 1 --2- 172.21.15.94:0/3799024817 >> v2:172.21.15.130:3300/0 conn(0x7f9514070a30 0x7f95140c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.922+0000 7f951c6e7640 1 --2- 172.21.15.94:0/3799024817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f951415a830 0x7f95140cb640 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.922+0000 7f951c6e7640 1 -- 172.21.15.94:0/3799024817 >> 172.21.15.94:0/3799024817 conn(0x7f95140b0030 msgr2=0x7f95140b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:45.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.922+0000 7f951c6e7640 1 -- 172.21.15.94:0/3799024817 shutdown_connections 2023-10-16T08:52:45.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.922+0000 7f951c6e7640 1 -- 172.21.15.94:0/3799024817 wait complete. 2023-10-16T08:52:45.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.923+0000 7f951c6e7640 1 Processor -- start 2023-10-16T08:52:45.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.924+0000 7f951c6e7640 1 -- start start 2023-10-16T08:52:45.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.924+0000 7f951c6e7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 0x7f95140c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.924+0000 7f951c6e7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95140ca550 0x7f95141f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951c6e7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f951415a830 0x7f9514151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951c6e7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140c5830 con 0x7f9514070a30 2023-10-16T08:52:45.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951c6e7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140c8750 con 0x7f95140ca550 2023-10-16T08:52:45.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951c6e7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95141f3a20 con 0x7f951415a830 2023-10-16T08:52:45.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 0x7f95140c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 0x7f95140c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40798/0 (socket says 172.21.15.94:40798) 2023-10-16T08:52:45.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 -- 172.21.15.94:0/1035715855 learned_addr learned my addr 172.21.15.94:0/1035715855 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:45.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951ac84640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f951415a830 0x7f9514151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f9519c82640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95140ca550 0x7f95141f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 -- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f951415a830 msgr2=0x7f9514151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f951415a830 0x7f9514151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 -- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95140ca550 msgr2=0x7f95141f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:45.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95140ca550 0x7f95141f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:45.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f951a483640 1 -- 172.21.15.94:0/1035715855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100094d0 con 0x7f9514070a30 2023-10-16T08:52:45.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.925+0000 7f9519c82640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95140ca550 0x7f95141f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:45.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.926+0000 7f951a483640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 0x7f95140c8210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9510000c00 tx=0x7f95100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.926+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510031840 con 0x7f9514070a30 2023-10-16T08:52:45.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.926+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100443f0 con 0x7f9514070a30 2023-10-16T08:52:45.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.926+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9514151890 con 0x7f9514070a30 2023-10-16T08:52:45.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.926+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100447a0 con 0x7f9514070a30 2023-10-16T08:52:45.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.926+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951415f320 con 0x7f9514070a30 2023-10-16T08:52:45.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.927+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95140c55b0 con 0x7f9514070a30 2023-10-16T08:52:45.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.928+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f951004d450 con 0x7f9514070a30 2023-10-16T08:52:45.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.929+0000 7f950affd640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94f806aec0 0x7f94f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:45.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.929+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f951002d040 con 0x7f9514070a30 2023-10-16T08:52:45.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.929+0000 7f9519c82640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94f806aec0 0x7f94f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:45.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.930+0000 7f9519c82640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94f806aec0 0x7f94f806d380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9504007fd0 tx=0x7f9504009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:45.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:45.934+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95140c55b0 con 0x7f9514070a30 2023-10-16T08:52:46.126 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.124+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9514151890 con 0x7f9514070a30 2023-10-16T08:52:46.127 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.125+0000 7f950affd640 1 -- 172.21.15.94:0/1035715855 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9514151890 con 0x7f9514070a30 2023-10-16T08:52:46.127 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:46.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.127+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94f806aec0 msgr2=0x7f94f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.127+0000 7f951c6e7640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94f806aec0 0x7f94f806d380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9504007fd0 tx=0x7f9504009040 comp rx=0 tx=0).stop 2023-10-16T08:52:46.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.127+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 msgr2=0x7f95140c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.130 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.127+0000 7f951c6e7640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 0x7f95140c8210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9510000c00 tx=0x7f95100046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 shutdown_connections 2023-10-16T08:52:46.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f951415a830 0x7f9514151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f94f806aec0 0x7f94f806d380 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95140ca550 0x7f95141f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.131 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 --2- 172.21.15.94:0/1035715855 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9514070a30 0x7f95140c8210 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.132 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 >> 172.21.15.94:0/1035715855 conn(0x7f95140b0030 msgr2=0x7f9514159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:46.132 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 shutdown_connections 2023-10-16T08:52:46.132 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.128+0000 7f951c6e7640 1 -- 172.21.15.94:0/1035715855 wait complete. 2023-10-16T08:52:46.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:46.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.363+0000 7f6d668e1640 1 Processor -- start 2023-10-16T08:52:46.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.363+0000 7f6d668e1640 1 -- start start 2023-10-16T08:52:46.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d668e1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d60159890 0x7f6d60071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d668e1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d60072480 con 0x7f6d600ca110 2023-10-16T08:52:46.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d668e1640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600cd0c0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d668e1640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6015e210 con 0x7f6d60159890 2023-10-16T08:52:46.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d5ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d60159890 0x7f6d60071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d5ffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d60159890 0x7f6d60071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40802/0 (socket says 172.21.15.94:40802) 2023-10-16T08:52:46.368 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.365+0000 7f6d5ffff640 1 -- 172.21.15.94:0/4091292373 learned_addr learned my addr 172.21.15.94:0/4091292373 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:46.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.366+0000 7f6d5ffff640 1 -- 172.21.15.94:0/4091292373 >> v1:172.21.15.130:6789/0 conn(0x7f6d600ca5a0 legacy=0x7f6d6015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:46.369 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.366+0000 7f6d5ffff640 1 -- 172.21.15.94:0/4091292373 >> v1:172.21.15.94:6789/0 conn(0x7f6d600ca110 legacy=0x7f6d6015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.366+0000 7f6d5ffff640 1 -- 172.21.15.94:0/4091292373 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600caa10 con 0x7f6d60159890 2023-10-16T08:52:46.370 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.366+0000 7f6d5effd640 1 -- 172.21.15.94:0/4091292373 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962059821 0 0) 0x7f6d60072480 con 0x7f6d600ca110 2023-10-16T08:52:46.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.367+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/4091292373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d60159890 0x7f6d60071f40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009e50 tx=0x7f6d5002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51dd0399c2f6aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:46.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.367+0000 7f6d5effd640 1 -- 172.21.15.94:0/4091292373 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5002cb20 con 0x7f6d60159890 2023-10-16T08:52:46.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.367+0000 7f6d5effd640 1 -- 172.21.15.94:0/4091292373 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5002cc80 con 0x7f6d60159890 2023-10-16T08:52:46.371 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.367+0000 7f6d5effd640 1 -- 172.21.15.94:0/4091292373 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500343f0 con 0x7f6d60159890 2023-10-16T08:52:46.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 -- 172.21.15.94:0/4091292373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d60159890 msgr2=0x7f6d60071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 --2- 172.21.15.94:0/4091292373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d60159890 0x7f6d60071f40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009e50 tx=0x7f6d5002bf80 comp rx=0 tx=0).stop 2023-10-16T08:52:46.372 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 -- 172.21.15.94:0/4091292373 shutdown_connections 2023-10-16T08:52:46.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 --2- 172.21.15.94:0/4091292373 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d60159890 0x7f6d60071f40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 -- 172.21.15.94:0/4091292373 >> 172.21.15.94:0/4091292373 conn(0x7f6d600b0030 msgr2=0x7f6d600b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:46.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 -- 172.21.15.94:0/4091292373 shutdown_connections 2023-10-16T08:52:46.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.368+0000 7f6d668e1640 1 -- 172.21.15.94:0/4091292373 wait complete. 2023-10-16T08:52:46.373 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.370+0000 7f6d668e1640 1 Processor -- start 2023-10-16T08:52:46.374 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.370+0000 7f6d668e1640 1 -- start start 2023-10-16T08:52:46.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d668e1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d600ca110 0x7f6d600c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d668e1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 0x7f6d600c1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d668e1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d60159890 0x7f6d600c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d668e1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600c7de0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.377 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d668e1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600ac730 con 0x7f6d600ca110 2023-10-16T08:52:46.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d668e1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d600c6ae0 con 0x7f6d60159890 2023-10-16T08:52:46.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 0x7f6d600c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 0x7f6d600c1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40816/0 (socket says 172.21.15.94:40816) 2023-10-16T08:52:46.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3446844203 learned_addr learned my addr 172.21.15.94:0/3446844203 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:46.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.371+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d600ca110 0x7f6d600c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d64e7e640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d60159890 0x7f6d600c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d60159890 msgr2=0x7f6d600c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d60159890 0x7f6d600c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d600ca110 msgr2=0x7f6d600c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d600ca110 0x7f6d600c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5f7fe640 1 -- 172.21.15.94:0/3446844203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009b30 con 0x7f6d600ca5a0 2023-10-16T08:52:46.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d600ca110 0x7f6d600c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:46.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d64e7e640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d60159890 0x7f6d600c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:46.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5f7fe640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 0x7f6d600c1520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c3e0 tx=0x7f6d4800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:46.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480052d0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48005430 con 0x7f6d600ca5a0 2023-10-16T08:52:46.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d600c6dc0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48003830 con 0x7f6d600ca5a0 2023-10-16T08:52:46.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.372+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d600c7380 con 0x7f6d600ca5a0 2023-10-16T08:52:46.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.373+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d60073ef0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.374+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d48003990 con 0x7f6d600ca5a0 2023-10-16T08:52:46.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.375+0000 7f6d5cff9640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d4006aea0 0x7f6d4006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.375+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d48088fe0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.376+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d4006aea0 0x7f6d4006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.376+0000 7f6d5ffff640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d4006aea0 0x7f6d4006d360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6d50035000 tx=0x7f6d50030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:46.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.379+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d48053c70 con 0x7f6d600ca5a0 2023-10-16T08:52:46.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.570+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d600cd290 con 0x7f6d600ca5a0 2023-10-16T08:52:46.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.571+0000 7f6d5cff9640 1 -- 172.21.15.94:0/3446844203 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d480170a0 con 0x7f6d600ca5a0 2023-10-16T08:52:46.573 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:46.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.573+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d4006aea0 msgr2=0x7f6d4006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.573+0000 7f6d668e1640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d4006aea0 0x7f6d4006d360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6d50035000 tx=0x7f6d50030000 comp rx=0 tx=0).stop 2023-10-16T08:52:46.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 msgr2=0x7f6d600c1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 0x7f6d600c1520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c3e0 tx=0x7f6d4800c8a0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 shutdown_connections 2023-10-16T08:52:46.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d60159890 0x7f6d600c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d600ca5a0 0x7f6d600c1520 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d4006aea0 0x7f6d4006d360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 --2- 172.21.15.94:0/3446844203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d600ca110 0x7f6d600c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 >> 172.21.15.94:0/3446844203 conn(0x7f6d600b0030 msgr2=0x7f6d600c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:46.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 shutdown_connections 2023-10-16T08:52:46.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.574+0000 7f6d668e1640 1 -- 172.21.15.94:0/3446844203 wait complete. 2023-10-16T08:52:46.595 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:46.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.797+0000 7f473a256640 1 Processor -- start 2023-10-16T08:52:46.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.797+0000 7f473a256640 1 -- start start 2023-10-16T08:52:46.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.798+0000 7f473a256640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f473415a830 0x7f47340cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.798+0000 7f473a256640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f47340ca550 0x7f4734070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.798+0000 7f473a256640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340cf040 con 0x7f4734070860 2023-10-16T08:52:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.798+0000 7f473a256640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4734070cf0 con 0x7f47340ca550 2023-10-16T08:52:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.798+0000 7f473a256640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47340ca9e0 con 0x7f473415a830 2023-10-16T08:52:46.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f47340ca550 0x7f4734070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f47340ca550 0x7f4734070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40832/0 (socket says 172.21.15.94:40832) 2023-10-16T08:52:46.802 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 -- 172.21.15.94:0/2244768186 learned_addr learned my addr 172.21.15.94:0/2244768186 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:46.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 -- 172.21.15.94:0/2244768186 >> v2:172.21.15.130:3300/0 conn(0x7f473415a830 msgr2=0x7f47340cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:46.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 --2- 172.21.15.94:0/2244768186 >> v2:172.21.15.130:3300/0 conn(0x7f473415a830 0x7f47340cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 -- 172.21.15.94:0/2244768186 >> v1:172.21.15.130:6789/0 conn(0x7f4734070860 legacy=0x7f473415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:46.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.799+0000 7f472bfff640 1 -- 172.21.15.94:0/2244768186 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340ce430 con 0x7f47340ca550 2023-10-16T08:52:46.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.800+0000 7f472bfff640 1 --2- 172.21.15.94:0/2244768186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47340ca550 0x7f4734070320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f47340cf570 tx=0x7f471c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebf4ee128ab4769 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:46.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.800+0000 7f4732ffd640 1 -- 172.21.15.94:0/2244768186 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c031870 con 0x7f47340ca550 2023-10-16T08:52:46.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.800+0000 7f4732ffd640 1 -- 172.21.15.94:0/2244768186 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0319d0 con 0x7f47340ca550 2023-10-16T08:52:46.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.800+0000 7f4732ffd640 1 -- 172.21.15.94:0/2244768186 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c031d60 con 0x7f47340ca550 2023-10-16T08:52:46.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 -- 172.21.15.94:0/2244768186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47340ca550 msgr2=0x7f4734070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 --2- 172.21.15.94:0/2244768186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47340ca550 0x7f4734070320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f47340cf570 tx=0x7f471c02b910 comp rx=0 tx=0).stop 2023-10-16T08:52:46.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 -- 172.21.15.94:0/2244768186 shutdown_connections 2023-10-16T08:52:46.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 --2- 172.21.15.94:0/2244768186 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f47340ca550 0x7f4734070320 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 --2- 172.21.15.94:0/2244768186 >> v2:172.21.15.130:3300/0 conn(0x7f473415a830 0x7f47340cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 -- 172.21.15.94:0/2244768186 >> 172.21.15.94:0/2244768186 conn(0x7f47340b0030 msgr2=0x7f47340b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:46.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 -- 172.21.15.94:0/2244768186 shutdown_connections 2023-10-16T08:52:46.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.801+0000 7f473a256640 1 -- 172.21.15.94:0/2244768186 wait complete. 2023-10-16T08:52:46.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.803+0000 7f473a256640 1 Processor -- start 2023-10-16T08:52:46.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.803+0000 7f473a256640 1 -- start start 2023-10-16T08:52:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f473a256640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 0x7f47341f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f473a256640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f47340ca550 0x7f47340a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.812 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f473a256640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473415a830 0x7f4734159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f473a256640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47341f3160 con 0x7f4734070860 2023-10-16T08:52:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f473a256640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c5670 con 0x7f473415a830 2023-10-16T08:52:46.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f473a256640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340a7810 con 0x7f47340ca550 2023-10-16T08:52:46.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 0x7f47341f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 0x7f47341f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40842/0 (socket says 172.21.15.94:40842) 2023-10-16T08:52:46.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 -- 172.21.15.94:0/4036489839 learned_addr learned my addr 172.21.15.94:0/4036489839 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 -- 172.21.15.94:0/4036489839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f47340ca550 msgr2=0x7f47340a81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f47340ca550 0x7f47340a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 -- 172.21.15.94:0/4036489839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473415a830 msgr2=0x7f4734159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473415a830 0x7f4734159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.804+0000 7f47337fe640 1 -- 172.21.15.94:0/4036489839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0094d0 con 0x7f4734070860 2023-10-16T08:52:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.805+0000 7f47337fe640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 0x7f47341f2c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f472400b410 tx=0x7f472400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:46.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.805+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724011830 con 0x7f4734070860 2023-10-16T08:52:46.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.805+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47240119b0 con 0x7f4734070860 2023-10-16T08:52:46.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.805+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724011d60 con 0x7f4734070860 2023-10-16T08:52:46.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.805+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47340c5910 con 0x7f4734070860 2023-10-16T08:52:46.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.805+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47340ad270 con 0x7f4734070860 2023-10-16T08:52:46.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.806+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47340c5e30 con 0x7f4734070860 2023-10-16T08:52:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.807+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f472401a400 con 0x7f4734070860 2023-10-16T08:52:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.808+0000 7f4730ff9640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f471406ae70 0x7f471406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:46.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.808+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4724089b80 con 0x7f4734070860 2023-10-16T08:52:46.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.808+0000 7f472bfff640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f471406ae70 0x7f471406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:46.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.809+0000 7f472bfff640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f471406ae70 0x7f471406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f471c036000 tx=0x7f471c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:46.822 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.812+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47340c5e30 con 0x7f4734070860 2023-10-16T08:52:46.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.992+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f47340c5e30 con 0x7f4734070860 2023-10-16T08:52:46.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.993+0000 7f4730ff9640 1 -- 172.21.15.94:0/4036489839 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4724015020 con 0x7f4734070860 2023-10-16T08:52:46.996 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:46.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f471406ae70 msgr2=0x7f471406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f471406ae70 0x7f471406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f471c036000 tx=0x7f471c030000 comp rx=0 tx=0).stop 2023-10-16T08:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 msgr2=0x7f47341f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 0x7f47341f2c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f472400b410 tx=0x7f472400b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 shutdown_connections 2023-10-16T08:52:46.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f471406ae70 0x7f471406d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f473415a830 0x7f4734159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f47340ca550 0x7f47340a81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 --2- 172.21.15.94:0/4036489839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4734070860 0x7f47341f2c20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 >> 172.21.15.94:0/4036489839 conn(0x7f47340b0030 msgr2=0x7f47340c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:47.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 shutdown_connections 2023-10-16T08:52:47.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:46.996+0000 7f473a256640 1 -- 172.21.15.94:0/4036489839 wait complete. 2023-10-16T08:52:47.015 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.221+0000 7f374232c640 1 Processor -- start 2023-10-16T08:52:47.223 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.221+0000 7f374232c640 1 -- start start 2023-10-16T08:52:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f374232c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 0x7f373c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f374232c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c15a2c0 con 0x7f373c15d700 2023-10-16T08:52:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f374232c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c15a5a0 con 0x7f373c06d440 2023-10-16T08:52:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f374232c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c15a880 con 0x7f373c159c80 2023-10-16T08:52:47.225 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f373bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f373c15d700 0x7f373c15dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60402/0 (socket says 172.21.15.94:60402) 2023-10-16T08:52:47.226 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f373bfff640 1 -- 172.21.15.94:0/3544068678 learned_addr learned my addr 172.21.15.94:0/3544068678 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:47.228 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799402345 0 0) 0x7f373c15a2c0 con 0x7f373c15d700 2023-10-16T08:52:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3724005730 con 0x7f373c15d700 2023-10-16T08:52:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.223+0000 7f373b7fe640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 0x7f373c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3021729573 0 0) 0x7f3724005730 con 0x7f373c15d700 2023-10-16T08:52:47.229 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 msgr2=0x7f373c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:47.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 0x7f373c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 >> v1:172.21.15.130:6789/0 conn(0x7f373c06d440 legacy=0x7f373c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c15ab60 con 0x7f373c15d700 2023-10-16T08:52:47.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f372c001670 con 0x7f373c15d700 2023-10-16T08:52:47.230 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 >> v1:172.21.15.94:6789/0 conn(0x7f373c15d700 legacy=0x7f373c15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 0x7f3724005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3724006130 0x7f37240069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006f10 0x7f3724007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.231 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c15a880 con 0x7f3724006130 2023-10-16T08:52:47.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372400dc70 con 0x7f3724006f10 2023-10-16T08:52:47.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372400de30 con 0x7f373c159c80 2023-10-16T08:52:47.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373b7fe640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3724006130 0x7f37240069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.224+0000 7f373bfff640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 0x7f3724005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.225+0000 7f37408c9640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006f10 0x7f3724007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.232 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.225+0000 7f373b7fe640 1 -- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 msgr2=0x7f3724005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:47.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.225+0000 7f373b7fe640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c159c80 0x7f3724005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.225+0000 7f373b7fe640 1 -- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006f10 msgr2=0x7f3724007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:47.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.225+0000 7f373b7fe640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006f10 0x7f3724007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.233 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.225+0000 7f373b7fe640 1 -- 172.21.15.94:0/3544068678 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724005730 con 0x7f3724006130 2023-10-16T08:52:47.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.226+0000 7f373b7fe640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3724006130 0x7f37240069d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ac0 tx=0x7f3724007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98379a1273ec6887 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:47.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.226+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373002c6b0 con 0x7f3724006130 2023-10-16T08:52:47.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.226+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373002c810 con 0x7f3724006130 2023-10-16T08:52:47.234 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.226+0000 7f373affd640 1 -- 172.21.15.94:0/3544068678 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373002cba0 con 0x7f3724006130 2023-10-16T08:52:47.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.226+0000 7f374232c640 1 -- 172.21.15.94:0/3544068678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3724006130 msgr2=0x7f37240069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.227+0000 7f374232c640 1 --2- 172.21.15.94:0/3544068678 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3724006130 0x7f37240069d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ac0 tx=0x7f3724007a00 comp rx=0 tx=0).stop 2023-10-16T08:52:47.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.227+0000 7f37408c9640 1 -- 172.21.15.94:0/3544068678 reap_dead start 2023-10-16T08:52:47.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.227+0000 7f374232c640 1 -- 172.21.15.94:0/3544068678 shutdown_connections 2023-10-16T08:52:47.236 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.227+0000 7f374232c640 1 -- 172.21.15.94:0/3544068678 >> 172.21.15.94:0/3544068678 conn(0x7f373c0cb1b0 msgr2=0x7f373c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:47.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.227+0000 7f374232c640 1 -- 172.21.15.94:0/3544068678 shutdown_connections 2023-10-16T08:52:47.237 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.227+0000 7f374232c640 1 -- 172.21.15.94:0/3544068678 wait complete. 2023-10-16T08:52:47.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.228+0000 7f374232c640 1 Processor -- start 2023-10-16T08:52:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.229+0000 7f374232c640 1 -- start start 2023-10-16T08:52:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f374232c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006130 0x7f373c156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f374232c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 0x7f373c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.240 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f374232c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c0cdf20 0x7f373c1f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f374232c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c15b420 con 0x7f373c0ca330 2023-10-16T08:52:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f374232c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0ce3a0 con 0x7f3724006130 2023-10-16T08:52:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f374232c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0c3230 con 0x7f373c0cdf20 2023-10-16T08:52:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 0x7f373c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.241 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 0x7f373c0cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40850/0 (socket says 172.21.15.94:40850) 2023-10-16T08:52:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 -- 172.21.15.94:0/1643817668 learned_addr learned my addr 172.21.15.94:0/1643817668 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 -- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c0cdf20 msgr2=0x7f373c1f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c0cdf20 0x7f373c1f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 -- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006130 msgr2=0x7f373c156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373bfff640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006130 0x7f373c156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006130 0x7f373c156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.230+0000 7f373b7fe640 1 -- 172.21.15.94:0/1643817668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0c2620 con 0x7f373c0ca330 2023-10-16T08:52:47.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.231+0000 7f373b7fe640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 0x7f373c0cd9e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3730037040 tx=0x7f3730004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:47.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.231+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730003810 con 0x7f373c0ca330 2023-10-16T08:52:47.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.231+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730003970 con 0x7f373c0ca330 2023-10-16T08:52:47.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.231+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c0c2900 con 0x7f373c0ca330 2023-10-16T08:52:47.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.231+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730003ce0 con 0x7f373c0ca330 2023-10-16T08:52:47.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.231+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c0c2ec0 con 0x7f373c0ca330 2023-10-16T08:52:47.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.232+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c073ef0 con 0x7f373c0ca330 2023-10-16T08:52:47.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.233+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3730034440 con 0x7f373c0ca330 2023-10-16T08:52:47.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.234+0000 7f3738ff9640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f372806aea0 0x7f372806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.234+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37300ab860 con 0x7f373c0ca330 2023-10-16T08:52:47.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.234+0000 7f373bfff640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f372806aea0 0x7f372806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.235+0000 7f373bfff640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f372806aea0 0x7f372806d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f372c000f60 tx=0x7f372c000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:47.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.239+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37300767b0 con 0x7f373c0ca330 2023-10-16T08:52:47.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.440+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f373c1571c0 con 0x7f373c0ca330 2023-10-16T08:52:47.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.441+0000 7f3738ff9640 1 -- 172.21.15.94:0/1643817668 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f37300044e0 con 0x7f373c0ca330 2023-10-16T08:52:47.443 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:47.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f372806aea0 msgr2=0x7f372806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f372806aea0 0x7f372806d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f372c000f60 tx=0x7f372c000ed0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.446 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 msgr2=0x7f373c0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 0x7f373c0cd9e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3730037040 tx=0x7f3730004730 comp rx=0 tx=0).stop 2023-10-16T08:52:47.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 shutdown_connections 2023-10-16T08:52:47.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f373c0cdf20 0x7f373c1f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f373c0ca330 0x7f373c0cd9e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.447 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f372806aea0 0x7f372806d360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 --2- 172.21.15.94:0/1643817668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3724006130 0x7f373c156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 >> 172.21.15.94:0/1643817668 conn(0x7f373c0cb1b0 msgr2=0x7f373c070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:47.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 shutdown_connections 2023-10-16T08:52:47.448 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.444+0000 7f374232c640 1 -- 172.21.15.94:0/1643817668 wait complete. 2023-10-16T08:52:47.465 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T08:52:47.465 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T08:52:47.525 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:47.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.741+0000 7fdcb685d640 1 Processor -- start 2023-10-16T08:52:47.743 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.741+0000 7fdcb685d640 1 -- start start 2023-10-16T08:52:47.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.742+0000 7fdcb685d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdcb00b0010 0x7fdcb00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcb685d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdcb015ad00 0x7fdcb015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcb685d640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb015f580 con 0x7fdcb00b03f0 2023-10-16T08:52:47.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcb685d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00707f0 con 0x7fdcb015ad00 2023-10-16T08:52:47.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcb685d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb0070ad0 con 0x7fdcb00b0010 2023-10-16T08:52:47.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcb4dfa640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdcb00b03f0 0x7fdcb015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60412/0 (socket says 172.21.15.94:60412) 2023-10-16T08:52:47.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcb4dfa640 1 -- 172.21.15.94:0/3278717133 learned_addr learned my addr 172.21.15.94:0/3278717133 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:47.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdca7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdcb015ad00 0x7fdcb015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcaf7fe640 1 -- 172.21.15.94:0/3278717133 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008445951 0 0) 0x7fdca8001490 con 0x7fdcb00b03f0 2023-10-16T08:52:47.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.743+0000 7fdcaf7fe640 1 -- 172.21.15.94:0/3278717133 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc9c003520 con 0x7fdcb00b03f0 2023-10-16T08:52:47.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.744+0000 7fdcaffff640 1 --2- 172.21.15.94:0/3278717133 >> v2:172.21.15.130:3300/0 conn(0x7fdcb00b0010 0x7fdcb00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.744+0000 7fdca7fff640 1 -- 172.21.15.94:0/3278717133 >> v2:172.21.15.130:3300/0 conn(0x7fdcb00b0010 msgr2=0x7fdcb00701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:47.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.744+0000 7fdca7fff640 1 --2- 172.21.15.94:0/3278717133 >> v2:172.21.15.130:3300/0 conn(0x7fdcb00b0010 0x7fdcb00701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.744+0000 7fdca7fff640 1 -- 172.21.15.94:0/3278717133 >> v1:172.21.15.94:6789/0 conn(0x7fdcb00b03f0 legacy=0x7fdcb015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.744+0000 7fdca7fff640 1 -- 172.21.15.94:0/3278717133 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb015b1d0 con 0x7fdcb015ad00 2023-10-16T08:52:47.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.744+0000 7fdcaffff640 1 --2- 172.21.15.94:0/3278717133 >> v2:172.21.15.130:3300/0 conn(0x7fdcb00b0010 0x7fdcb00701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:47.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.745+0000 7fdca7fff640 1 --2- 172.21.15.94:0/3278717133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb015ad00 0x7fdcb015f040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00cf690 tx=0x7fdc9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600cf54de5473bab server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:47.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.745+0000 7fdcaf7fe640 1 -- 172.21.15.94:0/3278717133 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98031830 con 0x7fdcb015ad00 2023-10-16T08:52:47.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.745+0000 7fdcaf7fe640 1 -- 172.21.15.94:0/3278717133 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98031990 con 0x7fdcb015ad00 2023-10-16T08:52:47.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.745+0000 7fdcaf7fe640 1 -- 172.21.15.94:0/3278717133 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98031d20 con 0x7fdcb015ad00 2023-10-16T08:52:47.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 -- 172.21.15.94:0/3278717133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb015ad00 msgr2=0x7fdcb015f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.750 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3278717133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb015ad00 0x7fdcb015f040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00cf690 tx=0x7fdc9802b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 -- 172.21.15.94:0/3278717133 shutdown_connections 2023-10-16T08:52:47.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3278717133 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb015ad00 0x7fdcb015f040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3278717133 >> v2:172.21.15.130:3300/0 conn(0x7fdcb00b0010 0x7fdcb00701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 -- 172.21.15.94:0/3278717133 >> 172.21.15.94:0/3278717133 conn(0x7fdcb006c1c0 msgr2=0x7fdcb006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:47.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 -- 172.21.15.94:0/3278717133 shutdown_connections 2023-10-16T08:52:47.751 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.746+0000 7fdcb685d640 1 -- 172.21.15.94:0/3278717133 wait complete. 2023-10-16T08:52:47.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.748+0000 7fdcb685d640 1 Processor -- start 2023-10-16T08:52:47.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.748+0000 7fdcb685d640 1 -- start start 2023-10-16T08:52:47.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdcb685d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b0010 0x7fdcb0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdcb685d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 0x7fdcb00c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdcb685d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb015ad00 0x7fdcb00c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdcb685d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c6fb0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdcb685d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c7290 con 0x7fdcb015ad00 2023-10-16T08:52:47.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdcb685d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c7570 con 0x7fdcb00b0010 2023-10-16T08:52:47.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 0x7fdcb00c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 0x7fdcb00c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40874/0 (socket says 172.21.15.94:40874) 2023-10-16T08:52:47.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.749+0000 7fdca7fff640 1 -- 172.21.15.94:0/3386915551 learned_addr learned my addr 172.21.15.94:0/3386915551 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:47.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdcaffff640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b0010 0x7fdcb0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdca7fff640 1 -- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b0010 msgr2=0x7fdcb0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdca7fff640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b0010 0x7fdcb0158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdca7fff640 1 -- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb015ad00 msgr2=0x7fdcb00c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdca7fff640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb015ad00 0x7fdcb00c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdca7fff640 1 -- 172.21.15.94:0/3386915551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009400 con 0x7fdcb00b03f0 2023-10-16T08:52:47.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdca7fff640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 0x7fdcb00c66b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdc98000c00 tx=0x7fdc980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:47.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9803a8f0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9803aa70 con 0x7fdcb00b03f0 2023-10-16T08:52:47.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb00b11b0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.750+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9803ae20 con 0x7fdcb00b03f0 2023-10-16T08:52:47.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.751+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb0159290 con 0x7fdcb00b03f0 2023-10-16T08:52:47.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.752+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb00b16d0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.760 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.753+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdc9804d450 con 0x7fdcb00b03f0 2023-10-16T08:52:47.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.753+0000 7fdcad7fa640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdc9006aea0 0x7fdc9006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:47.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.754+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc980ab9b0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.754+0000 7fdcaffff640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdc9006aea0 0x7fdc9006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:47.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.754+0000 7fdcaffff640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdc9006aea0 0x7fdc9006d360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdca0008850 tx=0x7fdca0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:47.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.758+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcb00b16d0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.949+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcb00b16d0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.952 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.950+0000 7fdcad7fa640 1 -- 172.21.15.94:0/3386915551 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7fdcb00b16d0 con 0x7fdcb00b03f0 2023-10-16T08:52:47.953 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:47.953 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:47.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdc9006aea0 msgr2=0x7fdc9006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdc9006aea0 0x7fdc9006d360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdca0008850 tx=0x7fdca0008040 comp rx=0 tx=0).stop 2023-10-16T08:52:47.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 msgr2=0x7fdcb00c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:47.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 0x7fdcb00c66b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdc98000c00 tx=0x7fdc980046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 shutdown_connections 2023-10-16T08:52:47.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fdc9006aea0 0x7fdc9006d360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcb015ad00 0x7fdcb00c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdcb00b03f0 0x7fdcb00c66b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 --2- 172.21.15.94:0/3386915551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdcb00b0010 0x7fdcb0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:47.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 >> 172.21.15.94:0/3386915551 conn(0x7fdcb006c1c0 msgr2=0x7fdcb00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:47.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.953+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 shutdown_connections 2023-10-16T08:52:47.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:47.954+0000 7fdcb685d640 1 -- 172.21.15.94:0/3386915551 wait complete. 2023-10-16T08:52:47.974 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:47.974 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:48.185 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.183+0000 7fc835cdf640 1 Processor -- start 2023-10-16T08:52:48.186 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.184+0000 7fc835cdf640 1 -- start start 2023-10-16T08:52:48.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.185+0000 7fc835cdf640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc83006de60 0x7fc83015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.185+0000 7fc835cdf640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83015d4d0 con 0x7fc830160420 2023-10-16T08:52:48.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.185+0000 7fc835cdf640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc830160ee0 con 0x7fc830071160 2023-10-16T08:52:48.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.185+0000 7fc835cdf640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8301611c0 con 0x7fc83006de60 2023-10-16T08:52:48.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc830160420 0x7fc830070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60424/0 (socket says 172.21.15.94:60424) 2023-10-16T08:52:48.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82ffff640 1 -- 172.21.15.94:0/2606157947 learned_addr learned my addr 172.21.15.94:0/2606157947 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:48.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc834cdd640 1 --2- 172.21.15.94:0/2606157947 >> v2:172.21.15.130:3300/0 conn(0x7fc83006de60 0x7fc83015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405697618 0 0) 0x7fc83015d4d0 con 0x7fc830160420 2023-10-16T08:52:48.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81c003520 con 0x7fc830160420 2023-10-16T08:52:48.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623780707 0 0) 0x7fc81c003520 con 0x7fc830160420 2023-10-16T08:52:48.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 >> v2:172.21.15.130:3300/0 conn(0x7fc83006de60 msgr2=0x7fc83015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:48.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 --2- 172.21.15.94:0/2606157947 >> v2:172.21.15.130:3300/0 conn(0x7fc83006de60 0x7fc83015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 >> v1:172.21.15.130:6789/0 conn(0x7fc830071160 legacy=0x7fc83006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83015d160 con 0x7fc830160420 2023-10-16T08:52:48.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.186+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fc818001670 con 0x7fc830160420 2023-10-16T08:52:48.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 >> v1:172.21.15.94:6789/0 conn(0x7fc830160420 legacy=0x7fc830070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c003970 0x7fc81c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc81c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c005180 0x7fc81c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.192 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301611c0 con 0x7fc81c0047c0 2023-10-16T08:52:48.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c00c020 con 0x7fc81c005180 2023-10-16T08:52:48.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c00c1e0 con 0x7fc81c003970 2023-10-16T08:52:48.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc81c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82ffff640 1 -- 172.21.15.94:0/2606157947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c003970 msgr2=0x7fc81c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:48.193 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc81c003970 0x7fc81c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82ffff640 1 -- 172.21.15.94:0/2606157947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c005180 msgr2=0x7fc81c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:48.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc81c005180 0x7fc81c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc82ffff640 1 -- 172.21.15.94:0/2606157947 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c003520 con 0x7fc81c0047c0 2023-10-16T08:52:48.194 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.187+0000 7fc8354de640 1 -- 172.21.15.94:0/2606157947 reap_dead start 2023-10-16T08:52:48.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.188+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc81c004c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c240 tx=0x7fc81c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ccb78fc31f3de2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:48.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818005ad0 con 0x7fc81c0047c0 2023-10-16T08:52:48.197 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc818005c30 con 0x7fc81c0047c0 2023-10-16T08:52:48.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc82f7fe640 1 -- 172.21.15.94:0/2606157947 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81802caf0 con 0x7fc81c0047c0 2023-10-16T08:52:48.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 -- 172.21.15.94:0/2606157947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 msgr2=0x7fc81c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc81c004c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c240 tx=0x7fc81c0057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.198 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 -- 172.21.15.94:0/2606157947 shutdown_connections 2023-10-16T08:52:48.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2606157947 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc81c004c40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 -- 172.21.15.94:0/2606157947 >> 172.21.15.94:0/2606157947 conn(0x7fc8300cef70 msgr2=0x7fc8300cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:48.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 -- 172.21.15.94:0/2606157947 shutdown_connections 2023-10-16T08:52:48.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.189+0000 7fc835cdf640 1 -- 172.21.15.94:0/2606157947 wait complete. 2023-10-16T08:52:48.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.191+0000 7fc835cdf640 1 Processor -- start 2023-10-16T08:52:48.199 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.191+0000 7fc835cdf640 1 -- start start 2023-10-16T08:52:48.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc835cdf640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc83015f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc835cdf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8300b18a0 0x7fc8301f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc835cdf640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8300aecf0 0x7fc8300af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.200 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc835cdf640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300af6c0 con 0x7fc81c0047c0 2023-10-16T08:52:48.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc835cdf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83015feb0 con 0x7fc8300b18a0 2023-10-16T08:52:48.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc835cdf640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301f1ef0 con 0x7fc8300aecf0 2023-10-16T08:52:48.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.192+0000 7fc834cdd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc83015f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc83015f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40900/0 (socket says 172.21.15.94:40900) 2023-10-16T08:52:48.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 -- 172.21.15.94:0/2029037204 learned_addr learned my addr 172.21.15.94:0/2029037204 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:48.201 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8300b18a0 0x7fc8301f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc8354de640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8300aecf0 0x7fc8300af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 -- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8300aecf0 msgr2=0x7fc8300af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8300aecf0 0x7fc8300af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 -- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8300b18a0 msgr2=0x7fc8301f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.202 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8300b18a0 0x7fc8301f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 -- 172.21.15.94:0/2029037204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83015a9a0 con 0x7fc81c0047c0 2023-10-16T08:52:48.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8300b18a0 0x7fc8301f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:48.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc834cdd640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc83015f970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc82000efa0 tx=0x7fc82000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:48.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.193+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000cea0 con 0x7fc81c0047c0 2023-10-16T08:52:48.203 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.194+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000f040 con 0x7fc81c0047c0 2023-10-16T08:52:48.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.194+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200146c0 con 0x7fc81c0047c0 2023-10-16T08:52:48.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.194+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8300b1da0 con 0x7fc81c0047c0 2023-10-16T08:52:48.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.194+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83015aed0 con 0x7fc81c0047c0 2023-10-16T08:52:48.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.195+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83004e9b0 con 0x7fc81c0047c0 2023-10-16T08:52:48.204 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.196+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc820014820 con 0x7fc81c0047c0 2023-10-16T08:52:48.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.197+0000 7fc82d7fa640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc81006ae70 0x7fc81006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.205 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.197+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc82008a790 con 0x7fc81c0047c0 2023-10-16T08:52:48.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.197+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc81006ae70 0x7fc81006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.198+0000 7fc82ffff640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc81006ae70 0x7fc81006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc818034000 tx=0x7fc818009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:48.206 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.201+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc820055470 con 0x7fc81c0047c0 2023-10-16T08:52:48.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.390+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc830069eb0 con 0x7fc81c0047c0 2023-10-16T08:52:48.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.391+0000 7fc82d7fa640 1 -- 172.21.15.94:0/2029037204 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc820058a90 con 0x7fc81c0047c0 2023-10-16T08:52:48.393 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:48.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.393+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc81006ae70 msgr2=0x7fc81006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.393+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc81006ae70 0x7fc81006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc818034000 tx=0x7fc818009030 comp rx=0 tx=0).stop 2023-10-16T08:52:48.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.393+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 msgr2=0x7fc83015f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.393+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc83015f970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc82000efa0 tx=0x7fc82000c490 comp rx=0 tx=0).stop 2023-10-16T08:52:48.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 shutdown_connections 2023-10-16T08:52:48.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc8300aecf0 0x7fc8300af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc81006ae70 0x7fc81006d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8300b18a0 0x7fc8301f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 --2- 172.21.15.94:0/2029037204 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc81c0047c0 0x7fc83015f970 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 >> 172.21.15.94:0/2029037204 conn(0x7fc8300cef70 msgr2=0x7fc8300cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:48.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 shutdown_connections 2023-10-16T08:52:48.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.394+0000 7fc835cdf640 1 -- 172.21.15.94:0/2029037204 wait complete. 2023-10-16T08:52:48.413 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:48.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.630+0000 7f3685b9e640 1 Processor -- start 2023-10-16T08:52:48.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.630+0000 7f3685b9e640 1 -- start start 2023-10-16T08:52:48.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.631+0000 7f3685b9e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f368006adf0 0x7f36800cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.631+0000 7f3685b9e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 0x7f36800b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.631+0000 7f3685b9e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800cd430 con 0x7f368006b1d0 2023-10-16T08:52:48.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.631+0000 7f3685b9e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800ccb00 con 0x7f368006adf0 2023-10-16T08:52:48.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.631+0000 7f3685b9e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800ccde0 con 0x7f36800b1c50 2023-10-16T08:52:48.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.632+0000 7f367f7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f368006adf0 0x7f36800cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.632+0000 7f367ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 0x7f36800b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.632+0000 7f367ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 0x7f36800b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:54284/0 (socket says 172.21.15.94:54284) 2023-10-16T08:52:48.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.632+0000 7f367ffff640 1 -- 172.21.15.94:0/3005534294 learned_addr learned my addr 172.21.15.94:0/3005534294 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:48.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.633+0000 7f367ffff640 1 -- 172.21.15.94:0/3005534294 >> v2:172.21.15.130:3300/0 conn(0x7f368006adf0 msgr2=0x7f36800cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:48.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.633+0000 7f367ffff640 1 --2- 172.21.15.94:0/3005534294 >> v2:172.21.15.130:3300/0 conn(0x7f368006adf0 0x7f36800cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.633+0000 7f367ffff640 1 -- 172.21.15.94:0/3005534294 >> v1:172.21.15.130:6789/0 conn(0x7f368006b1d0 legacy=0x7f36800cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.633+0000 7f367ffff640 1 -- 172.21.15.94:0/3005534294 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800cd0c0 con 0x7f36800b1c50 2023-10-16T08:52:48.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.634+0000 7f367ffff640 1 --2- 172.21.15.94:0/3005534294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 0x7f36800b20c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3678009e50 tx=0x7f367802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310c33c66c06407d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:48.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.635+0000 7f367e7fc640 1 -- 172.21.15.94:0/3005534294 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367802c9f0 con 0x7f36800b1c50 2023-10-16T08:52:48.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.635+0000 7f367e7fc640 1 -- 172.21.15.94:0/3005534294 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367802cb50 con 0x7f36800b1c50 2023-10-16T08:52:48.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.635+0000 7f367e7fc640 1 -- 172.21.15.94:0/3005534294 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780343f0 con 0x7f36800b1c50 2023-10-16T08:52:48.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.635+0000 7f3685b9e640 1 -- 172.21.15.94:0/3005534294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 msgr2=0x7f36800b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 --2- 172.21.15.94:0/3005534294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 0x7f36800b20c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3678009e50 tx=0x7f367802be50 comp rx=0 tx=0).stop 2023-10-16T08:52:48.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 -- 172.21.15.94:0/3005534294 shutdown_connections 2023-10-16T08:52:48.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 --2- 172.21.15.94:0/3005534294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36800b1c50 0x7f36800b20c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 --2- 172.21.15.94:0/3005534294 >> v2:172.21.15.130:3300/0 conn(0x7f368006adf0 0x7f36800cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 -- 172.21.15.94:0/3005534294 >> 172.21.15.94:0/3005534294 conn(0x7f36800709f0 msgr2=0x7f3680070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:48.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 -- 172.21.15.94:0/3005534294 shutdown_connections 2023-10-16T08:52:48.640 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.636+0000 7f3685b9e640 1 -- 172.21.15.94:0/3005534294 wait complete. 2023-10-16T08:52:48.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.637+0000 7f3685b9e640 1 Processor -- start 2023-10-16T08:52:48.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.638+0000 7f3685b9e640 1 -- start start 2023-10-16T08:52:48.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.638+0000 7f3685b9e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 0x7f3680148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.643 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.638+0000 7f3685b9e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f368006b1d0 0x7f36800c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f3685b9e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36800b1c50 0x7f36800c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.644 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f3685b9e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680156010 con 0x7f368006adf0 2023-10-16T08:52:48.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f3685b9e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801562f0 con 0x7f36800b1c50 2023-10-16T08:52:48.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f3685b9e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36801565d0 con 0x7f368006b1d0 2023-10-16T08:52:48.645 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 0x7f3680148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 0x7f3680148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40914/0 (socket says 172.21.15.94:40914) 2023-10-16T08:52:48.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 -- 172.21.15.94:0/2688675057 learned_addr learned my addr 172.21.15.94:0/2688675057 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:48.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367ffff640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36800b1c50 0x7f36800c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.646 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367effd640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f368006b1d0 0x7f36800c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 -- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f368006b1d0 msgr2=0x7f36800c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f368006b1d0 0x7f36800c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 -- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36800b1c50 msgr2=0x7f36800c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.647 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36800b1c50 0x7f36800c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367f7fe640 1 -- 172.21.15.94:0/2688675057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009b30 con 0x7f368006adf0 2023-10-16T08:52:48.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.639+0000 7f367ffff640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36800b1c50 0x7f36800c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:48.648 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.640+0000 7f367f7fe640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 0x7f3680148180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f367000e870 tx=0x7f367000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:48.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.640+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700094f0 con 0x7f368006adf0 2023-10-16T08:52:48.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.640+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000c940 con 0x7f368006adf0 2023-10-16T08:52:48.649 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.640+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801568b0 con 0x7f368006adf0 2023-10-16T08:52:48.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.640+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000ccf0 con 0x7f368006adf0 2023-10-16T08:52:48.650 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.640+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801486c0 con 0x7f368006adf0 2023-10-16T08:52:48.651 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.641+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680067180 con 0x7f368006adf0 2023-10-16T08:52:48.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.642+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3670013470 con 0x7f368006adf0 2023-10-16T08:52:48.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.644+0000 7f3667fff640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f366c06aea0 0x7f366c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:48.652 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.644+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36700899f0 con 0x7f368006adf0 2023-10-16T08:52:48.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.644+0000 7f367effd640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f366c06aea0 0x7f366c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:48.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.645+0000 7f367effd640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f366c06aea0 0x7f366c06d360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3680157970 tx=0x7f3674009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:48.653 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.648+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3670054770 con 0x7f368006adf0 2023-10-16T08:52:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.839+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f368006edf0 con 0x7f368006adf0 2023-10-16T08:52:48.841 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.840+0000 7f3667fff640 1 -- 172.21.15.94:0/2688675057 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3670057d90 con 0x7f368006adf0 2023-10-16T08:52:48.842 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:48.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f366c06aea0 msgr2=0x7f366c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f366c06aea0 0x7f366c06d360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3680157970 tx=0x7f3674009040 comp rx=0 tx=0).stop 2023-10-16T08:52:48.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 msgr2=0x7f3680148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:48.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 0x7f3680148180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f367000e870 tx=0x7f367000ed30 comp rx=0 tx=0).stop 2023-10-16T08:52:48.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 shutdown_connections 2023-10-16T08:52:48.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f366c06aea0 0x7f366c06d360 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36800b1c50 0x7f36800c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f368006b1d0 0x7f36800c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 --2- 172.21.15.94:0/2688675057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f368006adf0 0x7f3680148180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 >> 172.21.15.94:0/2688675057 conn(0x7f36800709f0 msgr2=0x7f36800cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 shutdown_connections 2023-10-16T08:52:48.846 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:48.842+0000 7f3685b9e640 1 -- 172.21.15.94:0/2688675057 wait complete. 2023-10-16T08:52:48.862 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:49.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.069+0000 7f26931b8640 1 Processor -- start 2023-10-16T08:52:49.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.069+0000 7f26931b8640 1 -- start start 2023-10-16T08:52:49.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.070+0000 7f26931b8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f268c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.070+0000 7f26931b8640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c1550f0 con 0x7f268c154d10 2023-10-16T08:52:49.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26931b8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c06db50 con 0x7f268c06d360 2023-10-16T08:52:49.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26931b8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b13f0 con 0x7f268c0cf030 2023-10-16T08:52:49.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26921b6640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f268c154d10 0x7f268c0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60436/0 (socket says 172.21.15.94:60436) 2023-10-16T08:52:49.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26921b6640 1 -- 172.21.15.94:0/4137724019 learned_addr learned my addr 172.21.15.94:0/4137724019 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:49.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26919b5640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f268c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569890095 0 0) 0x7f268c1550f0 con 0x7f268c154d10 2023-10-16T08:52:49.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.071+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2678003520 con 0x7f268c154d10 2023-10-16T08:52:49.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2647892570 0 0) 0x7f2678003520 con 0x7f268c154d10 2023-10-16T08:52:49.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 msgr2=0x7f268c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:49.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f268c06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 >> v1:172.21.15.130:6789/0 conn(0x7f268c06d360 legacy=0x7f268c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0b16d0 con 0x7f268c154d10 2023-10-16T08:52:49.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f2688001670 con 0x7f268c154d10 2023-10-16T08:52:49.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 >> v1:172.21.15.94:6789/0 conn(0x7f268c154d10 legacy=0x7f268c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2678003a10 0x7f2678003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f2678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f2678005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b13f0 con 0x7f26780047c0 2023-10-16T08:52:49.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267800bae0 con 0x7f2678003a10 2023-10-16T08:52:49.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267800bca0 con 0x7f268c0cf030 2023-10-16T08:52:49.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.072+0000 7f26919b5640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f2678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26921b6640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2678003a10 0x7f2678003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26929b7640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f2678005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26919b5640 1 -- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 msgr2=0x7f2678005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:49.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26919b5640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f2678005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26919b5640 1 -- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2678003a10 msgr2=0x7f2678003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:49.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26919b5640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2678003a10 0x7f2678003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26919b5640 1 -- 172.21.15.94:0/4137724019 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678003520 con 0x7f26780047c0 2023-10-16T08:52:49.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.073+0000 7f26929b7640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0cf030 0x7f2678005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:49.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.074+0000 7f26919b5640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f2678004c40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f267c009ac0 tx=0x7f26780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6499a118b1d9ca04 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.074+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c02c600 con 0x7f26780047c0 2023-10-16T08:52:49.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.074+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c02c760 con 0x7f26780047c0 2023-10-16T08:52:49.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.074+0000 7f26911b4640 1 -- 172.21.15.94:0/4137724019 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c02caf0 con 0x7f26780047c0 2023-10-16T08:52:49.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26931b8640 1 -- 172.21.15.94:0/4137724019 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 msgr2=0x7f2678004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26931b8640 1 --2- 172.21.15.94:0/4137724019 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f2678004c40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f267c009ac0 tx=0x7f26780057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26929b7640 1 -- 172.21.15.94:0/4137724019 reap_dead start 2023-10-16T08:52:49.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26931b8640 1 -- 172.21.15.94:0/4137724019 shutdown_connections 2023-10-16T08:52:49.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26931b8640 1 -- 172.21.15.94:0/4137724019 >> 172.21.15.94:0/4137724019 conn(0x7f268c06a200 msgr2=0x7f268c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:49.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26931b8640 1 -- 172.21.15.94:0/4137724019 shutdown_connections 2023-10-16T08:52:49.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.075+0000 7f26931b8640 1 -- 172.21.15.94:0/4137724019 wait complete. 2023-10-16T08:52:49.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.077+0000 7f26931b8640 1 Processor -- start 2023-10-16T08:52:49.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.077+0000 7f26931b8640 1 -- start start 2023-10-16T08:52:49.086 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26931b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f268c1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26931b8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f268c15d7c0 0x7f268c0977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26931b8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0ab150 0x7f268c0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26931b8640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c153f00 con 0x7f26780047c0 2023-10-16T08:52:49.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26931b8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0abb20 con 0x7f268c15d7c0 2023-10-16T08:52:49.087 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26931b8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15e240 con 0x7f268c0ab150 2023-10-16T08:52:49.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26921b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f268c1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26921b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f268c1539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40932/0 (socket says 172.21.15.94:40932) 2023-10-16T08:52:49.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26921b6640 1 -- 172.21.15.94:0/1249361954 learned_addr learned my addr 172.21.15.94:0/1249361954 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:49.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.078+0000 7f26919b5640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f268c15d7c0 0x7f268c0977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.088 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26921b6640 1 -- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0ab150 msgr2=0x7f268c0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26921b6640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0ab150 0x7f268c0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26921b6640 1 -- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f268c15d7c0 msgr2=0x7f268c0977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26921b6640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f268c15d7c0 0x7f268c0977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26921b6640 1 -- 172.21.15.94:0/1249361954 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0c6aa0 con 0x7f26780047c0 2023-10-16T08:52:49.089 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26921b6640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f268c1539c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f268800e820 tx=0x7f268800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800c870 con 0x7f26780047c0 2023-10-16T08:52:49.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268800c9d0 con 0x7f26780047c0 2023-10-16T08:52:49.090 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c0c6d40 con 0x7f26780047c0 2023-10-16T08:52:49.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800cd80 con 0x7f26780047c0 2023-10-16T08:52:49.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.079+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c15df60 con 0x7f26780047c0 2023-10-16T08:52:49.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.081+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c04e9b0 con 0x7f26780047c0 2023-10-16T08:52:49.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.081+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f268801d460 con 0x7f26780047c0 2023-10-16T08:52:49.091 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.082+0000 7f2682ffd640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f267006ae70 0x7f267006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.082+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2688089a00 con 0x7f26780047c0 2023-10-16T08:52:49.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.082+0000 7f26919b5640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f267006ae70 0x7f267006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.092 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.083+0000 7f26919b5640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f267006ae70 0x7f267006d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f267c036000 tx=0x7f267c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.093 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.087+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26880546f0 con 0x7f26780047c0 2023-10-16T08:52:49.281 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.279+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f268c06d140 con 0x7f26780047c0 2023-10-16T08:52:49.282 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.280+0000 7f2682ffd640 1 -- 172.21.15.94:0/1249361954 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2688057d10 con 0x7f26780047c0 2023-10-16T08:52:49.282 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.282+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f267006ae70 msgr2=0x7f267006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.282+0000 7f26931b8640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f267006ae70 0x7f267006d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f267c036000 tx=0x7f267c030000 comp rx=0 tx=0).stop 2023-10-16T08:52:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.282+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 msgr2=0x7f268c1539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.282+0000 7f26931b8640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f268c1539c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f268800e820 tx=0x7f268800ece0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 shutdown_connections 2023-10-16T08:52:49.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f268c0ab150 0x7f268c0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f267006ae70 0x7f267006d330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f268c15d7c0 0x7f268c0977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 --2- 172.21.15.94:0/1249361954 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f26780047c0 0x7f268c1539c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 >> 172.21.15.94:0/1249361954 conn(0x7f268c06a200 msgr2=0x7f268c0c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 shutdown_connections 2023-10-16T08:52:49.287 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.283+0000 7f26931b8640 1 -- 172.21.15.94:0/1249361954 wait complete. 2023-10-16T08:52:49.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:49.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.517+0000 7fda13800640 1 Processor -- start 2023-10-16T08:52:49.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.517+0000 7fda13800640 1 -- start start 2023-10-16T08:52:49.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda13800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fda0c159890 0x7fda0c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda13800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fda0c0ca110 0x7fda0c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda13800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c072480 con 0x7fda0c15d3f0 2023-10-16T08:52:49.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda13800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0caae0 con 0x7fda0c159890 2023-10-16T08:52:49.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda13800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0cd0c0 con 0x7fda0c0ca110 2023-10-16T08:52:49.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda1159c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fda0c159890 0x7fda0c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda1159c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fda0c159890 0x7fda0c071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40934/0 (socket says 172.21.15.94:40934) 2023-10-16T08:52:49.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.519+0000 7fda1159c640 1 -- 172.21.15.94:0/4139007056 learned_addr learned my addr 172.21.15.94:0/4139007056 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:49.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.520+0000 7fda10d9b640 1 --2- 172.21.15.94:0/4139007056 >> v2:172.21.15.130:3300/0 conn(0x7fda0c0ca110 0x7fda0c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.520+0000 7fda1159c640 1 -- 172.21.15.94:0/4139007056 >> v2:172.21.15.130:3300/0 conn(0x7fda0c0ca110 msgr2=0x7fda0c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:49.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.520+0000 7fda1159c640 1 --2- 172.21.15.94:0/4139007056 >> v2:172.21.15.130:3300/0 conn(0x7fda0c0ca110 0x7fda0c0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.520+0000 7fda1159c640 1 -- 172.21.15.94:0/4139007056 >> v1:172.21.15.130:6789/0 conn(0x7fda0c15d3f0 legacy=0x7fda0c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:49.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.520+0000 7fda1159c640 1 -- 172.21.15.94:0/4139007056 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0cc540 con 0x7fda0c159890 2023-10-16T08:52:49.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.521+0000 7fda1159c640 1 --2- 172.21.15.94:0/4139007056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c071f40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fda0c06e450 tx=0x7fda0802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c20a804d78d9a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.521+0000 7fda03fff640 1 -- 172.21.15.94:0/4139007056 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0802ca50 con 0x7fda0c159890 2023-10-16T08:52:49.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.521+0000 7fda03fff640 1 -- 172.21.15.94:0/4139007056 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0802cbb0 con 0x7fda0c159890 2023-10-16T08:52:49.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.521+0000 7fda03fff640 1 -- 172.21.15.94:0/4139007056 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda080343f0 con 0x7fda0c159890 2023-10-16T08:52:49.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 -- 172.21.15.94:0/4139007056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 msgr2=0x7fda0c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 --2- 172.21.15.94:0/4139007056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c071f40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fda0c06e450 tx=0x7fda0802beb0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 -- 172.21.15.94:0/4139007056 shutdown_connections 2023-10-16T08:52:49.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 --2- 172.21.15.94:0/4139007056 >> v2:172.21.15.130:3300/0 conn(0x7fda0c0ca110 0x7fda0c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 --2- 172.21.15.94:0/4139007056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c071f40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 -- 172.21.15.94:0/4139007056 >> 172.21.15.94:0/4139007056 conn(0x7fda0c0b0030 msgr2=0x7fda0c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:49.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 -- 172.21.15.94:0/4139007056 shutdown_connections 2023-10-16T08:52:49.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.522+0000 7fda13800640 1 -- 172.21.15.94:0/4139007056 wait complete. 2023-10-16T08:52:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.524+0000 7fda13800640 1 Processor -- start 2023-10-16T08:52:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.524+0000 7fda13800640 1 -- start start 2023-10-16T08:52:49.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda13800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda0c0ca110 0x7fda0c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda13800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda13800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda0c15d3f0 0x7fda0c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda13800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c150720 con 0x7fda0c159890 2023-10-16T08:52:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda13800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c14ea40 con 0x7fda0c0ca110 2023-10-16T08:52:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda13800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c14ec70 con 0x7fda0c15d3f0 2023-10-16T08:52:49.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda10d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda10d9b640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c1501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40946/0 (socket says 172.21.15.94:40946) 2023-10-16T08:52:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.525+0000 7fda10d9b640 1 -- 172.21.15.94:0/153659672 learned_addr learned my addr 172.21.15.94:0/153659672 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda1159c640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda0c0ca110 0x7fda0c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda11d9d640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda0c15d3f0 0x7fda0c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda10d9b640 1 -- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda0c15d3f0 msgr2=0x7fda0c14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda10d9b640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda0c15d3f0 0x7fda0c14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda10d9b640 1 -- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda0c0ca110 msgr2=0x7fda0c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda10d9b640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda0c0ca110 0x7fda0c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda10d9b640 1 -- 172.21.15.94:0/153659672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08009b30 con 0x7fda0c159890 2023-10-16T08:52:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda1159c640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda0c0ca110 0x7fda0c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:49.532 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda11d9d640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda0c15d3f0 0x7fda0c14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda10d9b640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c1501e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00d5f0 tx=0x7fd9fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0125f0 con 0x7fda0c159890 2023-10-16T08:52:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc012750 con 0x7fda0c159890 2023-10-16T08:52:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc012b00 con 0x7fda0c159890 2023-10-16T08:52:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.526+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c135fd0 con 0x7fda0c159890 2023-10-16T08:52:49.533 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.527+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c136590 con 0x7fda0c159890 2023-10-16T08:52:49.534 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.528+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c073ef0 con 0x7fda0c159890 2023-10-16T08:52:49.534 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.529+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd9fc012c60 con 0x7fda0c159890 2023-10-16T08:52:49.535 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.529+0000 7fda01ffb640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd9f006ae70 0x7fd9f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.535 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.530+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd9fc089f40 con 0x7fda0c159890 2023-10-16T08:52:49.535 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.530+0000 7fda1159c640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd9f006ae70 0x7fd9f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.535 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.531+0000 7fda1159c640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd9f006ae70 0x7fd9f006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda08035000 tx=0x7fda08030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.536 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.534+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9fc054b90 con 0x7fda0c159890 2023-10-16T08:52:49.728 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.726+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fda0c0ce1f0 con 0x7fda0c159890 2023-10-16T08:52:49.729 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.727+0000 7fda01ffb640 1 -- 172.21.15.94:0/153659672 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd9fc0581b0 con 0x7fda0c159890 2023-10-16T08:52:49.729 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:49.732 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd9f006ae70 msgr2=0x7fd9f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd9f006ae70 0x7fd9f006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda08035000 tx=0x7fda08030000 comp rx=0 tx=0).stop 2023-10-16T08:52:49.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 msgr2=0x7fda0c1501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c1501e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00d5f0 tx=0x7fd9fc00dab0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 shutdown_connections 2023-10-16T08:52:49.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fda0c15d3f0 0x7fda0c14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c159890 0x7fda0c1501e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fd9f006ae70 0x7fd9f006d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 --2- 172.21.15.94:0/153659672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda0c0ca110 0x7fda0c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.734 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 >> 172.21.15.94:0/153659672 conn(0x7fda0c0b0030 msgr2=0x7fda0c0ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:49.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.730+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 shutdown_connections 2023-10-16T08:52:49.735 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.731+0000 7fda13800640 1 -- 172.21.15.94:0/153659672 wait complete. 2023-10-16T08:52:49.750 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T08:52:49.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.959+0000 7f3d77ad7640 1 Processor -- start 2023-10-16T08:52:49.961 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.959+0000 7f3d77ad7640 1 -- start start 2023-10-16T08:52:49.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.960+0000 7f3d77ad7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d7015d700 0x7f3d70159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.962 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.960+0000 7f3d77ad7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d7006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.960+0000 7f3d77ad7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7015a2c0 con 0x7f3d7006d440 2023-10-16T08:52:49.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.960+0000 7f3d77ad7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7015a5a0 con 0x7f3d7015d700 2023-10-16T08:52:49.963 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.960+0000 7f3d77ad7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7015a880 con 0x7f3d7015dae0 2023-10-16T08:52:49.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.961+0000 7f3d75873640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d7015d700 0x7f3d70159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.961+0000 7f3d75072640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d7006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.961+0000 7f3d75873640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d7015d700 0x7f3d70159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:49262/0 (socket says 172.21.15.94:49262) 2023-10-16T08:52:49.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.961+0000 7f3d75873640 1 -- 172.21.15.94:0/2406853942 learned_addr learned my addr 172.21.15.94:0/2406853942 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:49.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.962+0000 7f3d75072640 1 -- 172.21.15.94:0/2406853942 >> v2:172.21.15.130:3300/0 conn(0x7f3d7015d700 msgr2=0x7f3d70159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:49.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.962+0000 7f3d75072640 1 --2- 172.21.15.94:0/2406853942 >> v2:172.21.15.130:3300/0 conn(0x7f3d7015d700 0x7f3d70159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.962+0000 7f3d75072640 1 -- 172.21.15.94:0/2406853942 >> v1:172.21.15.130:6789/0 conn(0x7f3d7006d440 legacy=0x7f3d700b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.962+0000 7f3d75072640 1 -- 172.21.15.94:0/2406853942 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7015ab60 con 0x7f3d7015dae0 2023-10-16T08:52:49.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.963+0000 7f3d75072640 1 --2- 172.21.15.94:0/2406853942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d7006cf00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097a0 tx=0x7f3d6002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30666e566812dd73 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d74871640 1 -- 172.21.15.94:0/2406853942 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6002d040 con 0x7f3d7015dae0 2023-10-16T08:52:49.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d74871640 1 -- 172.21.15.94:0/2406853942 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60031810 con 0x7f3d7015dae0 2023-10-16T08:52:49.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d74871640 1 -- 172.21.15.94:0/2406853942 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60031ba0 con 0x7f3d7015dae0 2023-10-16T08:52:49.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 -- 172.21.15.94:0/2406853942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 msgr2=0x7f3d7006cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/2406853942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d7006cf00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097a0 tx=0x7f3d6002b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 -- 172.21.15.94:0/2406853942 shutdown_connections 2023-10-16T08:52:49.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/2406853942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d7006cf00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/2406853942 >> v2:172.21.15.130:3300/0 conn(0x7f3d7015d700 0x7f3d70159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 -- 172.21.15.94:0/2406853942 >> 172.21.15.94:0/2406853942 conn(0x7f3d700cb1b0 msgr2=0x7f3d700cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:49.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.964+0000 7f3d77ad7640 1 -- 172.21.15.94:0/2406853942 shutdown_connections 2023-10-16T08:52:49.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.965+0000 7f3d77ad7640 1 -- 172.21.15.94:0/2406853942 wait complete. 2023-10-16T08:52:49.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.967+0000 7f3d77ad7640 1 Processor -- start 2023-10-16T08:52:49.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.967+0000 7f3d77ad7640 1 -- start start 2023-10-16T08:52:49.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d77ad7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d7006d440 0x7f3d7014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d77ad7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 0x7f3d700c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d77ad7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d700c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d77ad7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700c3960 con 0x7f3d7015d700 2023-10-16T08:52:49.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d77ad7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700c3d80 con 0x7f3d7006d440 2023-10-16T08:52:49.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d77ad7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700c2ce0 con 0x7f3d7015dae0 2023-10-16T08:52:49.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d75072640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 0x7f3d700c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d75072640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 0x7f3d700c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40958/0 (socket says 172.21.15.94:40958) 2023-10-16T08:52:49.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.968+0000 7f3d75072640 1 -- 172.21.15.94:0/3790829607 learned_addr learned my addr 172.21.15.94:0/3790829607 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:49.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75873640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d7006d440 0x7f3d7014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d76074640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d700c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.973 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75072640 1 -- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 msgr2=0x7f3d700c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75072640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d700c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75072640 1 -- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d7006d440 msgr2=0x7f3d7014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:49.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75072640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d7006d440 0x7f3d7014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:49.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75072640 1 -- 172.21.15.94:0/3790829607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009400 con 0x7f3d7015d700 2023-10-16T08:52:49.974 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d76074640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d700c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:49.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d75072640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 0x7f3d700c2260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000c00 tx=0x7f3d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60006e10 con 0x7f3d7015d700 2023-10-16T08:52:49.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6003ad60 con 0x7f3d7015d700 2023-10-16T08:52:49.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.969+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60044630 con 0x7f3d7015d700 2023-10-16T08:52:49.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.970+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d700c2fc0 con 0x7f3d7015d700 2023-10-16T08:52:49.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.970+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d700c3580 con 0x7f3d7015d700 2023-10-16T08:52:49.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.971+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d70156b00 con 0x7f3d7015d700 2023-10-16T08:52:49.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.972+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d6004d450 con 0x7f3d7015d700 2023-10-16T08:52:49.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.973+0000 7f3d667fc640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3d5406ae70 0x7f3d5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:49.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.973+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d600abfe0 con 0x7f3d7015d700 2023-10-16T08:52:49.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.973+0000 7f3d75873640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3d5406ae70 0x7f3d5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:49.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.974+0000 7f3d75873640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3d5406ae70 0x7f3d5406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00bce0 tx=0x7f3d6c00b450 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:49.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:49.977+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d60076cd0 con 0x7f3d7015d700 2023-10-16T08:52:50.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.182+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3d700c3aa0 con 0x7f3d7015d700 2023-10-16T08:52:50.184 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.183+0000 7f3d667fc640 1 -- 172.21.15.94:0/3790829607 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3d700c3aa0 con 0x7f3d7015d700 2023-10-16T08:52:50.185 INFO:teuthology.orchestra.run.smithi094.stderr:listed 0 entries 2023-10-16T08:52:50.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3d5406ae70 msgr2=0x7f3d5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3d5406ae70 0x7f3d5406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00bce0 tx=0x7f3d6c00b450 comp rx=0 tx=0).stop 2023-10-16T08:52:50.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 msgr2=0x7f3d700c2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 0x7f3d700c2260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000c00 tx=0x7f3d600046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 shutdown_connections 2023-10-16T08:52:50.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d7015dae0 0x7f3d700c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d7015d700 0x7f3d700c2260 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.188 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3d5406ae70 0x7f3d5406d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 --2- 172.21.15.94:0/3790829607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d7006d440 0x7f3d7014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 >> 172.21.15.94:0/3790829607 conn(0x7f3d700cb1b0 msgr2=0x7f3d70158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:50.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.185+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 shutdown_connections 2023-10-16T08:52:50.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.186+0000 7f3d77ad7640 1 -- 172.21.15.94:0/3790829607 wait complete. 2023-10-16T08:52:50.205 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2023-10-16T08:52:50.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:50.206 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-16T08:52:50.309 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:52:50.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T08:52:50.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:52:50.311 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T08:52:50.365 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T08:52:50.365 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:52:50.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.587+0000 7fa1f1975640 1 Processor -- start 2023-10-16T08:52:50.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.587+0000 7fa1f1975640 1 -- start start 2023-10-16T08:52:50.590 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1975640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0b1c60 0x7fa1ec0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:50.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1975640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1ec15cf30 0x7fa1ec15d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:50.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1975640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec15d4e0 con 0x7fa1ec0cf240 2023-10-16T08:52:50.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1975640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ec0b2160 con 0x7fa1ec15cf30 2023-10-16T08:52:50.591 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1975640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0d3300 con 0x7fa1ec0b1c60 2023-10-16T08:52:50.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1174640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1ec15cf30 0x7fa1ec15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:50.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1f1174640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa1ec15cf30 0x7fa1ec15d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:49282/0 (socket says 172.21.15.94:49282) 2023-10-16T08:52:50.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.589+0000 7fa1ebfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0b1c60 0x7fa1ec0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:50.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.590+0000 7fa1f1174640 1 -- 172.21.15.94:0/3648394339 learned_addr learned my addr 172.21.15.94:0/3648394339 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:50.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.590+0000 7fa1f1174640 1 -- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0b1c60 msgr2=0x7fa1ec0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:50.593 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.590+0000 7fa1f1174640 1 --2- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0b1c60 0x7fa1ec0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.590+0000 7fa1f1174640 1 -- 172.21.15.94:0/3648394339 >> v1:172.21.15.130:6789/0 conn(0x7fa1ec0cf240 legacy=0x7fa1ec0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.594 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.590+0000 7fa1f1174640 1 -- 172.21.15.94:0/3648394339 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0d35e0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.591+0000 7fa1f1174640 1 --2- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec15d970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e50 tx=0x7fa1e402bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840c6bfb86db3c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:50.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.592+0000 7fa1eb7fe640 1 -- 172.21.15.94:0/3648394339 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e402cb90 con 0x7fa1ec15cf30 2023-10-16T08:52:50.595 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.592+0000 7fa1eb7fe640 1 -- 172.21.15.94:0/3648394339 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e402ccf0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.592+0000 7fa1eb7fe640 1 -- 172.21.15.94:0/3648394339 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4034610 con 0x7fa1ec15cf30 2023-10-16T08:52:50.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 -- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec15cf30 msgr2=0x7fa1ec15d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 --2- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec15d970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e50 tx=0x7fa1e402bff0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 -- 172.21.15.94:0/3648394339 shutdown_connections 2023-10-16T08:52:50.596 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 --2- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec15d970 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 --2- 172.21.15.94:0/3648394339 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0b1c60 0x7fa1ec0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 -- 172.21.15.94:0/3648394339 >> 172.21.15.94:0/3648394339 conn(0x7fa1ec089f70 msgr2=0x7fa1ec0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:50.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 -- 172.21.15.94:0/3648394339 shutdown_connections 2023-10-16T08:52:50.597 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.593+0000 7fa1f1975640 1 -- 172.21.15.94:0/3648394339 wait complete. 2023-10-16T08:52:50.599 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.595+0000 7fa1f1975640 1 Processor -- start 2023-10-16T08:52:50.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.595+0000 7fa1f1975640 1 -- start start 2023-10-16T08:52:50.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1975640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec0b1c60 0x7fa1ec0b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:50.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1975640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0cf240 0x7fa1ec14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:50.600 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1975640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:50.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1975640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0b8280 con 0x7fa1ec15cf30 2023-10-16T08:52:50.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1975640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0b78b0 con 0x7fa1ec0b1c60 2023-10-16T08:52:50.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1975640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec14f200 con 0x7fa1ec0cf240 2023-10-16T08:52:50.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1174640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:50.601 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1174640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec0b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40960/0 (socket says 172.21.15.94:40960) 2023-10-16T08:52:50.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.596+0000 7fa1f1174640 1 -- 172.21.15.94:0/4133788191 learned_addr learned my addr 172.21.15.94:0/4133788191 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:50.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1ebfff640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0cf240 0x7fa1ec14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:50.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f0973640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec0b1c60 0x7fa1ec0b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:50.602 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1174640 1 -- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0cf240 msgr2=0x7fa1ec14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1174640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0cf240 0x7fa1ec14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1174640 1 -- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec0b1c60 msgr2=0x7fa1ec0b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1174640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec0b1c60 0x7fa1ec0b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1174640 1 -- 172.21.15.94:0/4133788191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4009b30 con 0x7fa1ec15cf30 2023-10-16T08:52:50.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f0973640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec0b1c60 0x7fa1ec0b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:50.603 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1174640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec0b43e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e50 tx=0x7fa1e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:50.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4040670 con 0x7fa1ec15cf30 2023-10-16T08:52:50.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec0b4920 con 0x7fa1ec15cf30 2023-10-16T08:52:50.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e4040810 con 0x7fa1ec15cf30 2023-10-16T08:52:50.604 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.597+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4040bc0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.605 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.598+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec0b7260 con 0x7fa1ec15cf30 2023-10-16T08:52:50.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.599+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec04e9b0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.600+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa1e4040d20 con 0x7fa1ec15cf30 2023-10-16T08:52:50.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.601+0000 7fa1e97fa640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa1d006ae70 0x7fa1d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:50.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.601+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa1e40ac7f0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.606 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.601+0000 7fa1f0973640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa1d006ae70 0x7fa1d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:50.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.602+0000 7fa1f0973640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa1d006ae70 0x7fa1d006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0d1940 tx=0x7fa1e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:50.607 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.605+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1e40774f0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.838 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.836+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1ec0b79f0 con 0x7fa1ec15cf30 2023-10-16T08:52:50.840 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.838+0000 7fa1e97fa640 1 -- 172.21.15.94:0/4133788191 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fa1e4009510 con 0x7fa1ec15cf30 2023-10-16T08:52:50.840 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:52:50.841 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:52:50.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.840+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa1d006ae70 msgr2=0x7fa1d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.840+0000 7fa1f1975640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa1d006ae70 0x7fa1d006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0d1940 tx=0x7fa1e0009040 comp rx=0 tx=0).stop 2023-10-16T08:52:50.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.840+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 msgr2=0x7fa1ec0b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:50.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.840+0000 7fa1f1975640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec0b43e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e50 tx=0x7fa1e4004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:50.843 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 shutdown_connections 2023-10-16T08:52:50.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1ec15cf30 0x7fa1ec0b43e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa1ec0cf240 0x7fa1ec14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa1d006ae70 0x7fa1d006d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 --2- 172.21.15.94:0/4133788191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1ec0b1c60 0x7fa1ec0b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:50.844 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 >> 172.21.15.94:0/4133788191 conn(0x7fa1ec089f70 msgr2=0x7fa1ec0b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:50.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 shutdown_connections 2023-10-16T08:52:50.845 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:50.841+0000 7fa1f1975640 1 -- 172.21.15.94:0/4133788191 wait complete. 2023-10-16T08:52:50.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:51.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.062+0000 7f76ca973640 1 Processor -- start 2023-10-16T08:52:51.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.062+0000 7f76ca973640 1 -- start start 2023-10-16T08:52:51.065 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76ca973640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f76c415ad00 0x7f76c40701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76ca973640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c40707f0 con 0x7f76c415f040 2023-10-16T08:52:51.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76ca973640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c4070ad0 con 0x7f76c40b0010 2023-10-16T08:52:51.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76ca973640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c415b1d0 con 0x7f76c415ad00 2023-10-16T08:52:51.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76c8f10640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f76c415f040 0x7f76c415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60448/0 (socket says 172.21.15.94:60448) 2023-10-16T08:52:51.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76c8f10640 1 -- 172.21.15.94:0/4248076823 learned_addr learned my addr 172.21.15.94:0/4248076823 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:51.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.064+0000 7f76c37fe640 1 --2- 172.21.15.94:0/4248076823 >> v2:172.21.15.130:3300/0 conn(0x7f76c415ad00 0x7f76c40701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399643280 0 0) 0x7f76c40707f0 con 0x7f76c415f040 2023-10-16T08:52:51.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ac003520 con 0x7f76c415f040 2023-10-16T08:52:51.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 177301830 0 0) 0x7f76ac003520 con 0x7f76c415f040 2023-10-16T08:52:51.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 >> v2:172.21.15.130:3300/0 conn(0x7f76c415ad00 msgr2=0x7f76c40701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 --2- 172.21.15.94:0/4248076823 >> v2:172.21.15.130:3300/0 conn(0x7f76c415ad00 0x7f76c40701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 >> v1:172.21.15.130:6789/0 conn(0x7f76c40b0010 legacy=0x7f76c40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c415b4b0 con 0x7f76c415f040 2023-10-16T08:52:51.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f76bc0019f0 con 0x7f76c415f040 2023-10-16T08:52:51.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 >> v1:172.21.15.94:6789/0 conn(0x7f76c415f040 legacy=0x7f76c415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ac0039e0 0x7f76ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ac005180 0x7f76ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c415b1d0 con 0x7f76ac0047c0 2023-10-16T08:52:51.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac00c0b0 con 0x7f76ac0039e0 2023-10-16T08:52:51.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac00c270 con 0x7f76ac005180 2023-10-16T08:52:51.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.065+0000 7f76c37fe640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c3fff640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ac0039e0 0x7f76ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c37fe640 1 -- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ac005180 msgr2=0x7f76ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c37fe640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ac005180 0x7f76ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c37fe640 1 -- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ac0039e0 msgr2=0x7f76ac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c37fe640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ac0039e0 0x7f76ac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c37fe640 1 -- 172.21.15.94:0/4248076823 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac003520 con 0x7f76ac0047c0 2023-10-16T08:52:51.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c8f10640 1 -- 172.21.15.94:0/4248076823 reap_dead start 2023-10-16T08:52:51.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.066+0000 7f76c3fff640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ac0039e0 0x7f76ac003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:51.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.067+0000 7f76c37fe640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76ac004c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009a90 tx=0x7f76ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62eafe1ed833b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.067+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b802c680 con 0x7f76ac0047c0 2023-10-16T08:52:51.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.067+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b802c7e0 con 0x7f76ac0047c0 2023-10-16T08:52:51.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.067+0000 7f76c2ffd640 1 -- 172.21.15.94:0/4248076823 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b802cb70 con 0x7f76ac0047c0 2023-10-16T08:52:51.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 -- 172.21.15.94:0/4248076823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 msgr2=0x7f76ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76ac004c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009a90 tx=0x7f76ac0057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 -- 172.21.15.94:0/4248076823 shutdown_connections 2023-10-16T08:52:51.077 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 --2- 172.21.15.94:0/4248076823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76ac004c40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 -- 172.21.15.94:0/4248076823 >> 172.21.15.94:0/4248076823 conn(0x7f76c406c1c0 msgr2=0x7f76c406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:51.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 -- 172.21.15.94:0/4248076823 shutdown_connections 2023-10-16T08:52:51.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.068+0000 7f76ca973640 1 -- 172.21.15.94:0/4248076823 wait complete. 2023-10-16T08:52:51.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.070+0000 7f76ca973640 1 Processor -- start 2023-10-16T08:52:51.078 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.070+0000 7f76ca973640 1 -- start start 2023-10-16T08:52:51.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76ca973640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76c414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76ca973640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76c40cc160 0x7f76c415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76ca973640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76c415e870 0x7f76c4154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76ca973640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41f6920 con 0x7f76ac0047c0 2023-10-16T08:52:51.079 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76ca973640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40acdb0 con 0x7f76c415e870 2023-10-16T08:52:51.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76ca973640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41f5d10 con 0x7f76c40cc160 2023-10-16T08:52:51.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76c414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76c414fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40972/0 (socket says 172.21.15.94:40972) 2023-10-16T08:52:51.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 -- 172.21.15.94:0/993174652 learned_addr learned my addr 172.21.15.94:0/993174652 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:51.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c37fe640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76c40cc160 0x7f76c415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.080 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 -- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76c40cc160 msgr2=0x7f76c415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76c40cc160 0x7f76c415e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 -- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76c415e870 msgr2=0x7f76c4154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76c415e870 0x7f76c4154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.071+0000 7f76c3fff640 1 -- 172.21.15.94:0/993174652 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c41f5ff0 con 0x7f76ac0047c0 2023-10-16T08:52:51.081 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.072+0000 7f76c3fff640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76c414fcc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76b400d4a0 tx=0x7f76b400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.072+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4005480 con 0x7f76ac0047c0 2023-10-16T08:52:51.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.072+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4007030 con 0x7f76ac0047c0 2023-10-16T08:52:51.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.072+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c41f62d0 con 0x7f76ac0047c0 2023-10-16T08:52:51.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.072+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4007400 con 0x7f76ac0047c0 2023-10-16T08:52:51.082 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.072+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c4150200 con 0x7f76ac0047c0 2023-10-16T08:52:51.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.074+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c4073ef0 con 0x7f76ac0047c0 2023-10-16T08:52:51.083 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.074+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f76b4007560 con 0x7f76ac0047c0 2023-10-16T08:52:51.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.075+0000 7f76c0ff9640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f76b006aea0 0x7f76b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.075+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76b4088e10 con 0x7f76ac0047c0 2023-10-16T08:52:51.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.075+0000 7f76c37fe640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f76b006aea0 0x7f76b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.084 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.076+0000 7f76c37fe640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f76b006aea0 0x7f76b006d360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76b8036000 tx=0x7f76b8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.085 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.080+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76b4053bb0 con 0x7f76ac0047c0 2023-10-16T08:52:51.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.269+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76c40b0500 con 0x7f76ac0047c0 2023-10-16T08:52:51.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.271+0000 7f76c0ff9640 1 -- 172.21.15.94:0/993174652 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f76b4019020 con 0x7f76ac0047c0 2023-10-16T08:52:51.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:51.274 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:51.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f76b006aea0 msgr2=0x7f76b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f76b006aea0 0x7f76b006d360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76b8036000 tx=0x7f76b8030000 comp rx=0 tx=0).stop 2023-10-16T08:52:51.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 msgr2=0x7f76c414fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76c414fcc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76b400d4a0 tx=0x7f76b400d960 comp rx=0 tx=0).stop 2023-10-16T08:52:51.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 shutdown_connections 2023-10-16T08:52:51.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f76b006aea0 0x7f76b006d360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76c415e870 0x7f76c4154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76c40cc160 0x7f76c415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.277 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 --2- 172.21.15.94:0/993174652 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76ac0047c0 0x7f76c414fcc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 >> 172.21.15.94:0/993174652 conn(0x7f76c406c1c0 msgr2=0x7f76c406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:51.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 shutdown_connections 2023-10-16T08:52:51.278 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.274+0000 7f76ca973640 1 -- 172.21.15.94:0/993174652 wait complete. 2023-10-16T08:52:51.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T08:51:17.366527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T08:51:17.915588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T08:51:21.690272+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T08:52:51.295 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:52:51.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.511+0000 7f02d8541640 1 Processor -- start 2023-10-16T08:52:51.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.511+0000 7f02d8541640 1 -- start start 2023-10-16T08:52:51.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d8541640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d8541640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02d00cdbb0 0x7f02d00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d8541640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02d00c8b50 0x7f02d00c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d8541640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00c9520 con 0x7f02d00cdbb0 2023-10-16T08:52:51.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d8541640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00cac40 con 0x7f02d00c8b50 2023-10-16T08:52:51.516 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d8541640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00cb180 con 0x7f02d015c580 2023-10-16T08:52:51.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d5adc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02d00cdbb0 0x7f02d00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d5adc640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02d00cdbb0 0x7f02d00cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40976/0 (socket says 172.21.15.94:40976) 2023-10-16T08:52:51.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d5adc640 1 -- 172.21.15.94:0/2486154457 learned_addr learned my addr 172.21.15.94:0/2486154457 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:51.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d62dd640 1 --2- 172.21.15.94:0/2486154457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.517 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d6ade640 1 --2- 172.21.15.94:0/2486154457 >> v2:172.21.15.130:3300/0 conn(0x7f02d00c8b50 0x7f02d00c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d5adc640 1 -- 172.21.15.94:0/2486154457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 msgr2=0x7f02d00cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.513+0000 7f02d5adc640 1 --2- 172.21.15.94:0/2486154457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.514+0000 7f02d5adc640 1 -- 172.21.15.94:0/2486154457 >> v2:172.21.15.130:3300/0 conn(0x7f02d00c8b50 msgr2=0x7f02d00c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.514+0000 7f02d5adc640 1 --2- 172.21.15.94:0/2486154457 >> v2:172.21.15.130:3300/0 conn(0x7f02d00c8b50 0x7f02d00c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.518 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.514+0000 7f02d5adc640 1 -- 172.21.15.94:0/2486154457 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00cf440 con 0x7f02d00cdbb0 2023-10-16T08:52:51.519 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.514+0000 7f02d6ade640 1 --2- 172.21.15.94:0/2486154457 >> v2:172.21.15.130:3300/0 conn(0x7f02d00c8b50 0x7f02d00c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:51.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.515+0000 7f02d5adc640 1 --2- 172.21.15.94:0/2486154457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d00cb610 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f02d00c1c40 tx=0x7f02c402e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d680cd9aea752c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.515+0000 7f02d52db640 1 -- 172.21.15.94:0/2486154457 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c402edf0 con 0x7f02d00cdbb0 2023-10-16T08:52:51.520 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.515+0000 7f02d52db640 1 -- 172.21.15.94:0/2486154457 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4036440 con 0x7f02d00cdbb0 2023-10-16T08:52:51.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.515+0000 7f02d52db640 1 -- 172.21.15.94:0/2486154457 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40367d0 con 0x7f02d00cdbb0 2023-10-16T08:52:51.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 -- 172.21.15.94:0/2486154457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 msgr2=0x7f02d00cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 --2- 172.21.15.94:0/2486154457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d00cb610 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f02d00c1c40 tx=0x7f02c402e040 comp rx=0 tx=0).stop 2023-10-16T08:52:51.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 -- 172.21.15.94:0/2486154457 shutdown_connections 2023-10-16T08:52:51.521 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 --2- 172.21.15.94:0/2486154457 >> v2:172.21.15.130:3300/0 conn(0x7f02d00c8b50 0x7f02d00c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 --2- 172.21.15.94:0/2486154457 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d00cb610 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 --2- 172.21.15.94:0/2486154457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 -- 172.21.15.94:0/2486154457 >> 172.21.15.94:0/2486154457 conn(0x7f02d00b0030 msgr2=0x7f02d00b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:51.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 -- 172.21.15.94:0/2486154457 shutdown_connections 2023-10-16T08:52:51.522 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.516+0000 7f02d8541640 1 -- 172.21.15.94:0/2486154457 wait complete. 2023-10-16T08:52:51.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.517+0000 7f02d8541640 1 Processor -- start 2023-10-16T08:52:51.523 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.518+0000 7f02d8541640 1 -- start start 2023-10-16T08:52:51.524 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d8541640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d00c8b50 0x7f02d00b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d8541640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d8541640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d8541640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00b2170 con 0x7f02d00cdbb0 2023-10-16T08:52:51.525 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d8541640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00b2450 con 0x7f02d00c8b50 2023-10-16T08:52:51.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d8541640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00b2730 con 0x7f02d015c580 2023-10-16T08:52:51.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d0156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40986/0 (socket says 172.21.15.94:40986) 2023-10-16T08:52:51.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 -- 172.21.15.94:0/809816799 learned_addr learned my addr 172.21.15.94:0/809816799 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:51.526 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 -- 172.21.15.94:0/809816799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 msgr2=0x7f02d00c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 -- 172.21.15.94:0/809816799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d00c8b50 msgr2=0x7f02d00b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d00c8b50 0x7f02d00b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.519+0000 7f02d5adc640 1 -- 172.21.15.94:0/809816799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c400b770 con 0x7f02d00cdbb0 2023-10-16T08:52:51.527 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.520+0000 7f02d5adc640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d0156db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f02c402e080 tx=0x7f02c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.520+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4034b80 con 0x7f02d00cdbb0 2023-10-16T08:52:51.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.520+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4034d00 con 0x7f02d00cdbb0 2023-10-16T08:52:51.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.520+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4041680 con 0x7f02d00cdbb0 2023-10-16T08:52:51.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.520+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d00b2a10 con 0x7f02d00cdbb0 2023-10-16T08:52:51.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.520+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d00b3750 con 0x7f02d00cdbb0 2023-10-16T08:52:51.528 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.521+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d00b2f30 con 0x7f02d00cdbb0 2023-10-16T08:52:51.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.522+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02c40403e0 con 0x7f02d00cdbb0 2023-10-16T08:52:51.529 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.523+0000 7f02ceffd640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f02bc06ae70 0x7f02bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.523+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02c40abf80 con 0x7f02d00cdbb0 2023-10-16T08:52:51.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.524+0000 7f02d62dd640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f02bc06ae70 0x7f02bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.530 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.524+0000 7f02d62dd640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f02bc06ae70 0x7f02bc06d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f02c0007e60 tx=0x7f02c0007390 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.531 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.528+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02c4076bd0 con 0x7f02d00cdbb0 2023-10-16T08:52:51.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.715+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02d0073ef0 con 0x7f02d00cdbb0 2023-10-16T08:52:51.717 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.715+0000 7f02ceffd640 1 -- 172.21.15.94:0/809816799 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02c403b020 con 0x7f02d00cdbb0 2023-10-16T08:52:51.718 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:52:51.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f02bc06ae70 msgr2=0x7f02bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f02bc06ae70 0x7f02bc06d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f02c0007e60 tx=0x7f02c0007390 comp rx=0 tx=0).stop 2023-10-16T08:52:51.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 msgr2=0x7f02d0156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d0156db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f02c402e080 tx=0x7f02c40046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 shutdown_connections 2023-10-16T08:52:51.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d015c580 0x7f02d00c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d00cdbb0 0x7f02d0156db0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f02bc06ae70 0x7f02bc06d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 --2- 172.21.15.94:0/809816799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d00c8b50 0x7f02d00b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 >> 172.21.15.94:0/809816799 conn(0x7f02d00b0030 msgr2=0x7f02d00c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:51.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 shutdown_connections 2023-10-16T08:52:51.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.718+0000 7f02d8541640 1 -- 172.21.15.94:0/809816799 wait complete. 2023-10-16T08:52:51.738 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T08:52:51.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.947+0000 7f57f6b0a640 1 Processor -- start 2023-10-16T08:52:51.949 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.947+0000 7f57f6b0a640 1 -- start start 2023-10-16T08:52:51.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.948+0000 7f57f6b0a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 0x7f57f006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.950 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.948+0000 7f57f6b0a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f0159ca0 con 0x7f57f006cbf0 2023-10-16T08:52:51.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.948+0000 7f57f6b0a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00cac20 con 0x7f57f00cf0c0 2023-10-16T08:52:51.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.948+0000 7f57f6b0a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00b34c0 con 0x7f57f00ad940 2023-10-16T08:52:51.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f5307640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f57f006cbf0 0x7f57f00ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60456/0 (socket says 172.21.15.94:60456) 2023-10-16T08:52:51.951 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f5307640 1 -- 172.21.15.94:0/3013027195 learned_addr learned my addr 172.21.15.94:0/3013027195 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:51.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f5b08640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 0x7f57f006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.953 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893810794 0 0) 0x7f57f0159ca0 con 0x7f57f006cbf0 2023-10-16T08:52:51.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc003520 con 0x7f57f006cbf0 2023-10-16T08:52:51.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 237445117 0 0) 0x7f57dc003520 con 0x7f57f006cbf0 2023-10-16T08:52:51.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 msgr2=0x7f57f006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.954 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 0x7f57f006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 >> v1:172.21.15.130:6789/0 conn(0x7f57f00cf0c0 legacy=0x7f57f015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00add20 con 0x7f57f006cbf0 2023-10-16T08:52:51.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f57e0001670 con 0x7f57f006cbf0 2023-10-16T08:52:51.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 >> v1:172.21.15.94:6789/0 conn(0x7f57f006cbf0 legacy=0x7f57f00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.955 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 0x7f57dc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.949+0000 7f57f4b06640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc003fc0 0x7f57dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f4b06640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc004d00 0x7f57dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00b34c0 con 0x7f57dc003fc0 2023-10-16T08:52:51.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc00bb10 con 0x7f57dc004d00 2023-10-16T08:52:51.956 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc00dee0 con 0x7f57f00ad940 2023-10-16T08:52:51.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5307640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc003fc0 0x7f57dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5b08640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 0x7f57dc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f6309640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc004d00 0x7f57dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5307640 1 -- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 msgr2=0x7f57dc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5307640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f00ad940 0x7f57dc003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.957 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5307640 1 -- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc004d00 msgr2=0x7f57dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:51.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5307640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc004d00 0x7f57dc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.950+0000 7f57f5307640 1 -- 172.21.15.94:0/3013027195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc003520 con 0x7f57dc003fc0 2023-10-16T08:52:51.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.951+0000 7f57f5307640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc003fc0 0x7f57dc0047c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c190 tx=0x7f57dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fb8587a80aacd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0005ad0 con 0x7f57dc003fc0 2023-10-16T08:52:51.958 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0005c30 con 0x7f57dc003fc0 2023-10-16T08:52:51.959 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f4b06640 1 -- 172.21.15.94:0/3013027195 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e002c810 con 0x7f57dc003fc0 2023-10-16T08:52:51.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6b0a640 1 -- 172.21.15.94:0/3013027195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc003fc0 msgr2=0x7f57dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/3013027195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc003fc0 0x7f57dc0047c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c190 tx=0x7f57dc0057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6309640 1 -- 172.21.15.94:0/3013027195 reap_dead start 2023-10-16T08:52:51.964 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6b0a640 1 -- 172.21.15.94:0/3013027195 shutdown_connections 2023-10-16T08:52:51.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6b0a640 1 -- 172.21.15.94:0/3013027195 >> 172.21.15.94:0/3013027195 conn(0x7f57f006a200 msgr2=0x7f57f006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:51.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6b0a640 1 -- 172.21.15.94:0/3013027195 shutdown_connections 2023-10-16T08:52:51.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.952+0000 7f57f6b0a640 1 -- 172.21.15.94:0/3013027195 wait complete. 2023-10-16T08:52:51.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.954+0000 7f57f6b0a640 1 Processor -- start 2023-10-16T08:52:51.965 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.954+0000 7f57f6b0a640 1 -- start start 2023-10-16T08:52:51.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f6b0a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57dc003fc0 0x7f57f00c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f6b0a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 0x7f57f015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f6b0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f01557b0 0x7f57f00c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f6b0a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0157450 con 0x7f57f0158650 2023-10-16T08:52:51.966 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f6b0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0157120 con 0x7f57f01557b0 2023-10-16T08:52:51.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f6b0a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0159f80 con 0x7f57dc003fc0 2023-10-16T08:52:51.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f5307640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 0x7f57f015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f5307640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 0x7f57f015a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41002/0 (socket says 172.21.15.94:41002) 2023-10-16T08:52:51.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.955+0000 7f57f5307640 1 -- 172.21.15.94:0/796044389 learned_addr learned my addr 172.21.15.94:0/796044389 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:51.967 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5b08640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57dc003fc0 0x7f57f00c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f6309640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f01557b0 0x7f57f00c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5307640 1 -- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57dc003fc0 msgr2=0x7f57f00c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5307640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57dc003fc0 0x7f57f00c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5307640 1 -- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f01557b0 msgr2=0x7f57f00c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:51.968 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5307640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f01557b0 0x7f57f00c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:51.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5307640 1 -- 172.21.15.94:0/796044389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f015a260 con 0x7f57f0158650 2023-10-16T08:52:51.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f6309640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f01557b0 0x7f57f00c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:51.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57f5307640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 0x7f57f015a830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c2b0 tx=0x7f57e0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.956+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0039070 con 0x7f57f0158650 2023-10-16T08:52:51.969 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.957+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0007270 con 0x7f57f0158650 2023-10-16T08:52:51.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.957+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0007600 con 0x7f57f0158650 2023-10-16T08:52:51.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.957+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f015a540 con 0x7f57f0158650 2023-10-16T08:52:51.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.957+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f015ad70 con 0x7f57f0158650 2023-10-16T08:52:51.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.958+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f01575c0 con 0x7f57f0158650 2023-10-16T08:52:51.970 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.959+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f57e0032070 con 0x7f57f0158650 2023-10-16T08:52:51.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.959+0000 7f57e67fc640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f57d406aea0 0x7f57d406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:51.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.959+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57e003c040 con 0x7f57f0158650 2023-10-16T08:52:51.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.960+0000 7f57f5b08640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f57d406aea0 0x7f57d406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:51.971 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.960+0000 7f57f5b08640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f57d406aea0 0x7f57d406d360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009a90 tx=0x7f57ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:51.972 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:51.964+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57e0075b50 con 0x7f57f0158650 2023-10-16T08:52:52.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.153+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57f004e9b0 con 0x7f57f0158650 2023-10-16T08:52:52.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.154+0000 7f57e67fc640 1 -- 172.21.15.94:0/796044389 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57e0045020 con 0x7f57f0158650 2023-10-16T08:52:52.156 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:52.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f57d406aea0 msgr2=0x7f57d406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f57d406aea0 0x7f57d406d360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009a90 tx=0x7f57ec008040 comp rx=0 tx=0).stop 2023-10-16T08:52:52.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 msgr2=0x7f57f015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 0x7f57f015a830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c2b0 tx=0x7f57e0001930 comp rx=0 tx=0).stop 2023-10-16T08:52:52.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 shutdown_connections 2023-10-16T08:52:52.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f57d406aea0 0x7f57d406d360 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f01557b0 0x7f57f00c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57f0158650 0x7f57f015a830 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 --2- 172.21.15.94:0/796044389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57dc003fc0 0x7f57f00c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 >> 172.21.15.94:0/796044389 conn(0x7f57f006a200 msgr2=0x7f57f006ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:52.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 shutdown_connections 2023-10-16T08:52:52.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.157+0000 7f57f6b0a640 1 -- 172.21.15.94:0/796044389 wait complete. 2023-10-16T08:52:52.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T08:52:52.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.388+0000 7fbeb62da640 1 Processor -- start 2023-10-16T08:52:52.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.388+0000 7fbeb62da640 1 -- start start 2023-10-16T08:52:52.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.389+0000 7fbeb62da640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbeb00d0d80 0x7fbeb00d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb62da640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb00b5fd0 0x7fbeb00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb62da640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb00ce810 con 0x7fbeb015c940 2023-10-16T08:52:52.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb62da640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb00d1740 con 0x7fbeb00d0d80 2023-10-16T08:52:52.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb62da640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb00b5b40 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb52d8640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fbeb015c940 0x7fbeb00d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60462/0 (socket says 172.21.15.94:60462) 2023-10-16T08:52:52.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb52d8640 1 -- 172.21.15.94:0/1359994202 learned_addr learned my addr 172.21.15.94:0/1359994202 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:52.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb4ad7640 1 --2- 172.21.15.94:0/1359994202 >> v2:172.21.15.94:3300/0 conn(0x7fbeb00d0d80 0x7fbeb00d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:52.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb4ad7640 1 -- 172.21.15.94:0/1359994202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb00b5fd0 msgr2=0x7fbeb00b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:52.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb4ad7640 1 --2- 172.21.15.94:0/1359994202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb00b5fd0 0x7fbeb00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb4ad7640 1 -- 172.21.15.94:0/1359994202 >> v1:172.21.15.94:6789/0 conn(0x7fbeb015c940 legacy=0x7fbeb00d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.390+0000 7fbeb4ad7640 1 -- 172.21.15.94:0/1359994202 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb00d0b10 con 0x7fbeb00d0d80 2023-10-16T08:52:52.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.391+0000 7fbeb4ad7640 1 --2- 172.21.15.94:0/1359994202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00d0d80 0x7fbeb00d1200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbea00097a0 tx=0x7fbea002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4982aa049cc6c4cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:52.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.392+0000 7fbea7fff640 1 -- 172.21.15.94:0/1359994202 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0031780 con 0x7fbeb00d0d80 2023-10-16T08:52:52.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.392+0000 7fbea7fff640 1 -- 172.21.15.94:0/1359994202 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea00318e0 con 0x7fbeb00d0d80 2023-10-16T08:52:52.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.392+0000 7fbea7fff640 1 -- 172.21.15.94:0/1359994202 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0031c70 con 0x7fbeb00d0d80 2023-10-16T08:52:52.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.392+0000 7fbeb62da640 1 -- 172.21.15.94:0/1359994202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00d0d80 msgr2=0x7fbeb00d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.392+0000 7fbeb62da640 1 --2- 172.21.15.94:0/1359994202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00d0d80 0x7fbeb00d1200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbea00097a0 tx=0x7fbea002b820 comp rx=0 tx=0).stop 2023-10-16T08:52:52.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.393+0000 7fbeb62da640 1 -- 172.21.15.94:0/1359994202 shutdown_connections 2023-10-16T08:52:52.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.393+0000 7fbeb62da640 1 --2- 172.21.15.94:0/1359994202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb00b5fd0 0x7fbeb00b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.393+0000 7fbeb62da640 1 --2- 172.21.15.94:0/1359994202 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00d0d80 0x7fbeb00d1200 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.393+0000 7fbeb62da640 1 -- 172.21.15.94:0/1359994202 >> 172.21.15.94:0/1359994202 conn(0x7fbeb009bb30 msgr2=0x7fbeb00d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:52.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.393+0000 7fbeb62da640 1 -- 172.21.15.94:0/1359994202 shutdown_connections 2023-10-16T08:52:52.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.393+0000 7fbeb62da640 1 -- 172.21.15.94:0/1359994202 wait complete. 2023-10-16T08:52:52.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.395+0000 7fbeb62da640 1 Processor -- start 2023-10-16T08:52:52.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.395+0000 7fbeb62da640 1 -- start start 2023-10-16T08:52:52.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb62da640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 0x7fbeb00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb62da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbeb00d0d80 0x7fbeb015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb62da640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb015c940 0x7fbeb0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb62da640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f5850 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb62da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f66b0 con 0x7fbeb00d0d80 2023-10-16T08:52:52.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb62da640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01f5aa0 con 0x7fbeb015c940 2023-10-16T08:52:52.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb52d8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 0x7fbeb00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:52.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb52d8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 0x7fbeb00c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41032/0 (socket says 172.21.15.94:41032) 2023-10-16T08:52:52.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.396+0000 7fbeb52d8640 1 -- 172.21.15.94:0/4024230938 learned_addr learned my addr 172.21.15.94:0/4024230938 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:52.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb52d8640 1 -- 172.21.15.94:0/4024230938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb015c940 msgr2=0x7fbeb0158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb52d8640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb015c940 0x7fbeb0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb52d8640 1 -- 172.21.15.94:0/4024230938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbeb00d0d80 msgr2=0x7fbeb015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb52d8640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbeb00d0d80 0x7fbeb015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb52d8640 1 -- 172.21.15.94:0/4024230938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0009400 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb52d8640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 0x7fbeb00c8f10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c4b0 tx=0x7fbeac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:52.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac005ce0 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac005e40 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac007270 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb01f5d80 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.405 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.397+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb01f6340 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.398+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb004e9b0 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.399+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbeac0073d0 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.400+0000 7fbea5ffb640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbe9406ae70 0x7fbe9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.400+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbeac088e30 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.400+0000 7fbeb4ad7640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbe9406ae70 0x7fbe9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:52.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.401+0000 7fbeb4ad7640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbe9406ae70 0x7fbe9406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbea0036000 tx=0x7fbea0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:52.408 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.405+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbeac057690 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.583 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.581+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbeb00a04e0 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.584 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.582+0000 7fbea5ffb640 1 -- 172.21.15.94:0/4024230938 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbeac017020 con 0x7fbeb00b5fd0 2023-10-16T08:52:52.584 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2023-10-16T08:52:52.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbe9406ae70 msgr2=0x7fbe9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.586 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbe9406ae70 0x7fbe9406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbea0036000 tx=0x7fbea0030000 comp rx=0 tx=0).stop 2023-10-16T08:52:52.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 msgr2=0x7fbeb00c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 0x7fbeb00c8f10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c4b0 tx=0x7fbeac00c970 comp rx=0 tx=0).stop 2023-10-16T08:52:52.587 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 shutdown_connections 2023-10-16T08:52:52.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbeb015c940 0x7fbeb0158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fbe9406ae70 0x7fbe9406d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbeb00d0d80 0x7fbeb015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 --2- 172.21.15.94:0/4024230938 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbeb00b5fd0 0x7fbeb00c8f10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.584+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 >> 172.21.15.94:0/4024230938 conn(0x7fbeb009bb30 msgr2=0x7fbeb00cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:52.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.585+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 shutdown_connections 2023-10-16T08:52:52.589 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.585+0000 7fbeb62da640 1 -- 172.21.15.94:0/4024230938 wait complete. 2023-10-16T08:52:52.605 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T08:52:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.812+0000 7f33a3d3c640 1 Processor -- start 2023-10-16T08:52:52.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.812+0000 7f33a3d3c640 1 -- start start 2023-10-16T08:52:52.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.813+0000 7f33a3d3c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f339c0cdbb0 0x7f339c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.813+0000 7f33a3d3c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c0cb610 0x7f339c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.813+0000 7f33a3d3c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c0cb180 con 0x7f339c15c580 2023-10-16T08:52:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.813+0000 7f33a3d3c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c0cac40 con 0x7f339c0cdbb0 2023-10-16T08:52:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.813+0000 7f33a3d3c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c15c9e0 con 0x7f339c0cb610 2023-10-16T08:52:52.816 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f339c0cdbb0 0x7f339c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:52.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f339c0cdbb0 0x7f339c0cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41038/0 (socket says 172.21.15.94:41038) 2023-10-16T08:52:52.817 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 -- 172.21.15.94:0/4166788376 learned_addr learned my addr 172.21.15.94:0/4166788376 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:52.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 -- 172.21.15.94:0/4166788376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c0cb610 msgr2=0x7f339c0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:52.818 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 --2- 172.21.15.94:0/4166788376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c0cb610 0x7f339c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 -- 172.21.15.94:0/4166788376 >> v1:172.21.15.130:6789/0 conn(0x7f339c15c580 legacy=0x7f339c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:52.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.814+0000 7f33a1ad8640 1 -- 172.21.15.94:0/4166788376 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0cbaa0 con 0x7f339c0cdbb0 2023-10-16T08:52:52.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.815+0000 7f33a1ad8640 1 --2- 172.21.15.94:0/4166788376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cdbb0 0x7f339c0cd5f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3398009870 tx=0x7f339802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4ac1dedad28aad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:52.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a0ad6640 1 -- 172.21.15.94:0/4166788376 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398031640 con 0x7f339c0cdbb0 2023-10-16T08:52:52.819 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a0ad6640 1 -- 172.21.15.94:0/4166788376 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33980317a0 con 0x7f339c0cdbb0 2023-10-16T08:52:52.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a0ad6640 1 -- 172.21.15.94:0/4166788376 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398031b30 con 0x7f339c0cdbb0 2023-10-16T08:52:52.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 -- 172.21.15.94:0/4166788376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cdbb0 msgr2=0x7f339c0cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/4166788376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cdbb0 0x7f339c0cd5f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3398009870 tx=0x7f339802b8f0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 -- 172.21.15.94:0/4166788376 shutdown_connections 2023-10-16T08:52:52.820 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/4166788376 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c0cb610 0x7f339c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/4166788376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cdbb0 0x7f339c0cd5f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 -- 172.21.15.94:0/4166788376 >> 172.21.15.94:0/4166788376 conn(0x7f339c0b0030 msgr2=0x7f339c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:52.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.816+0000 7f33a3d3c640 1 -- 172.21.15.94:0/4166788376 shutdown_connections 2023-10-16T08:52:52.821 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.817+0000 7f33a3d3c640 1 -- 172.21.15.94:0/4166788376 wait complete. 2023-10-16T08:52:52.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.818+0000 7f33a3d3c640 1 Processor -- start 2023-10-16T08:52:52.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.818+0000 7f33a3d3c640 1 -- start start 2023-10-16T08:52:52.823 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.819+0000 7f33a3d3c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 0x7f339c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.819+0000 7f33a3d3c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f339c0cdbb0 0x7f339c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.819+0000 7f33a3d3c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c15c580 0x7f339c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.819+0000 7f33a3d3c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c3980 con 0x7f339c0cb610 2023-10-16T08:52:52.824 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.819+0000 7f33a3d3c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c4f20 con 0x7f339c0cdbb0 2023-10-16T08:52:52.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.819+0000 7f33a3d3c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c3330 con 0x7f339c15c580 2023-10-16T08:52:52.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 0x7f339c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:52.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 0x7f339c0c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41052/0 (socket says 172.21.15.94:41052) 2023-10-16T08:52:52.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 -- 172.21.15.94:0/68546449 learned_addr learned my addr 172.21.15.94:0/68546449 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:52.825 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 -- 172.21.15.94:0/68546449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c15c580 msgr2=0x7f339c14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c15c580 0x7f339c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 -- 172.21.15.94:0/68546449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f339c0cdbb0 msgr2=0x7f339c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f339c0cdbb0 0x7f339c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 -- 172.21.15.94:0/68546449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980094d0 con 0x7f339c0cb610 2023-10-16T08:52:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.820+0000 7f33a1ad8640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 0x7f339c0c3e10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3398009870 tx=0x7f33980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:52.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.821+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339803ac60 con 0x7f339c0cb610 2023-10-16T08:52:52.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.821+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339803ade0 con 0x7f339c0cb610 2023-10-16T08:52:52.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.821+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c0c3610 con 0x7f339c0cb610 2023-10-16T08:52:52.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.821+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398044630 con 0x7f339c0cb610 2023-10-16T08:52:52.827 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.821+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c14ed00 con 0x7f339c0cb610 2023-10-16T08:52:52.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.822+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c073ef0 con 0x7f339c0cb610 2023-10-16T08:52:52.828 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.823+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f339802f050 con 0x7f339c0cb610 2023-10-16T08:52:52.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.824+0000 7f338e7fc640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f338006ae70 0x7f338006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:52.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.824+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f33980abbe0 con 0x7f339c0cb610 2023-10-16T08:52:52.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.824+0000 7f33a12d7640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f338006ae70 0x7f338006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:52.829 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.825+0000 7f33a12d7640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f338006ae70 0x7f338006d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f339c149e00 tx=0x7f3390006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:52.830 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:52.828+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33980768f0 con 0x7f339c0cb610 2023-10-16T08:52:53.022 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.020+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f339c0cd2a0 con 0x7f339c0cb610 2023-10-16T08:52:53.023 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.021+0000 7f338e7fc640 1 -- 172.21.15.94:0/68546449 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3398079f10 con 0x7f339c0cb610 2023-10-16T08:52:53.023 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2023-10-16T08:52:53.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f338006ae70 msgr2=0x7f338006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f338006ae70 0x7f338006d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f339c149e00 tx=0x7f3390006ba0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 msgr2=0x7f339c0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 0x7f339c0c3e10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3398009870 tx=0x7f33980046c0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.026 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 shutdown_connections 2023-10-16T08:52:53.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f339c15c580 0x7f339c14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f338006ae70 0x7f338006d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f339c0cdbb0 0x7f339c0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 --2- 172.21.15.94:0/68546449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f339c0cb610 0x7f339c0c3e10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.027 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.023+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 >> 172.21.15.94:0/68546449 conn(0x7f339c0b0030 msgr2=0x7f339c0aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:53.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.024+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 shutdown_connections 2023-10-16T08:52:53.028 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.024+0000 7f33a3d3c640 1 -- 172.21.15.94:0/68546449 wait complete. 2023-10-16T08:52:53.044 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:52:53.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.256+0000 7f2f0061a640 1 Processor -- start 2023-10-16T08:52:53.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.256+0000 7f2f0061a640 1 -- start start 2023-10-16T08:52:53.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.257+0000 7f2f0061a640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef80c9e00 0x7f2ef80c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.257+0000 7f2f0061a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2ef80ca1e0 0x7f2ef80710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.257+0000 7f2f0061a640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef8071e40 con 0x7f2ef8071630 2023-10-16T08:52:53.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.257+0000 7f2f0061a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef80cde00 con 0x7f2ef80ca1e0 2023-10-16T08:52:53.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.257+0000 7f2f0061a640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef8072120 con 0x7f2ef80c9e00 2023-10-16T08:52:53.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efdbb5640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2ef80ca1e0 0x7f2ef80710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efebb7640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2ef8071630 0x7f2ef80cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60464/0 (socket says 172.21.15.94:60464) 2023-10-16T08:52:53.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efebb7640 1 -- 172.21.15.94:0/1825235730 learned_addr learned my addr 172.21.15.94:0/1825235730 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:53.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efe3b6640 1 --2- 172.21.15.94:0/1825235730 >> v2:172.21.15.130:3300/0 conn(0x7f2ef80c9e00 0x7f2ef80c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efdbb5640 1 -- 172.21.15.94:0/1825235730 >> v2:172.21.15.130:3300/0 conn(0x7f2ef80c9e00 msgr2=0x7f2ef80c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:53.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efdbb5640 1 --2- 172.21.15.94:0/1825235730 >> v2:172.21.15.130:3300/0 conn(0x7f2ef80c9e00 0x7f2ef80c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efdbb5640 1 -- 172.21.15.94:0/1825235730 >> v1:172.21.15.94:6789/0 conn(0x7f2ef8071630 legacy=0x7f2ef80cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efdbb5640 1 -- 172.21.15.94:0/1825235730 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8072400 con 0x7f2ef80ca1e0 2023-10-16T08:52:53.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.258+0000 7f2efd3b4640 1 -- 172.21.15.94:0/1825235730 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411639938 0 0) 0x7f2ef8071e40 con 0x7f2ef8071630 2023-10-16T08:52:53.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.259+0000 7f2efdbb5640 1 --2- 172.21.15.94:0/1825235730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef80710f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80ce3b0 tx=0x7f2ee802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b695393723752f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:53.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2efd3b4640 1 -- 172.21.15.94:0/1825235730 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8031830 con 0x7f2ef80ca1e0 2023-10-16T08:52:53.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2efd3b4640 1 -- 172.21.15.94:0/1825235730 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8031990 con 0x7f2ef80ca1e0 2023-10-16T08:52:53.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2efd3b4640 1 -- 172.21.15.94:0/1825235730 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8031d20 con 0x7f2ef80ca1e0 2023-10-16T08:52:53.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2f0061a640 1 -- 172.21.15.94:0/1825235730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef80ca1e0 msgr2=0x7f2ef80710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2f0061a640 1 --2- 172.21.15.94:0/1825235730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef80710f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80ce3b0 tx=0x7f2ee802b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2f0061a640 1 -- 172.21.15.94:0/1825235730 shutdown_connections 2023-10-16T08:52:53.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2f0061a640 1 --2- 172.21.15.94:0/1825235730 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef80710f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2f0061a640 1 --2- 172.21.15.94:0/1825235730 >> v2:172.21.15.130:3300/0 conn(0x7f2ef80c9e00 0x7f2ef80c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.260+0000 7f2f0061a640 1 -- 172.21.15.94:0/1825235730 >> 172.21.15.94:0/1825235730 conn(0x7f2ef806c1c0 msgr2=0x7f2ef806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:53.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.261+0000 7f2f0061a640 1 -- 172.21.15.94:0/1825235730 shutdown_connections 2023-10-16T08:52:53.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.261+0000 7f2f0061a640 1 -- 172.21.15.94:0/1825235730 wait complete. 2023-10-16T08:52:53.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.262+0000 7f2f0061a640 1 Processor -- start 2023-10-16T08:52:53.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.262+0000 7f2f0061a640 1 -- start start 2023-10-16T08:52:53.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2f0061a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 0x7f2ef80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2f0061a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef80c9e00 0x7f2ef8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2f0061a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef81468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2f0061a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef8149850 con 0x7f2ef8071630 2023-10-16T08:52:53.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2f0061a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80b1d90 con 0x7f2ef80ca1e0 2023-10-16T08:52:53.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2f0061a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80b22c0 con 0x7f2ef80c9e00 2023-10-16T08:52:53.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2efe3b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 0x7f2ef80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2efe3b6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 0x7f2ef80b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41064/0 (socket says 172.21.15.94:41064) 2023-10-16T08:52:53.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.263+0000 7f2efe3b6640 1 -- 172.21.15.94:0/2775587095 learned_addr learned my addr 172.21.15.94:0/2775587095 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:53.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efdbb5640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef80c9e00 0x7f2ef8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.271 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efebb7640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef81468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.272 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efe3b6640 1 -- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef80c9e00 msgr2=0x7f2ef8149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.272 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efe3b6640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef80c9e00 0x7f2ef8149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.272 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efe3b6640 1 -- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80ca1e0 msgr2=0x7f2ef81468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.272 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efe3b6640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef81468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.272 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efe3b6640 1 -- 172.21.15.94:0/2775587095 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009400 con 0x7f2ef8071630 2023-10-16T08:52:53.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efdbb5640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef80c9e00 0x7f2ef8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:53.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efebb7640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef81468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:53.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2efe3b6640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 0x7f2ef80b30d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d800 tx=0x7f2ef400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:53.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400b6c0 con 0x7f2ef8071630 2023-10-16T08:52:53.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400b820 con 0x7f2ef8071630 2023-10-16T08:52:53.273 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.264+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400bbb0 con 0x7f2ef8071630 2023-10-16T08:52:53.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.265+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef80b1fe0 con 0x7f2ef8071630 2023-10-16T08:52:53.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.265+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef814ea70 con 0x7f2ef8071630 2023-10-16T08:52:53.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.266+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef8073ef0 con 0x7f2ef8071630 2023-10-16T08:52:53.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.267+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ef400bd10 con 0x7f2ef8071630 2023-10-16T08:52:53.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.267+0000 7f2eeeffd640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2edc06ae70 0x7f2edc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.267+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2ef4089ee0 con 0x7f2ef8071630 2023-10-16T08:52:53.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.268+0000 7f2efdbb5640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2edc06ae70 0x7f2edc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.275 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.268+0000 7f2efdbb5640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2edc06ae70 0x7f2edc06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8036000 tx=0x7f2ee803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:53.276 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.272+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ef4054c60 con 0x7f2ef8071630 2023-10-16T08:52:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.479+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef814ec30 con 0x7f2ef8071630 2023-10-16T08:52:53.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.480+0000 7f2eeeffd640 1 -- 172.21.15.94:0/2775587095 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f2ef4058280 con 0x7f2ef8071630 2023-10-16T08:52:53.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:53.482 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:52:53.482 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:52:53.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2edc06ae70 msgr2=0x7f2edc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2edc06ae70 0x7f2edc06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8036000 tx=0x7f2ee803c040 comp rx=0 tx=0).stop 2023-10-16T08:52:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 msgr2=0x7f2ef80b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 0x7f2ef80b30d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d800 tx=0x7f2ef400dcc0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 shutdown_connections 2023-10-16T08:52:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2edc06ae70 0x7f2edc06d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef80ca1e0 0x7f2ef81468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef80c9e00 0x7f2ef8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 --2- 172.21.15.94:0/2775587095 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2ef8071630 0x7f2ef80b30d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.482+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 >> 172.21.15.94:0/2775587095 conn(0x7f2ef806c1c0 msgr2=0x7f2ef80b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.483+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 shutdown_connections 2023-10-16T08:52:53.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.483+0000 7f2f0061a640 1 -- 172.21.15.94:0/2775587095 wait complete. 2023-10-16T08:52:53.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:53.706 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.704+0000 7f3b59c7c640 1 Processor -- start 2023-10-16T08:52:53.707 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.705+0000 7f3b59c7c640 1 -- start start 2023-10-16T08:52:53.708 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.706+0000 7f3b59c7c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b540b0010 0x7f3b540701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.706+0000 7f3b59c7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3b5415f040 0x7f3b5415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.706+0000 7f3b59c7c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b540707f0 con 0x7f3b5415ad00 2023-10-16T08:52:53.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.706+0000 7f3b59c7c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b54070ad0 con 0x7f3b540b0010 2023-10-16T08:52:53.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.706+0000 7f3b59c7c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5415b1d0 con 0x7f3b5415f040 2023-10-16T08:52:53.709 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.706+0000 7f3b537fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b540b0010 0x7f3b540701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b537fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b540b0010 0x7f3b540701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41078/0 (socket says 172.21.15.94:41078) 2023-10-16T08:52:53.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b537fe640 1 -- 172.21.15.94:0/1913665401 learned_addr learned my addr 172.21.15.94:0/1913665401 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:53.710 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b53fff640 1 --2- 172.21.15.94:0/1913665401 >> v2:172.21.15.130:3300/0 conn(0x7f3b5415f040 0x7f3b5415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b537fe640 1 -- 172.21.15.94:0/1913665401 >> v2:172.21.15.130:3300/0 conn(0x7f3b5415f040 msgr2=0x7f3b5415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:53.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b537fe640 1 --2- 172.21.15.94:0/1913665401 >> v2:172.21.15.130:3300/0 conn(0x7f3b5415f040 0x7f3b5415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.711 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b537fe640 1 -- 172.21.15.94:0/1913665401 >> v1:172.21.15.130:6789/0 conn(0x7f3b5415ad00 legacy=0x7f3b540b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:53.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b537fe640 1 -- 172.21.15.94:0/1913665401 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5415b4b0 con 0x7f3b540b0010 2023-10-16T08:52:53.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.707+0000 7f3b53fff640 1 --2- 172.21.15.94:0/1913665401 >> v2:172.21.15.130:3300/0 conn(0x7f3b5415f040 0x7f3b5415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:53.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.709+0000 7f3b537fe640 1 --2- 172.21.15.94:0/1913665401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b540b0010 0x7f3b540701a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3b540adf80 tx=0x7f3b4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7138f7b2e17194e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:53.712 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.709+0000 7f3b52ffd640 1 -- 172.21.15.94:0/1913665401 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44031870 con 0x7f3b540b0010 2023-10-16T08:52:53.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.709+0000 7f3b52ffd640 1 -- 172.21.15.94:0/1913665401 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b440319d0 con 0x7f3b540b0010 2023-10-16T08:52:53.713 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.709+0000 7f3b52ffd640 1 -- 172.21.15.94:0/1913665401 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44031d60 con 0x7f3b540b0010 2023-10-16T08:52:53.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 -- 172.21.15.94:0/1913665401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b540b0010 msgr2=0x7f3b540701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/1913665401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b540b0010 0x7f3b540701a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3b540adf80 tx=0x7f3b4402b910 comp rx=0 tx=0).stop 2023-10-16T08:52:53.714 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 -- 172.21.15.94:0/1913665401 shutdown_connections 2023-10-16T08:52:53.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/1913665401 >> v2:172.21.15.130:3300/0 conn(0x7f3b5415f040 0x7f3b5415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/1913665401 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b540b0010 0x7f3b540701a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 -- 172.21.15.94:0/1913665401 >> 172.21.15.94:0/1913665401 conn(0x7f3b5406c1c0 msgr2=0x7f3b5406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:53.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 -- 172.21.15.94:0/1913665401 shutdown_connections 2023-10-16T08:52:53.715 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.710+0000 7f3b59c7c640 1 -- 172.21.15.94:0/1913665401 wait complete. 2023-10-16T08:52:53.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.712+0000 7f3b59c7c640 1 Processor -- start 2023-10-16T08:52:53.716 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.712+0000 7f3b59c7c640 1 -- start start 2023-10-16T08:52:53.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b59c7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b540b0010 0x7f3b540c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b59c7c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 0x7f3b540ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.718 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b59c7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b5415f040 0x7f3b540abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b59c7c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540c65f0 con 0x7f3b5415ad00 2023-10-16T08:52:53.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b59c7c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541f1f90 con 0x7f3b540b0010 2023-10-16T08:52:53.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b59c7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540c2b00 con 0x7f3b5415f040 2023-10-16T08:52:53.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 0x7f3b540ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.719 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 0x7f3b540ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41094/0 (socket says 172.21.15.94:41094) 2023-10-16T08:52:53.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b4bfff640 1 -- 172.21.15.94:0/3402545930 learned_addr learned my addr 172.21.15.94:0/3402545930 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:53.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.713+0000 7f3b537fe640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b540b0010 0x7f3b540c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b4bfff640 1 -- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b5415f040 msgr2=0x7f3b540abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b53fff640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b5415f040 0x7f3b540abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b4bfff640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b5415f040 0x7f3b540abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.720 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b4bfff640 1 -- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b540b0010 msgr2=0x7f3b540c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b4bfff640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b540b0010 0x7f3b540c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b4bfff640 1 -- 172.21.15.94:0/3402545930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440094d0 con 0x7f3b5415ad00 2023-10-16T08:52:53.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b537fe640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b540b0010 0x7f3b540c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:53.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b4bfff640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 0x7f3b540ab860 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c400 tx=0x7f3b3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:53.721 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c011790 con 0x7f3b5415ad00 2023-10-16T08:52:53.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c011930 con 0x7f3b5415ad00 2023-10-16T08:52:53.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b540c2de0 con 0x7f3b5415ad00 2023-10-16T08:52:53.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c011ce0 con 0x7f3b5415ad00 2023-10-16T08:52:53.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.714+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540c6280 con 0x7f3b5415ad00 2023-10-16T08:52:53.722 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.715+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b540c67a0 con 0x7f3b5415ad00 2023-10-16T08:52:53.723 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.716+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b3c01c460 con 0x7f3b5415ad00 2023-10-16T08:52:53.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.718+0000 7f3b50ff9640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3b3406ae70 0x7f3b3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:53.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.718+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b3c089990 con 0x7f3b5415ad00 2023-10-16T08:52:53.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.718+0000 7f3b537fe640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3b3406ae70 0x7f3b3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:53.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.718+0000 7f3b537fe640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3b3406ae70 0x7f3b3406d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3b44036000 tx=0x7f3b4403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:53.724 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.722+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b540c67a0 con 0x7f3b5415ad00 2023-10-16T08:52:53.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.912+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b5415bee0 con 0x7f3b5415ad00 2023-10-16T08:52:53.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.915+0000 7f3b50ff9640 1 -- 172.21.15.94:0/3402545930 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f3b3c0545e0 con 0x7f3b5415ad00 2023-10-16T08:52:53.917 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:53.918 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:53.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3b3406ae70 msgr2=0x7f3b3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3b3406ae70 0x7f3b3406d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3b44036000 tx=0x7f3b4403c040 comp rx=0 tx=0).stop 2023-10-16T08:52:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 msgr2=0x7f3b540ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 0x7f3b540ab860 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c400 tx=0x7f3b3c00c8c0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 shutdown_connections 2023-10-16T08:52:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b5415f040 0x7f3b540abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b5415ad00 0x7f3b540ab860 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3b3406ae70 0x7f3b3406d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 --2- 172.21.15.94:0/3402545930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b540b0010 0x7f3b540c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.917+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 >> 172.21.15.94:0/3402545930 conn(0x7f3b5406c1c0 msgr2=0x7f3b54072920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.918+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 shutdown_connections 2023-10-16T08:52:53.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:53.918+0000 7f3b59c7c640 1 -- 172.21.15.94:0/3402545930 wait complete. 2023-10-16T08:52:53.940 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T08:52:53.940 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:52:54.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.151+0000 7f3948990640 1 Processor -- start 2023-10-16T08:52:54.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.152+0000 7f3948990640 1 -- start start 2023-10-16T08:52:54.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3948990640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f394415ad00 0x7f39440701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3948990640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3948990640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440707f0 con 0x7f39440b0010 2023-10-16T08:52:54.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3948990640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3944070ad0 con 0x7f394415ad00 2023-10-16T08:52:54.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3948990640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394415b1d0 con 0x7f394415f040 2023-10-16T08:52:54.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3941d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f394415ad00 0x7f39440701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f394259c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f39440b0010 0x7f39440b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:60472/0 (socket says 172.21.15.94:60472) 2023-10-16T08:52:54.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f394259c640 1 -- 172.21.15.94:0/3207982011 learned_addr learned my addr 172.21.15.94:0/3207982011 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:54.157 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.153+0000 7f3941d9b640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f394415ad00 0x7f39440701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41104/0 (socket says 172.21.15.94:41104) 2023-10-16T08:52:54.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.154+0000 7f3942d9d640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.158 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.154+0000 7f3941d9b640 1 -- 172.21.15.94:0/3207982011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 msgr2=0x7f394415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:54.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.154+0000 7f3941d9b640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.154+0000 7f3941d9b640 1 -- 172.21.15.94:0/3207982011 >> v1:172.21.15.94:6789/0 conn(0x7f39440b0010 legacy=0x7f39440b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.154+0000 7f3941d9b640 1 -- 172.21.15.94:0/3207982011 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394415b4b0 con 0x7f394415ad00 2023-10-16T08:52:54.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.154+0000 7f3942d9d640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:54.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.155+0000 7f3941d9b640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394415ad00 0x7f39440701a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f392c0097a0 tx=0x7f392c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfa64b037e8d177 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:54.159 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.155+0000 7f394159a640 1 -- 172.21.15.94:0/3207982011 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c02d040 con 0x7f394415ad00 2023-10-16T08:52:54.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.155+0000 7f394159a640 1 -- 172.21.15.94:0/3207982011 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c031810 con 0x7f394415ad00 2023-10-16T08:52:54.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.155+0000 7f394159a640 1 -- 172.21.15.94:0/3207982011 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c031ba0 con 0x7f394415ad00 2023-10-16T08:52:54.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 -- 172.21.15.94:0/3207982011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394415ad00 msgr2=0x7f39440701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394415ad00 0x7f39440701a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f392c0097a0 tx=0x7f392c02b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 -- 172.21.15.94:0/3207982011 shutdown_connections 2023-10-16T08:52:54.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 --2- 172.21.15.94:0/3207982011 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f394415ad00 0x7f39440701a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 -- 172.21.15.94:0/3207982011 >> 172.21.15.94:0/3207982011 conn(0x7f394406c1c0 msgr2=0x7f394406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:54.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 -- 172.21.15.94:0/3207982011 shutdown_connections 2023-10-16T08:52:54.161 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.156+0000 7f3948990640 1 -- 172.21.15.94:0/3207982011 wait complete. 2023-10-16T08:52:54.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.158+0000 7f3948990640 1 Processor -- start 2023-10-16T08:52:54.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.158+0000 7f3948990640 1 -- start start 2023-10-16T08:52:54.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f3948990640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 0x7f39440cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f3948990640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394415ad00 0x7f39440c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f3948990640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f3948990640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440ce220 con 0x7f39440b0010 2023-10-16T08:52:54.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f3948990640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440b12e0 con 0x7f394415ad00 2023-10-16T08:52:54.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f3948990640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440b3730 con 0x7f394415f040 2023-10-16T08:52:54.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 0x7f39440cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 0x7f39440cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41118/0 (socket says 172.21.15.94:41118) 2023-10-16T08:52:54.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 -- 172.21.15.94:0/1612136721 learned_addr learned my addr 172.21.15.94:0/1612136721 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:54.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 -- 172.21.15.94:0/1612136721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 msgr2=0x7f394414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 -- 172.21.15.94:0/1612136721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394415ad00 msgr2=0x7f39440c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394415ad00 0x7f39440c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.166 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.159+0000 7f394259c640 1 -- 172.21.15.94:0/1612136721 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009400 con 0x7f39440b0010 2023-10-16T08:52:54.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.160+0000 7f394259c640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 0x7f39440cdce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f393400cba0 tx=0x7f393400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:54.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.160+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400ad40 con 0x7f39440b0010 2023-10-16T08:52:54.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.160+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934012400 con 0x7f39440b0010 2023-10-16T08:52:54.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.160+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400aea0 con 0x7f39440b0010 2023-10-16T08:52:54.167 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.160+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39440b3a10 con 0x7f39440b0010 2023-10-16T08:52:54.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.160+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39440b15c0 con 0x7f39440b0010 2023-10-16T08:52:54.168 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.161+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39440b3f30 con 0x7f39440b0010 2023-10-16T08:52:54.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.162+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3934007070 con 0x7f39440b0010 2023-10-16T08:52:54.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.163+0000 7f393affd640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f392406ae70 0x7f392406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.163+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3934089870 con 0x7f39440b0010 2023-10-16T08:52:54.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.163+0000 7f3941d9b640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f392406ae70 0x7f392406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.164+0000 7f3941d9b640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f392406ae70 0x7f392406d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f392c036000 tx=0x7f392c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:54.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.167+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39440b3f30 con 0x7f39440b0010 2023-10-16T08:52:54.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.380+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39440b3f30 con 0x7f39440b0010 2023-10-16T08:52:54.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.381+0000 7f393affd640 1 -- 172.21.15.94:0/1612136721 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f3934017090 con 0x7f39440b0010 2023-10-16T08:52:54.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:54.384 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:52:54.384 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:52:54.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.383+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f392406ae70 msgr2=0x7f392406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.383+0000 7f3948990640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f392406ae70 0x7f392406d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f392c036000 tx=0x7f392c030000 comp rx=0 tx=0).stop 2023-10-16T08:52:54.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.383+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 msgr2=0x7f39440cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.383+0000 7f3948990640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 0x7f39440cdce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f393400cba0 tx=0x7f393400a430 comp rx=0 tx=0).stop 2023-10-16T08:52:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 shutdown_connections 2023-10-16T08:52:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f394415f040 0x7f394414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f392406ae70 0x7f392406d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f394415ad00 0x7f39440c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 --2- 172.21.15.94:0/1612136721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39440b0010 0x7f39440cdce0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 >> 172.21.15.94:0/1612136721 conn(0x7f394406c1c0 msgr2=0x7f394406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:54.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 shutdown_connections 2023-10-16T08:52:54.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.384+0000 7f3948990640 1 -- 172.21.15.94:0/1612136721 wait complete. 2023-10-16T08:52:54.404 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:52:54.615 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.613+0000 7f0e4b81a640 1 Processor -- start 2023-10-16T08:52:54.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.614+0000 7f0e4b81a640 1 -- start start 2023-10-16T08:52:54.617 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e4b81a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e440ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e4b81a640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e4406a4f0 0x7f0e440cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e4b81a640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e44161250 con 0x7f0e4415ca80 2023-10-16T08:52:54.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e4b81a640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e441614f0 con 0x7f0e4406a4f0 2023-10-16T08:52:54.618 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e4b81a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44071ed0 con 0x7f0e440c9e70 2023-10-16T08:52:54.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e49db7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e4406a4f0 0x7f0e440cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e49db7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0e4406a4f0 0x7f0e440cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41886/0 (socket says 172.21.15.94:41886) 2023-10-16T08:52:54.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e49db7640 1 -- 172.21.15.94:0/587235882 learned_addr learned my addr 172.21.15.94:0/587235882 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:54.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e48db5640 1 --2- 172.21.15.94:0/587235882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e440ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.615+0000 7f0e49db7640 1 -- 172.21.15.94:0/587235882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 msgr2=0x7f0e440ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:54.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.616+0000 7f0e49db7640 1 --2- 172.21.15.94:0/587235882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e440ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.616+0000 7f0e49db7640 1 -- 172.21.15.94:0/587235882 >> v1:172.21.15.130:6789/0 conn(0x7f0e4415ca80 legacy=0x7f0e44069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:54.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.616+0000 7f0e49db7640 1 -- 172.21.15.94:0/587235882 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440721b0 con 0x7f0e4406a4f0 2023-10-16T08:52:54.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.617+0000 7f0e49db7640 1 --2- 172.21.15.94:0/587235882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4406a4f0 0x7f0e440cd310 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009e80 tx=0x7f0e3c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b32790e708a29b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:54.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.617+0000 7f0e3bfff640 1 -- 172.21.15.94:0/587235882 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c02ca50 con 0x7f0e4406a4f0 2023-10-16T08:52:54.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.617+0000 7f0e3bfff640 1 -- 172.21.15.94:0/587235882 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c02cbb0 con 0x7f0e4406a4f0 2023-10-16T08:52:54.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.617+0000 7f0e3bfff640 1 -- 172.21.15.94:0/587235882 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0343f0 con 0x7f0e4406a4f0 2023-10-16T08:52:54.622 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.617+0000 7f0e4b81a640 1 -- 172.21.15.94:0/587235882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4406a4f0 msgr2=0x7f0e440cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.617+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/587235882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4406a4f0 0x7f0e440cd310 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009e80 tx=0x7f0e3c02beb0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.618+0000 7f0e4b81a640 1 -- 172.21.15.94:0/587235882 shutdown_connections 2023-10-16T08:52:54.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.618+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/587235882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4406a4f0 0x7f0e440cd310 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.623 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.618+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/587235882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e440ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.618+0000 7f0e4b81a640 1 -- 172.21.15.94:0/587235882 >> 172.21.15.94:0/587235882 conn(0x7f0e440cc0c0 msgr2=0x7f0e440cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:54.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.618+0000 7f0e4b81a640 1 -- 172.21.15.94:0/587235882 shutdown_connections 2023-10-16T08:52:54.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.618+0000 7f0e4b81a640 1 -- 172.21.15.94:0/587235882 wait complete. 2023-10-16T08:52:54.624 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.619+0000 7f0e4b81a640 1 Processor -- start 2023-10-16T08:52:54.625 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.619+0000 7f0e4b81a640 1 -- start start 2023-10-16T08:52:54.627 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.620+0000 7f0e4b81a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e4406a4f0 0x7f0e4415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.620+0000 7f0e4b81a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e4415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.620+0000 7f0e4b81a640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 0x7f0e440cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.620+0000 7f0e4b81a640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415ea10 con 0x7f0e4415ca80 2023-10-16T08:52:54.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.620+0000 7f0e4b81a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415b7b0 con 0x7f0e4406a4f0 2023-10-16T08:52:54.628 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.620+0000 7f0e4b81a640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415e170 con 0x7f0e440c9e70 2023-10-16T08:52:54.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 0x7f0e440cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 0x7f0e440cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41892/0 (socket says 172.21.15.94:41892) 2023-10-16T08:52:54.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 -- 172.21.15.94:0/2672801112 learned_addr learned my addr 172.21.15.94:0/2672801112 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:54.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e48db5640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e4415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.629 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e495b6640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e4406a4f0 0x7f0e4415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 -- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 msgr2=0x7f0e4415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e4415fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 -- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e4406a4f0 msgr2=0x7f0e4415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.630 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e4406a4f0 0x7f0e4415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 -- 172.21.15.94:0/2672801112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009b30 con 0x7f0e4415ca80 2023-10-16T08:52:54.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e48db5640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e4415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:54.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.621+0000 7f0e49db7640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 0x7f0e440cf8a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009fa0 tx=0x7f0e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:54.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.622+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c009510 con 0x7f0e4415ca80 2023-10-16T08:52:54.631 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.622+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c03e450 con 0x7f0e4415ca80 2023-10-16T08:52:54.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.622+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c03e7e0 con 0x7f0e4415ca80 2023-10-16T08:52:54.634 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.622+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4415e450 con 0x7f0e4415ca80 2023-10-16T08:52:54.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.622+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e440c7f70 con 0x7f0e4415ca80 2023-10-16T08:52:54.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.623+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e440c8190 con 0x7f0e4415ca80 2023-10-16T08:52:54.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.624+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e3c03e940 con 0x7f0e4415ca80 2023-10-16T08:52:54.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.625+0000 7f0e39ffb640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0e2806ae70 0x7f0e2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:54.635 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.625+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e3c0ac850 con 0x7f0e4415ca80 2023-10-16T08:52:54.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.625+0000 7f0e495b6640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0e2806ae70 0x7f0e2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:54.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.626+0000 7f0e495b6640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0e2806ae70 0x7f0e2806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000a730 tx=0x7f0e40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:54.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.629+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e3c077530 con 0x7f0e4415ca80 2023-10-16T08:52:54.861 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.859+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e44073ef0 con 0x7f0e4415ca80 2023-10-16T08:52:54.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.860+0000 7f0e39ffb640 1 -- 172.21.15.94:0/2672801112 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f0e3c07ab50 con 0x7f0e4415ca80 2023-10-16T08:52:54.862 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:54.863 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1169905348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1169905348},{"type":"v1","addr":"172.21.15.130:6833","nonce":1169905348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3564689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3564689},{"type":"v1","addr":"172.21.15.94:6835","nonce":3564689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/630206311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6836","nonce":630206311},{"type":"v1","addr":"172.21.15.94:6837","nonce":630206311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:51:18.896750+0000","modified":"2023-10-16T08:51:46.124847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3616835354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3616835354},{"type":"v1","addr":"172.21.15.130:6835","nonce":3616835354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T08:52:54.863 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 8 2023-10-16T08:52:54.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.862+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0e2806ae70 msgr2=0x7f0e2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.862+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0e2806ae70 0x7f0e2806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000a730 tx=0x7f0e40008040 comp rx=0 tx=0).stop 2023-10-16T08:52:54.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.862+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 msgr2=0x7f0e440cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:54.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.862+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 0x7f0e440cf8a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009fa0 tx=0x7f0e3c004a40 comp rx=0 tx=0).stop 2023-10-16T08:52:54.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 shutdown_connections 2023-10-16T08:52:54.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e4415ca80 0x7f0e440cf8a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e440c9e70 0x7f0e4415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f0e2806ae70 0x7f0e2806d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 --2- 172.21.15.94:0/2672801112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e4406a4f0 0x7f0e4415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:54.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 >> 172.21.15.94:0/2672801112 conn(0x7f0e440cc0c0 msgr2=0x7f0e440b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:54.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 shutdown_connections 2023-10-16T08:52:54.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:54.863+0000 7f0e4b81a640 1 -- 172.21.15.94:0/2672801112 wait complete. 2023-10-16T08:52:54.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:52:55.097 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.095+0000 7f70f1900640 1 Processor -- start 2023-10-16T08:52:55.098 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.095+0000 7f70f1900640 1 -- start start 2023-10-16T08:52:55.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70f1900640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 0x7f70ec0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.103 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70f1900640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec071e40 con 0x7f70ec071800 2023-10-16T08:52:55.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70f1900640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec072120 con 0x7f70ec0ca1e0 2023-10-16T08:52:55.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70f1900640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec071c30 con 0x7f70ec0c9e00 2023-10-16T08:52:55.104 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70eb7fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f70ec071800 0x7f70ec0cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45894/0 (socket says 172.21.15.94:45894) 2023-10-16T08:52:55.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70eb7fe640 1 -- 172.21.15.94:0/1568430872 learned_addr learned my addr 172.21.15.94:0/1568430872 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:55.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.097+0000 7f70eaffd640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 0x7f70ec0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.105 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613286885 0 0) 0x7f70ec071e40 con 0x7f70ec071800 2023-10-16T08:52:55.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d4003520 con 0x7f70ec071800 2023-10-16T08:52:55.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3095227306 0 0) 0x7f70d4003520 con 0x7f70ec071800 2023-10-16T08:52:55.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 msgr2=0x7f70ec0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:55.106 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 0x7f70ec0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 >> v1:172.21.15.130:6789/0 conn(0x7f70ec0ca1e0 legacy=0x7f70ec0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec072400 con 0x7f70ec071800 2023-10-16T08:52:55.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f70e40019f0 con 0x7f70ec071800 2023-10-16T08:52:55.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 >> v1:172.21.15.94:6789/0 conn(0x7f70ec071800 legacy=0x7f70ec0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.107 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 0x7f70d4003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70d4003f90 0x7f70d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d4004d00 0x7f70d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec071c30 con 0x7f70d4003f90 2023-10-16T08:52:55.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d400bae0 con 0x7f70d4004d00 2023-10-16T08:52:55.108 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d400deb0 con 0x7f70ec0c9e00 2023-10-16T08:52:55.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.098+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70d4003f90 0x7f70d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.099+0000 7f70eaffd640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 0x7f70d4003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.099+0000 7f70ea7fc640 1 -- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 msgr2=0x7f70d4003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:55.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.099+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70ec0c9e00 0x7f70d4003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.109 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.099+0000 7f70ea7fc640 1 -- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d4004d00 msgr2=0x7f70d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:55.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.099+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70d4004d00 0x7f70d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.099+0000 7f70ea7fc640 1 -- 172.21.15.94:0/1568430872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4003520 con 0x7f70d4003f90 2023-10-16T08:52:55.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.100+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70d4003f90 0x7f70d40047c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70e0001750 tx=0x7f70d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d6649d63760928 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:55.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.100+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00052d0 con 0x7f70d4003f90 2023-10-16T08:52:55.110 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.100+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e002e050 con 0x7f70d4003f90 2023-10-16T08:52:55.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.100+0000 7f70e9ffb640 1 -- 172.21.15.94:0/1568430872 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0003830 con 0x7f70d4003f90 2023-10-16T08:52:55.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70f1900640 1 -- 172.21.15.94:0/1568430872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70d4003f90 msgr2=0x7f70d40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70f1900640 1 --2- 172.21.15.94:0/1568430872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70d4003f90 0x7f70d40047c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70e0001750 tx=0x7f70d40057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70eb7fe640 1 -- 172.21.15.94:0/1568430872 reap_dead start 2023-10-16T08:52:55.111 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70f1900640 1 -- 172.21.15.94:0/1568430872 shutdown_connections 2023-10-16T08:52:55.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70f1900640 1 -- 172.21.15.94:0/1568430872 >> 172.21.15.94:0/1568430872 conn(0x7f70ec06c1c0 msgr2=0x7f70ec06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:55.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70f1900640 1 -- 172.21.15.94:0/1568430872 shutdown_connections 2023-10-16T08:52:55.112 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.101+0000 7f70f1900640 1 -- 172.21.15.94:0/1568430872 wait complete. 2023-10-16T08:52:55.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.103+0000 7f70f1900640 1 Processor -- start 2023-10-16T08:52:55.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.103+0000 7f70f1900640 1 -- start start 2023-10-16T08:52:55.115 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70f1900640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70d4003f90 0x7f70ec145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70f1900640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 0x7f70ec0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70f1900640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ec1ef5e0 0x7f70ec0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70f1900640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0ad400 con 0x7f70ec1ef180 2023-10-16T08:52:55.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70f1900640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec145790 con 0x7f70ec1ef5e0 2023-10-16T08:52:55.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70f1900640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0ac360 con 0x7f70d4003f90 2023-10-16T08:52:55.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70ea7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 0x7f70ec0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70ea7fc640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 0x7f70ec0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41904/0 (socket says 172.21.15.94:41904) 2023-10-16T08:52:55.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70ea7fc640 1 -- 172.21.15.94:0/2338523071 learned_addr learned my addr 172.21.15.94:0/2338523071 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:55.117 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.104+0000 7f70eaffd640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70d4003f90 0x7f70ec145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70ea7fc640 1 -- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70d4003f90 msgr2=0x7f70ec145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70d4003f90 0x7f70ec145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70ea7fc640 1 -- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ec1ef5e0 msgr2=0x7f70ec0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.118 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70eb7fe640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ec1ef5e0 0x7f70ec0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ec1ef5e0 0x7f70ec0cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.119 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70ea7fc640 1 -- 172.21.15.94:0/2338523071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0ac640 con 0x7f70ec1ef180 2023-10-16T08:52:55.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70eaffd640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70d4003f90 0x7f70ec145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:55.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70ea7fc640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 0x7f70ec0ccd10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f70e0008fd0 tx=0x7f70e0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:55.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007a30 con 0x7f70ec1ef180 2023-10-16T08:52:55.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e00069e0 con 0x7f70ec1ef180 2023-10-16T08:52:55.120 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0006d50 con 0x7f70ec1ef180 2023-10-16T08:52:55.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec0ac920 con 0x7f70ec1ef180 2023-10-16T08:52:55.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.105+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec0acee0 con 0x7f70ec1ef180 2023-10-16T08:52:55.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.107+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec0ad070 con 0x7f70ec1ef180 2023-10-16T08:52:55.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.107+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70e00035f0 con 0x7f70ec1ef180 2023-10-16T08:52:55.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.109+0000 7f70d3fff640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70d806aea0 0x7f70d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.121 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.109+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70e00ab7c0 con 0x7f70ec1ef180 2023-10-16T08:52:55.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.109+0000 7f70eaffd640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70d806aea0 0x7f70d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.110+0000 7f70eaffd640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70d806aea0 0x7f70d806d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009a00 tx=0x7f70dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:55.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.114+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70e00765d0 con 0x7f70ec1ef180 2023-10-16T08:52:55.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.305+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70ec073ef0 con 0x7f70ec1ef180 2023-10-16T08:52:55.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.307+0000 7f70d3fff640 1 -- 172.21.15.94:0/2338523071 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f70e0079bf0 con 0x7f70ec1ef180 2023-10-16T08:52:55.310 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:52:55.310 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":28,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:52:01.747744+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T08:51:17.366527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T08:51:17.915588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T08:51:21.690272+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:52:55.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70d806aea0 msgr2=0x7f70d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70d806aea0 0x7f70d806d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009a00 tx=0x7f70dc008040 comp rx=0 tx=0).stop 2023-10-16T08:52:55.313 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 msgr2=0x7f70ec0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 0x7f70ec0ccd10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f70e0008fd0 tx=0x7f70e0001120 comp rx=0 tx=0).stop 2023-10-16T08:52:55.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 shutdown_connections 2023-10-16T08:52:55.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70d806aea0 0x7f70d806d360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ec1ef5e0 0x7f70ec0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70ec1ef180 0x7f70ec0ccd10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 --2- 172.21.15.94:0/2338523071 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70d4003f90 0x7f70ec145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.310+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 >> 172.21.15.94:0/2338523071 conn(0x7f70ec06c1c0 msgr2=0x7f70ec0c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:55.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.311+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 shutdown_connections 2023-10-16T08:52:55.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.311+0000 7f70f1900640 1 -- 172.21.15.94:0/2338523071 wait complete. 2023-10-16T08:52:55.333 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T08:52:55.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.548+0000 7f959f7d7640 1 Processor -- start 2023-10-16T08:52:55.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.549+0000 7f959f7d7640 1 -- start start 2023-10-16T08:52:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.550+0000 7f959f7d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 0x7f9598167740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.550+0000 7f959f7d7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95980ccb60 con 0x7f95980cde30 2023-10-16T08:52:55.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.550+0000 7f959f7d7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95980ccd90 con 0x7f959815a540 2023-10-16T08:52:55.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.550+0000 7f959f7d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95980cd070 con 0x7f95980c45b0 2023-10-16T08:52:55.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.550+0000 7f959cd72640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f95980cde30 0x7f95980c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45898/0 (socket says 172.21.15.94:45898) 2023-10-16T08:52:55.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.550+0000 7f959cd72640 1 -- 172.21.15.94:0/3389537496 learned_addr learned my addr 172.21.15.94:0/3389537496 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:55.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657263675 0 0) 0x7f95980ccb60 con 0x7f95980cde30 2023-10-16T08:52:55.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9584003520 con 0x7f95980cde30 2023-10-16T08:52:55.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f959dd74640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 0x7f9598167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 584527829 0 0) 0x7f9584003520 con 0x7f95980cde30 2023-10-16T08:52:55.557 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 msgr2=0x7f9598167740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 0x7f9598167740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 >> v1:172.21.15.130:6789/0 conn(0x7f959815a540 legacy=0x7f959815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95980cd350 con 0x7f95980cde30 2023-10-16T08:52:55.558 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f9588001670 con 0x7f95980cde30 2023-10-16T08:52:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 >> v1:172.21.15.94:6789/0 conn(0x7f95980cde30 legacy=0x7f95980c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95840039a0 0x7f9584003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f9584004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.559 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 0x7f9584005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980cd070 con 0x7f95840047c0 2023-10-16T08:52:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958400bb40 con 0x7f95840039a0 2023-10-16T08:52:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.551+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958400bd00 con 0x7f95980c45b0 2023-10-16T08:52:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959cd72640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f9584004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.560 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959d573640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95840039a0 0x7f9584003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959dd74640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 0x7f9584005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959cd72640 1 -- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 msgr2=0x7f9584005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:55.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959cd72640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95980c45b0 0x7f9584005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.561 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959cd72640 1 -- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95840039a0 msgr2=0x7f9584003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:55.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959cd72640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95840039a0 0x7f9584003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.552+0000 7f959cd72640 1 -- 172.21.15.94:0/3389537496 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584003520 con 0x7f95840047c0 2023-10-16T08:52:55.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.553+0000 7f959cd72640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f9584004c40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f95980709d0 tx=0x7f95840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee399d7fd843cd7f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:55.562 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.553+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588005ad0 con 0x7f95840047c0 2023-10-16T08:52:55.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.553+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588005c30 con 0x7f95840047c0 2023-10-16T08:52:55.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.553+0000 7f958ffff640 1 -- 172.21.15.94:0/3389537496 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958802c7c0 con 0x7f95840047c0 2023-10-16T08:52:55.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959f7d7640 1 -- 172.21.15.94:0/3389537496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 msgr2=0x7f9584004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.563 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3389537496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f9584004c40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f95980709d0 tx=0x7f95840057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959dd74640 1 -- 172.21.15.94:0/3389537496 reap_dead start 2023-10-16T08:52:55.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959f7d7640 1 -- 172.21.15.94:0/3389537496 shutdown_connections 2023-10-16T08:52:55.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959f7d7640 1 -- 172.21.15.94:0/3389537496 >> 172.21.15.94:0/3389537496 conn(0x7f95980cb830 msgr2=0x7f95980cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:55.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959f7d7640 1 -- 172.21.15.94:0/3389537496 shutdown_connections 2023-10-16T08:52:55.564 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.554+0000 7f959f7d7640 1 -- 172.21.15.94:0/3389537496 wait complete. 2023-10-16T08:52:55.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.556+0000 7f959f7d7640 1 Processor -- start 2023-10-16T08:52:55.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.556+0000 7f959f7d7640 1 -- start start 2023-10-16T08:52:55.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959f7d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f95980b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959f7d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9598156d30 0x7f9598155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959f7d7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9598149c20 0x7f9598156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959f7d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598157580 con 0x7f95840047c0 2023-10-16T08:52:55.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959f7d7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980b4910 con 0x7f9598149c20 2023-10-16T08:52:55.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959f7d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95981572a0 con 0x7f9598156d30 2023-10-16T08:52:55.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959d573640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f95980b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959d573640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f95980b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41918/0 (socket says 172.21.15.94:41918) 2023-10-16T08:52:55.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.557+0000 7f959d573640 1 -- 172.21.15.94:0/3104332805 learned_addr learned my addr 172.21.15.94:0/3104332805 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:55.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959dd74640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9598149c20 0x7f9598156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959d573640 1 -- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9598156d30 msgr2=0x7f9598155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959d573640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9598156d30 0x7f9598155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959d573640 1 -- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9598149c20 msgr2=0x7f9598156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959d573640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9598149c20 0x7f9598156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959d573640 1 -- 172.21.15.94:0/3104332805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598155310 con 0x7f95840047c0 2023-10-16T08:52:55.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959d573640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f95980b43d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f959400e8c0 tx=0x7f959400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:55.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594003b80 con 0x7f95840047c0 2023-10-16T08:52:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594003ce0 con 0x7f95840047c0 2023-10-16T08:52:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95981555f0 con 0x7f95840047c0 2023-10-16T08:52:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940052f0 con 0x7f95840047c0 2023-10-16T08:52:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.558+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9598154e20 con 0x7f95840047c0 2023-10-16T08:52:55.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.559+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598154fb0 con 0x7f95840047c0 2023-10-16T08:52:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.560+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9594005450 con 0x7f95840047c0 2023-10-16T08:52:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.561+0000 7f958dffb640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f957c06ae70 0x7f957c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.561+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9594089b70 con 0x7f95840047c0 2023-10-16T08:52:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.561+0000 7f959cd72640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f957c06ae70 0x7f957c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:55.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.562+0000 7f959cd72640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f957c06ae70 0x7f957c06d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9588034000 tx=0x7f9588007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:55.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.566+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9598154fb0 con 0x7f95840047c0 2023-10-16T08:52:55.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.792+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9598155170 con 0x7f95840047c0 2023-10-16T08:52:55.795 INFO:tasks.ceph.mon.a.smithi094.stderr:2023-10-16T08:52:55.793+0000 7fbd41f36640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T08:52:55.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.797+0000 7f958dffb640 1 -- 172.21.15.94:0/3104332805 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9598155170 con 0x7f95840047c0 2023-10-16T08:52:55.799 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T08:52:55.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.800+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f957c06ae70 msgr2=0x7f957c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.800+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f957c06ae70 0x7f957c06d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9588034000 tx=0x7f9588007000 comp rx=0 tx=0).stop 2023-10-16T08:52:55.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.800+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 msgr2=0x7f95980b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:55.803 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.800+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f95980b43d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f959400e8c0 tx=0x7f959400ed80 comp rx=0 tx=0).stop 2023-10-16T08:52:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 shutdown_connections 2023-10-16T08:52:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f957c06ae70 0x7f957c06d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9598149c20 0x7f9598156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9598156d30 0x7f9598155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 --2- 172.21.15.94:0/3104332805 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95840047c0 0x7f95980b43d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:55.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 >> 172.21.15.94:0/3104332805 conn(0x7f95980cb830 msgr2=0x7f9598070920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:55.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 shutdown_connections 2023-10-16T08:52:55.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:55.801+0000 7f959f7d7640 1 -- 172.21.15.94:0/3104332805 wait complete. 2023-10-16T08:52:55.821 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T08:52:55.833 INFO:tasks.ceph.mds.d.smithi130.stderr: -5406> 2023-10-16T08:51:20.407+0000 7f71f4ec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T08:52:55.929 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2023-10-16T08:52:56.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.029+0000 7f510fe7c640 1 Processor -- start 2023-10-16T08:52:56.031 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.029+0000 7f510fe7c640 1 -- start start 2023-10-16T08:52:56.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.030+0000 7f510fe7c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5108159890 0x7f5108071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.030+0000 7f510fe7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51080ca110 0x7f51080ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.032 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.030+0000 7f510fe7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f510815d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.030+0000 7f510fe7c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080caae0 con 0x7f5108159890 2023-10-16T08:52:56.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.030+0000 7f510fe7c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5108072480 con 0x7f51080ca110 2023-10-16T08:52:56.033 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.030+0000 7f510fe7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080cd0c0 con 0x7f510815d3f0 2023-10-16T08:52:56.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5108159890 0x7f5108071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:56.034 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5108159890 0x7f5108071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41926/0 (socket says 172.21.15.94:41926) 2023-10-16T08:52:56.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 -- 172.21.15.94:0/2090230825 learned_addr learned my addr 172.21.15.94:0/2090230825 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:56.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 -- 172.21.15.94:0/2090230825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 msgr2=0x7f510815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:56.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 --2- 172.21.15.94:0/2090230825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f510815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 -- 172.21.15.94:0/2090230825 >> v2:172.21.15.130:3300/0 conn(0x7f51080ca110 msgr2=0x7f51080ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:56.035 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 --2- 172.21.15.94:0/2090230825 >> v2:172.21.15.130:3300/0 conn(0x7f51080ca110 0x7f51080ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.031+0000 7f510dc18640 1 -- 172.21.15.94:0/2090230825 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080cc540 con 0x7f5108159890 2023-10-16T08:52:56.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.032+0000 7f510dc18640 1 --2- 172.21.15.94:0/2090230825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f5108071f40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f51080b0fd0 tx=0x7f50f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f05f4c624694e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:56.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.032+0000 7f510cc16640 1 -- 172.21.15.94:0/2090230825 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8031870 con 0x7f5108159890 2023-10-16T08:52:56.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.032+0000 7f510cc16640 1 -- 172.21.15.94:0/2090230825 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f80319d0 con 0x7f5108159890 2023-10-16T08:52:56.036 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.032+0000 7f510cc16640 1 -- 172.21.15.94:0/2090230825 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8031d60 con 0x7f5108159890 2023-10-16T08:52:56.037 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 -- 172.21.15.94:0/2090230825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 msgr2=0x7f5108071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:56.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 --2- 172.21.15.94:0/2090230825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f5108071f40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f51080b0fd0 tx=0x7f50f802b910 comp rx=0 tx=0).stop 2023-10-16T08:52:56.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 -- 172.21.15.94:0/2090230825 shutdown_connections 2023-10-16T08:52:56.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 --2- 172.21.15.94:0/2090230825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f510815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.038 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 --2- 172.21.15.94:0/2090230825 >> v2:172.21.15.130:3300/0 conn(0x7f51080ca110 0x7f51080ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 --2- 172.21.15.94:0/2090230825 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f5108071f40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 -- 172.21.15.94:0/2090230825 >> 172.21.15.94:0/2090230825 conn(0x7f51080b0030 msgr2=0x7f51080b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 -- 172.21.15.94:0/2090230825 shutdown_connections 2023-10-16T08:52:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.033+0000 7f510fe7c640 1 -- 172.21.15.94:0/2090230825 wait complete. 2023-10-16T08:52:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.035+0000 7f510fe7c640 1 Processor -- start 2023-10-16T08:52:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.036+0000 7f510fe7c640 1 -- start start 2023-10-16T08:52:56.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.036+0000 7f510fe7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080ca110 0x7f51080c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510fe7c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f51081f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510fe7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f51080c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.042 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510fe7c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51081f3630 con 0x7f5108159890 2023-10-16T08:52:56.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510fe7c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51081f6020 con 0x7f51080ca110 2023-10-16T08:52:56.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510fe7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51081f6300 con 0x7f510815d3f0 2023-10-16T08:52:56.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f51081f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:56.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f51081f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41940/0 (socket says 172.21.15.94:41940) 2023-10-16T08:52:56.043 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 -- 172.21.15.94:0/3071034536 learned_addr learned my addr 172.21.15.94:0/3071034536 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:56.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510dc18640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080ca110 0x7f51080c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:56.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 -- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 msgr2=0x7f51080c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:56.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510e419640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f51080c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:56.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f51080c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.044 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 -- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080ca110 msgr2=0x7f51080c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:56.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080ca110 0x7f51080c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510d417640 1 -- 172.21.15.94:0/3071034536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80094d0 con 0x7f5108159890 2023-10-16T08:52:56.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.037+0000 7f510dc18640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080ca110 0x7f51080c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:56.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.038+0000 7f510d417640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f51081f30f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b410 tx=0x7f50fc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:56.045 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.038+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011830 con 0x7f5108159890 2023-10-16T08:52:56.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.038+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0119b0 con 0x7f5108159890 2023-10-16T08:52:56.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.038+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51081f65e0 con 0x7f5108159890 2023-10-16T08:52:56.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.038+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011d60 con 0x7f5108159890 2023-10-16T08:52:56.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.038+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51080c82b0 con 0x7f5108159890 2023-10-16T08:52:56.046 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.039+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5108073ef0 con 0x7f5108159890 2023-10-16T08:52:56.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.040+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f50fc01a400 con 0x7f5108159890 2023-10-16T08:52:56.047 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.041+0000 7f51067fc640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50f406aea0 0x7f50f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:56.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.041+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f50fc089b00 con 0x7f5108159890 2023-10-16T08:52:56.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.041+0000 7f510dc18640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50f406aea0 0x7f50f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:56.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.042+0000 7f510dc18640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50f406aea0 0x7f50f406d360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50f8036000 tx=0x7f50f803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:56.048 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.045+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50fc0547a0 con 0x7f5108159890 2023-10-16T08:52:56.274 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.272+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51080cd290 con 0x7f5108159890 2023-10-16T08:52:56.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.807+0000 7f51067fc640 1 -- 172.21.15.94:0/3071034536 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f50fc0150a0 con 0x7f5108159890 2023-10-16T08:52:56.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.810+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50f406aea0 msgr2=0x7f50f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:56.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.810+0000 7f510fe7c640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50f406aea0 0x7f50f406d360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50f8036000 tx=0x7f50f803c040 comp rx=0 tx=0).stop 2023-10-16T08:52:56.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.810+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 msgr2=0x7f51081f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:56.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.810+0000 7f510fe7c640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f51081f30f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b410 tx=0x7f50fc00b8d0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 shutdown_connections 2023-10-16T08:52:56.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f510815d3f0 0x7f51080c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5108159890 0x7f51081f30f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f50f406aea0 0x7f50f406d360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 --2- 172.21.15.94:0/3071034536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51080ca110 0x7f51080c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 >> 172.21.15.94:0/3071034536 conn(0x7f51080b0030 msgr2=0x7f51080accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 shutdown_connections 2023-10-16T08:52:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:56.811+0000 7f510fe7c640 1 -- 172.21.15.94:0/3071034536 wait complete. 2023-10-16T08:52:56.834 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T08:52:57.051 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.049+0000 7fcb01246640 1 Processor -- start 2023-10-16T08:52:57.052 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.050+0000 7fcb01246640 1 -- start start 2023-10-16T08:52:57.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.051+0000 7fcb01246640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 0x7fcafc0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.053 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.051+0000 7fcb01246640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcafc15ab30 0x7fcafc0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.051+0000 7fcb01246640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc0b0870 con 0x7fcafc15e440 2023-10-16T08:52:57.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.051+0000 7fcb01246640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc0c9660 con 0x7fcafc15ab30 2023-10-16T08:52:57.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.051+0000 7fcb01246640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc15ee20 con 0x7fcafc0aff50 2023-10-16T08:52:57.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.051+0000 7fcafb59e640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcafc15e440 0x7fcafc0b1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45902/0 (socket says 172.21.15.94:45902) 2023-10-16T08:52:57.054 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcafb59e640 1 -- 172.21.15.94:0/408155010 learned_addr learned my addr 172.21.15.94:0/408155010 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcafad9d640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 0x7fcafc0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcafa59c640 1 --2- 172.21.15.94:0/408155010 >> v2:172.21.15.130:3300/0 conn(0x7fcafc15ab30 0x7fcafc0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233453717 0 0) 0x7fcafc0b0870 con 0x7fcafc15e440 2023-10-16T08:52:57.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae8003520 con 0x7fcafc15e440 2023-10-16T08:52:57.058 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594128824 0 0) 0x7fcae8003520 con 0x7fcafc15e440 2023-10-16T08:52:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 msgr2=0x7fcafc0b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 0x7fcafc0b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 >> v2:172.21.15.130:3300/0 conn(0x7fcafc15ab30 msgr2=0x7fcafc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 --2- 172.21.15.94:0/408155010 >> v2:172.21.15.130:3300/0 conn(0x7fcafc15ab30 0x7fcafc0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc15f100 con 0x7fcafc15e440 2023-10-16T08:52:57.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fcaf4001670 con 0x7fcafc15e440 2023-10-16T08:52:57.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.052+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 >> v1:172.21.15.94:6789/0 conn(0x7fcafc15e440 legacy=0x7fcafc0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:57.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcaf9d9b640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 0x7fcae80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcaf9d9b640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcae80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.060 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcaf9d9b640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcae8004d00 0x7fcae8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0c9660 con 0x7fcae8003f60 2023-10-16T08:52:57.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc15ee20 con 0x7fcae8004d00 2023-10-16T08:52:57.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae800ba60 con 0x7fcafc0aff50 2023-10-16T08:52:57.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafa59c640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcae80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.061 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafad9d640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 0x7fcae80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafa59c640 1 -- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 msgr2=0x7fcae80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafa59c640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0aff50 0x7fcae80039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafa59c640 1 -- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcae8004d00 msgr2=0x7fcae8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafa59c640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcae8004d00 0x7fcae8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.053+0000 7fcafa59c640 1 -- 172.21.15.94:0/408155010 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8003520 con 0x7fcae8003f60 2023-10-16T08:52:57.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.054+0000 7fcafa59c640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcae80047c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcae400ba00 tx=0x7fcae80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b152ed36315df6b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:57.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4032640 con 0x7fcae8003f60 2023-10-16T08:52:57.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae40327a0 con 0x7fcae8003f60 2023-10-16T08:52:57.063 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcaf9d9b640 1 -- 172.21.15.94:0/408155010 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4032b30 con 0x7fcae8003f60 2023-10-16T08:52:57.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcb01246640 1 -- 172.21.15.94:0/408155010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 msgr2=0x7fcae80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:57.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcb01246640 1 --2- 172.21.15.94:0/408155010 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcae80047c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcae400ba00 tx=0x7fcae80057f0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcafb59e640 1 -- 172.21.15.94:0/408155010 reap_dead start 2023-10-16T08:52:57.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcb01246640 1 -- 172.21.15.94:0/408155010 shutdown_connections 2023-10-16T08:52:57.064 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcb01246640 1 -- 172.21.15.94:0/408155010 >> 172.21.15.94:0/408155010 conn(0x7fcafc06c190 msgr2=0x7fcafc06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcb01246640 1 -- 172.21.15.94:0/408155010 shutdown_connections 2023-10-16T08:52:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.055+0000 7fcb01246640 1 -- 172.21.15.94:0/408155010 wait complete. 2023-10-16T08:52:57.067 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.057+0000 7fcb01246640 1 Processor -- start 2023-10-16T08:52:57.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.057+0000 7fcb01246640 1 -- start start 2023-10-16T08:52:57.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcb01246640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcafc1ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcb01246640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0b0f80 0x7fcafc0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcb01246640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc0b1400 0x7fcafc0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.068 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcb01246640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc1f3240 con 0x7fcae8003f60 2023-10-16T08:52:57.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcb01246640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc1f2320 con 0x7fcafc0b1400 2023-10-16T08:52:57.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcb01246640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0cc5e0 con 0x7fcafc0b0f80 2023-10-16T08:52:57.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.058+0000 7fcafad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcafc1ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.069 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcafc1ef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41964/0 (socket says 172.21.15.94:41964) 2023-10-16T08:52:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 -- 172.21.15.94:0/2176899506 learned_addr learned my addr 172.21.15.94:0/2176899506 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafb59e640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc0b1400 0x7fcafc0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafa59c640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0b0f80 0x7fcafc0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 -- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0b0f80 msgr2=0x7fcafc0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0b0f80 0x7fcafc0b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 -- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc0b1400 msgr2=0x7fcafc0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc0b1400 0x7fcafc0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 -- 172.21.15.94:0/2176899506 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc1f25c0 con 0x7fcae8003f60 2023-10-16T08:52:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcafad9d640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcafc1ef770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00f350 tx=0x7fcaec00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec017600 con 0x7fcae8003f60 2023-10-16T08:52:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec011040 con 0x7fcae8003f60 2023-10-16T08:52:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec0179c0 con 0x7fcae8003f60 2023-10-16T08:52:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.059+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc1f28a0 con 0x7fcae8003f60 2023-10-16T08:52:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.060+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc1f2e60 con 0x7fcae8003f60 2023-10-16T08:52:57.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.061+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcafc1f3020 con 0x7fcae8003f60 2023-10-16T08:52:57.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.062+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcaec017b20 con 0x7fcae8003f60 2023-10-16T08:52:57.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.063+0000 7fcaf37fe640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcadc06ae70 0x7fcadc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:57.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.063+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcaec08a0b0 con 0x7fcae8003f60 2023-10-16T08:52:57.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.063+0000 7fcafa59c640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcadc06ae70 0x7fcadc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:57.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.064+0000 7fcafa59c640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcadc06ae70 0x7fcadc06d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcafc15af10 tx=0x7fcae403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.068+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaec054e10 con 0x7fcae8003f60 2023-10-16T08:52:57.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:57.259+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcafc073ef0 con 0x7fcae8003f60 2023-10-16T08:52:58.142 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.140+0000 7fcaf37fe640 1 -- 172.21.15.94:0/2176899506 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcaec01c0d0 con 0x7fcae8003f60 2023-10-16T08:52:58.142 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2023-10-16T08:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.144+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcadc06ae70 msgr2=0x7fcadc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.144+0000 7fcb01246640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcadc06ae70 0x7fcadc06d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcafc15af10 tx=0x7fcae403d040 comp rx=0 tx=0).stop 2023-10-16T08:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.144+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 msgr2=0x7fcafc1ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:58.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.144+0000 7fcb01246640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcafc1ef770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00f350 tx=0x7fcaec00f810 comp rx=0 tx=0).stop 2023-10-16T08:52:58.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.145+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 shutdown_connections 2023-10-16T08:52:58.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.145+0000 7fcb01246640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fcadc06ae70 0x7fcadc06d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.145+0000 7fcb01246640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcafc0b1400 0x7fcafc0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.145+0000 7fcb01246640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcafc0b0f80 0x7fcafc0b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.145+0000 7fcb01246640 1 --2- 172.21.15.94:0/2176899506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae8003f60 0x7fcafc1ef770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.148 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.145+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 >> 172.21.15.94:0/2176899506 conn(0x7fcafc06c190 msgr2=0x7fcafc0c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:58.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.146+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 shutdown_connections 2023-10-16T08:52:58.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.146+0000 7fcb01246640 1 -- 172.21.15.94:0/2176899506 wait complete. 2023-10-16T08:52:58.173 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T08:52:58.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.374+0000 7f5ec365d640 1 Processor -- start 2023-10-16T08:52:58.376 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.374+0000 7f5ec365d640 1 -- start start 2023-10-16T08:52:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.376+0000 7f5ec365d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 0x7f5ebc0b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.376+0000 7f5ec365d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ebc1605d0 0x7f5ebc0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.376+0000 7f5ec365d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc160a60 con 0x7f5ebc0cdb10 2023-10-16T08:52:58.378 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.376+0000 7f5ec365d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0cdf80 con 0x7f5ebc1605d0 2023-10-16T08:52:58.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.376+0000 7f5ec365d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc160d40 con 0x7f5ebc15ca80 2023-10-16T08:52:58.379 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.377+0000 7f5ec0bf8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5ebc1605d0 0x7f5ebc0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.377+0000 7f5ec13f9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 0x7f5ebc0b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.377+0000 7f5ec13f9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 0x7f5ebc0b8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:37416/0 (socket says 172.21.15.94:37416) 2023-10-16T08:52:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.377+0000 7f5ec13f9640 1 -- 172.21.15.94:0/2695150321 learned_addr learned my addr 172.21.15.94:0/2695150321 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.378+0000 7f5ec0bf8640 1 -- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 msgr2=0x7f5ebc0b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:58.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.378+0000 7f5ec0bf8640 1 --2- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 0x7f5ebc0b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.378+0000 7f5ec0bf8640 1 -- 172.21.15.94:0/2695150321 >> v1:172.21.15.130:6789/0 conn(0x7f5ebc0cdb10 legacy=0x7f5ebc0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.378+0000 7f5ec0bf8640 1 -- 172.21.15.94:0/2695150321 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc161020 con 0x7f5ebc1605d0 2023-10-16T08:52:58.381 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.378+0000 7f5ec13f9640 1 --2- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 0x7f5ebc0b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:52:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.379+0000 7f5ec0bf8640 1 --2- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc1605d0 0x7f5ebc0cd5d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0097a0 tx=0x7f5eac02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587f685cc73d2342 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:58.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5eb3fff640 1 -- 172.21.15.94:0/2695150321 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac02d040 con 0x7f5ebc1605d0 2023-10-16T08:52:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5eb3fff640 1 -- 172.21.15.94:0/2695150321 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac031810 con 0x7f5ebc1605d0 2023-10-16T08:52:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5eb3fff640 1 -- 172.21.15.94:0/2695150321 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac031ba0 con 0x7f5ebc1605d0 2023-10-16T08:52:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 -- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc1605d0 msgr2=0x7f5ebc0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc1605d0 0x7f5ebc0cd5d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0097a0 tx=0x7f5eac02b8b0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 -- 172.21.15.94:0/2695150321 shutdown_connections 2023-10-16T08:52:58.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc1605d0 0x7f5ebc0cd5d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2695150321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc15ca80 0x7f5ebc0b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 -- 172.21.15.94:0/2695150321 >> 172.21.15.94:0/2695150321 conn(0x7f5ebc06afe0 msgr2=0x7f5ebc06b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:58.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 -- 172.21.15.94:0/2695150321 shutdown_connections 2023-10-16T08:52:58.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.380+0000 7f5ec365d640 1 -- 172.21.15.94:0/2695150321 wait complete. 2023-10-16T08:52:58.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.382+0000 7f5ec365d640 1 Processor -- start 2023-10-16T08:52:58.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.382+0000 7f5ec365d640 1 -- start start 2023-10-16T08:52:58.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.383+0000 7f5ec365d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc0cdb10 0x7f5ebc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:58.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.383+0000 7f5ec365d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc15ca80 0x7f5ebc0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:58.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.383+0000 7f5ec365d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 0x7f5ebc14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.383+0000 7f5ec365d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0c7fd0 con 0x7f5ebc0c6310 2023-10-16T08:52:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.383+0000 7f5ec365d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0c82b0 con 0x7f5ebc15ca80 2023-10-16T08:52:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.383+0000 7f5ec365d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0c8590 con 0x7f5ebc0cdb10 2023-10-16T08:52:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 0x7f5ebc14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:58.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 0x7f5ebc14d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41980/0 (socket says 172.21.15.94:41980) 2023-10-16T08:52:58.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 -- 172.21.15.94:0/2496410605 learned_addr learned my addr 172.21.15.94:0/2496410605 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:58.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec13f9640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc0cdb10 0x7f5ebc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:58.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec0bf8640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc15ca80 0x7f5ebc0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:58.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 -- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc0cdb10 msgr2=0x7f5ebc0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:58.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc0cdb10 0x7f5ebc0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 -- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc15ca80 msgr2=0x7f5ebc0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:58.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc15ca80 0x7f5ebc0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:58.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 -- 172.21.15.94:0/2496410605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80094d0 con 0x7f5ebc0c6310 2023-10-16T08:52:58.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec13f9640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc0cdb10 0x7f5ebc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:58.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec0bf8640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc15ca80 0x7f5ebc0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:52:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.384+0000 7f5ec1bfa640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 0x7f5ebc14d1b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400c7a0 tx=0x7f5eb400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.385+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4003b70 con 0x7f5ebc0c6310 2023-10-16T08:52:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.385+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4003cf0 con 0x7f5ebc0c6310 2023-10-16T08:52:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.385+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4003ea0 con 0x7f5ebc0c6310 2023-10-16T08:52:58.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.385+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac009400 con 0x7f5ebc0c6310 2023-10-16T08:52:58.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.385+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc0c8b50 con 0x7f5ebc0c6310 2023-10-16T08:52:58.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.386+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc0b8720 con 0x7f5ebc0c6310 2023-10-16T08:52:58.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.387+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5eb400aa90 con 0x7f5ebc0c6310 2023-10-16T08:52:58.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.388+0000 7f5eb1ffb640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ea006ae70 0x7f5ea006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:58.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.389+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f5eb40896e0 con 0x7f5ebc0c6310 2023-10-16T08:52:58.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.389+0000 7f5ec13f9640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ea006ae70 0x7f5ea006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:58.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.390+0000 7f5ec13f9640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ea006ae70 0x7f5ea006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009db0 tx=0x7f5eb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:58.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.393+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5eb4054520 con 0x7f5ebc0c6310 2023-10-16T08:52:58.588 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:58.586+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ebc067180 con 0x7f5ebc0c6310 2023-10-16T08:52:59.145 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.143+0000 7f5eb1ffb640 1 -- 172.21.15.94:0/2496410605 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5eb4057b40 con 0x7f5ebc0c6310 2023-10-16T08:52:59.146 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2023-10-16T08:52:59.149 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.147+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ea006ae70 msgr2=0x7f5ea006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.147+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ea006ae70 0x7f5ea006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009db0 tx=0x7f5eb8008040 comp rx=0 tx=0).stop 2023-10-16T08:52:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.147+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 msgr2=0x7f5ebc14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.147+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 0x7f5ebc14d1b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400c7a0 tx=0x7f5eb400cc60 comp rx=0 tx=0).stop 2023-10-16T08:52:59.150 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 shutdown_connections 2023-10-16T08:52:59.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ebc0c6310 0x7f5ebc14d1b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f5ea006ae70 0x7f5ea006d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ebc15ca80 0x7f5ebc0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 --2- 172.21.15.94:0/2496410605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ebc0cdb10 0x7f5ebc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 >> 172.21.15.94:0/2496410605 conn(0x7f5ebc06afe0 msgr2=0x7f5ebc0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:59.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 shutdown_connections 2023-10-16T08:52:59.152 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.148+0000 7f5ec365d640 1 -- 172.21.15.94:0/2496410605 wait complete. 2023-10-16T08:52:59.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-16T08:52:59.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.382+0000 7f0988fae640 1 Processor -- start 2023-10-16T08:52:59.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.382+0000 7f0988fae640 1 -- start start 2023-10-16T08:52:59.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.383+0000 7f0988fae640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098415e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:59.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.383+0000 7f0988fae640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f09840c8930 0x7f09840707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:59.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.383+0000 7f0988fae640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09840c8e40 con 0x7f0984070400 2023-10-16T08:52:59.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.383+0000 7f0988fae640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840c9090 con 0x7f09840c8930 2023-10-16T08:52:59.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.383+0000 7f0988fae640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c9370 con 0x7f09840cb400 2023-10-16T08:52:59.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f09837fe640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0984070400 0x7f09840cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45904/0 (socket says 172.21.15.94:45904) 2023-10-16T08:52:59.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f09837fe640 1 -- 172.21.15.94:0/2299026214 learned_addr learned my addr 172.21.15.94:0/2299026214 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:52:59.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0983fff640 1 --2- 172.21.15.94:0/2299026214 >> v2:172.21.15.94:3300/0 conn(0x7f09840c8930 0x7f09840707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:59.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0982ffd640 1 -- 172.21.15.94:0/2299026214 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150306577 0 0) 0x7f09840c8e40 con 0x7f0984070400 2023-10-16T08:52:59.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0982ffd640 1 -- 172.21.15.94:0/2299026214 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0970003520 con 0x7f0984070400 2023-10-16T08:52:59.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f097bfff640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:59.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0983fff640 1 -- 172.21.15.94:0/2299026214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 msgr2=0x7f098415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:52:59.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0983fff640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0983fff640 1 -- 172.21.15.94:0/2299026214 >> v1:172.21.15.94:6789/0 conn(0x7f0984070400 legacy=0x7f09840cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:59.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f0983fff640 1 -- 172.21.15.94:0/2299026214 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840c9650 con 0x7f09840c8930 2023-10-16T08:52:59.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.384+0000 7f097bfff640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:52:59.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.386+0000 7f0983fff640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09840c8930 0x7f09840707e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad91f52ddcbeac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:59.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.386+0000 7f0982ffd640 1 -- 172.21.15.94:0/2299026214 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c02cc50 con 0x7f09840c8930 2023-10-16T08:52:59.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.386+0000 7f0982ffd640 1 -- 172.21.15.94:0/2299026214 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c02cdb0 con 0x7f09840c8930 2023-10-16T08:52:59.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.386+0000 7f0982ffd640 1 -- 172.21.15.94:0/2299026214 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c034660 con 0x7f09840c8930 2023-10-16T08:52:59.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 -- 172.21.15.94:0/2299026214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09840c8930 msgr2=0x7f09840707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:59.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09840c8930 0x7f09840707e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c02bea0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 -- 172.21.15.94:0/2299026214 shutdown_connections 2023-10-16T08:52:59.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09840c8930 0x7f09840707e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 --2- 172.21.15.94:0/2299026214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 -- 172.21.15.94:0/2299026214 >> 172.21.15.94:0/2299026214 conn(0x7f098406a470 msgr2=0x7f09840afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:52:59.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 -- 172.21.15.94:0/2299026214 shutdown_connections 2023-10-16T08:52:59.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.387+0000 7f0988fae640 1 -- 172.21.15.94:0/2299026214 wait complete. 2023-10-16T08:52:59.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.389+0000 7f0988fae640 1 Processor -- start 2023-10-16T08:52:59.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.389+0000 7f0988fae640 1 -- start start 2023-10-16T08:52:59.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f0988fae640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 0x7f09841461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:59.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f0988fae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09840c8930 0x7f098414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:59.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f0988fae640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:59.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f0988fae640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c4ce0 con 0x7f0984070400 2023-10-16T08:52:59.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f0988fae640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c5e40 con 0x7f09840c8930 2023-10-16T08:52:59.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f0988fae640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c5550 con 0x7f09840cb400 2023-10-16T08:52:59.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 0x7f09841461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:59.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 0x7f09841461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:41986/0 (socket says 172.21.15.94:41986) 2023-10-16T08:52:59.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 -- 172.21.15.94:0/1782878672 learned_addr learned my addr 172.21.15.94:0/1782878672 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:52:59.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 -- 172.21.15.94:0/1782878672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 msgr2=0x7f098414bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:59.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 -- 172.21.15.94:0/1782878672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09840c8930 msgr2=0x7f098414b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:52:59.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09840c8930 0x7f098414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:52:59.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.390+0000 7f09837fe640 1 -- 172.21.15.94:0/1782878672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009a70 con 0x7f0984070400 2023-10-16T08:52:59.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.391+0000 7f09837fe640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 0x7f09841461d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f097400c500 tx=0x7f097400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:59.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.391+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974005ce0 con 0x7f0984070400 2023-10-16T08:52:59.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.391+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974005e40 con 0x7f0984070400 2023-10-16T08:52:59.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.391+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974007330 con 0x7f0984070400 2023-10-16T08:52:59.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.391+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09840c57f0 con 0x7f0984070400 2023-10-16T08:52:59.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.391+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0984146710 con 0x7f0984070400 2023-10-16T08:52:59.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.392+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098404e9b0 con 0x7f0984070400 2023-10-16T08:52:59.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.393+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0974007490 con 0x7f0984070400 2023-10-16T08:52:59.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.394+0000 7f0980ff9640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f096406ae70 0x7f096406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:52:59.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.394+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f0974088ce0 con 0x7f0984070400 2023-10-16T08:52:59.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.394+0000 7f097bfff640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f096406ae70 0x7f096406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:52:59.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.395+0000 7f097bfff640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f096406ae70 0x7f096406d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f096c006fd0 tx=0x7f096c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:52:59.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.398+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0974053d30 con 0x7f0984070400 2023-10-16T08:52:59.592 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:52:59.590+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0984071360 con 0x7f0984070400 2023-10-16T08:53:00.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.166+0000 7f0980ff9640 1 -- 172.21.15.94:0/1782878672 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f0974017020 con 0x7f0984070400 2023-10-16T08:53:00.169 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data_ec' removed 2023-10-16T08:53:00.172 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.170+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f096406ae70 msgr2=0x7f096406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.170+0000 7f0988fae640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f096406ae70 0x7f096406d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f096c006fd0 tx=0x7f096c008040 comp rx=0 tx=0).stop 2023-10-16T08:53:00.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.170+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 msgr2=0x7f09841461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.170+0000 7f0988fae640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 0x7f09841461d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f097400c500 tx=0x7f097400c9c0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.172+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 shutdown_connections 2023-10-16T08:53:00.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.172+0000 7f0988fae640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09840cb400 0x7f098414bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.172+0000 7f0988fae640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f096406ae70 0x7f096406d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.172+0000 7f0988fae640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09840c8930 0x7f098414b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.172+0000 7f0988fae640 1 --2- 172.21.15.94:0/1782878672 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0984070400 0x7f09841461d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.172+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 >> 172.21.15.94:0/1782878672 conn(0x7f098406a470 msgr2=0x7f09840cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:00.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.173+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 shutdown_connections 2023-10-16T08:53:00.176 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.174+0000 7f0988fae640 1 -- 172.21.15.94:0/1782878672 wait complete. 2023-10-16T08:53:00.215 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T08:53:00.216 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T08:53:00.216 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T08:53:00.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:53:00.217 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T08:53:00.217 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T08:53:00.217 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T08:53:00.217 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:53:00.218 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T08:53:00.218 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T08:53:00.218 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T08:53:00.219 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:53:00.219 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T08:53:00.219 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T08:53:00.220 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T08:53:00.220 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T08:53:00.235 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T08:53:00.236 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T08:53:00.238 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T08:53:00.238 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T08:53:00.241 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T08:53:00.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T08:53:00.242 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T08:53:00.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T08:53:00.284 INFO:tasks.ceph.mds.a:Started 2023-10-16T08:53:00.285 DEBUG:teuthology.parallel:result is None 2023-10-16T08:53:00.288 INFO:tasks.ceph.mds.b:Started 2023-10-16T08:53:00.288 DEBUG:teuthology.parallel:result is None 2023-10-16T08:53:00.289 INFO:tasks.ceph.mds.c:Started 2023-10-16T08:53:00.290 DEBUG:teuthology.parallel:result is None 2023-10-16T08:53:00.292 INFO:tasks.ceph.mds.d:Started 2023-10-16T08:53:00.293 DEBUG:teuthology.parallel:result is None 2023-10-16T08:53:00.293 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T08:53:00.437 INFO:tasks.ceph.mds.c.smithi094.stdout:starting mds.c at 2023-10-16T08:53:00.439 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2023-10-16T08:53:00.442 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2023-10-16T08:53:00.443 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-16T08:53:00.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.481+0000 7f789ba09640 1 Processor -- start 2023-10-16T08:53:00.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.481+0000 7f789ba09640 1 -- start start 2023-10-16T08:53:00.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.482+0000 7f789ba09640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f78940b08c0 0x7f78940c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.482+0000 7f789ba09640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789406cbf0 con 0x7f789406c760 2023-10-16T08:53:00.484 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.482+0000 7f789ba09640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789415ae40 con 0x7f789415aa60 2023-10-16T08:53:00.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.482+0000 7f789ba09640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940b1580 con 0x7f78940b08c0 2023-10-16T08:53:00.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f7899fa6640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f789406c760 0x7f78940b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45922/0 (socket says 172.21.15.94:45922) 2023-10-16T08:53:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f7899fa6640 1 -- 172.21.15.94:0/1770491649 learned_addr learned my addr 172.21.15.94:0/1770491649 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f7898fa4640 1 --2- 172.21.15.94:0/1770491649 >> v2:172.21.15.130:3300/0 conn(0x7f78940b08c0 0x7f78940c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356779493 0 0) 0x7f789406cbf0 con 0x7f789406c760 2023-10-16T08:53:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7880003520 con 0x7f789406c760 2023-10-16T08:53:00.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953319022 0 0) 0x7f789415ae40 con 0x7f789415aa60 2023-10-16T08:53:00.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f789406cbf0 con 0x7f789415aa60 2023-10-16T08:53:00.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202756816 0 0) 0x7f7880003520 con 0x7f789406c760 2023-10-16T08:53:00.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 >> v2:172.21.15.130:3300/0 conn(0x7f78940b08c0 msgr2=0x7f78940c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:00.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 --2- 172.21.15.94:0/1770491649 >> v2:172.21.15.130:3300/0 conn(0x7f78940b08c0 0x7f78940c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.483+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 >> v1:172.21.15.130:6789/0 conn(0x7f789415aa60 legacy=0x7f78940b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940c98f0 con 0x7f789406c760 2023-10-16T08:53:00.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f788c0019f0 con 0x7f789406c760 2023-10-16T08:53:00.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 >> v1:172.21.15.94:6789/0 conn(0x7f789406c760 legacy=0x7f78940b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7880003b50 0x7f7880003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78800047c0 0x7f7880004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78800051d0 0x7f788000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940b1580 con 0x7f78800051d0 2023-10-16T08:53:00.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788000c100 con 0x7f7880003b50 2023-10-16T08:53:00.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788000c2c0 con 0x7f78800047c0 2023-10-16T08:53:00.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f7899fa6640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78800051d0 0x7f788000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f78997a5640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7880003b50 0x7f7880003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f7898fa4640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78800047c0 0x7f7880004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f7899fa6640 1 -- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78800047c0 msgr2=0x7f7880004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:00.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f7899fa6640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78800047c0 0x7f7880004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.484+0000 7f7899fa6640 1 -- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7880003b50 msgr2=0x7f7880003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:00.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.485+0000 7f7899fa6640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7880003b50 0x7f7880003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.485+0000 7f7899fa6640 1 -- 172.21.15.94:0/1770491649 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880003520 con 0x7f78800051d0 2023-10-16T08:53:00.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.485+0000 7f78997a5640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7880003b50 0x7f7880003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:53:00.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.485+0000 7f7899fa6640 1 -- 172.21.15.94:0/1770491649 reap_dead start 2023-10-16T08:53:00.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.486+0000 7f7899fa6640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78800051d0 0x7f788000b980 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f788c00a710 tx=0x7f78800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805261853fb98e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:00.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.486+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c034630 con 0x7f78800051d0 2023-10-16T08:53:00.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.486+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c02f070 con 0x7f78800051d0 2023-10-16T08:53:00.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.486+0000 7f788bfff640 1 -- 172.21.15.94:0/1770491649 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c034a10 con 0x7f78800051d0 2023-10-16T08:53:00.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.486+0000 7f789ba09640 1 -- 172.21.15.94:0/1770491649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78800051d0 msgr2=0x7f788000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.486+0000 7f789ba09640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78800051d0 0x7f788000b980 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f788c00a710 tx=0x7f78800057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.487+0000 7f789ba09640 1 -- 172.21.15.94:0/1770491649 shutdown_connections 2023-10-16T08:53:00.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.487+0000 7f789ba09640 1 --2- 172.21.15.94:0/1770491649 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78800051d0 0x7f788000b980 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.487+0000 7f789ba09640 1 -- 172.21.15.94:0/1770491649 >> 172.21.15.94:0/1770491649 conn(0x7f78940cb1b0 msgr2=0x7f78940cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:00.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.487+0000 7f789ba09640 1 -- 172.21.15.94:0/1770491649 shutdown_connections 2023-10-16T08:53:00.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.487+0000 7f789ba09640 1 -- 172.21.15.94:0/1770491649 wait complete. 2023-10-16T08:53:00.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.488+0000 7f789ba09640 1 Processor -- start 2023-10-16T08:53:00.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.488+0000 7f789ba09640 1 -- start start 2023-10-16T08:53:00.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.489+0000 7f789ba09640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78800051d0 0x7f78940c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.489+0000 7f789ba09640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 0x7f789415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.489+0000 7f789ba09640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f789415d190 0x7f78941451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.489+0000 7f789ba09640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789415d620 con 0x7f78940c5d40 2023-10-16T08:53:00.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.489+0000 7f789ba09640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c8c30 con 0x7f78800051d0 2023-10-16T08:53:00.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.489+0000 7f789ba09640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7894142dd0 con 0x7f789415d190 2023-10-16T08:53:00.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 0x7f789415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 0x7f789415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42044/0 (socket says 172.21.15.94:42044) 2023-10-16T08:53:00.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 -- 172.21.15.94:0/3477731045 learned_addr learned my addr 172.21.15.94:0/3477731045 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:00.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f78997a5640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78800051d0 0x7f78940c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7899fa6640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f789415d190 0x7f78941451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 -- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f789415d190 msgr2=0x7f78941451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f789415d190 0x7f78941451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 -- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78800051d0 msgr2=0x7f78940c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:00.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78800051d0 0x7f78940c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:00.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 -- 172.21.15.94:0/3477731045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78941430b0 con 0x7f78940c5d40 2023-10-16T08:53:00.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.490+0000 7f7898fa4640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 0x7f789415cc50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7884011960 tx=0x7f7884011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:00.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.491+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400faf0 con 0x7f78940c5d40 2023-10-16T08:53:00.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.491+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400fc70 con 0x7f78940c5d40 2023-10-16T08:53:00.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.491+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884014440 con 0x7f78940c5d40 2023-10-16T08:53:00.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.491+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894143390 con 0x7f78940c5d40 2023-10-16T08:53:00.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.491+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78941456f0 con 0x7f78940c5d40 2023-10-16T08:53:00.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.492+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78940cafb0 con 0x7f78940c5d40 2023-10-16T08:53:00.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.493+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78840145a0 con 0x7f78940c5d40 2023-10-16T08:53:00.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.494+0000 7f7889ffb640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f787806aea0 0x7f787806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:00.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.494+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7884089c10 con 0x7f78940c5d40 2023-10-16T08:53:00.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.494+0000 7f78997a5640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f787806aea0 0x7f787806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:00.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.495+0000 7f78997a5640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f787806aea0 0x7f787806d360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7890000c00 tx=0x7f7890013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:00.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.499+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7884054e90 con 0x7f78940c5d40 2023-10-16T08:53:00.705 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:00.703+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7894073ef0 con 0x7f78940c5d40 2023-10-16T08:53:01.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.682+0000 7f7889ffb640 1 -- 172.21.15.94:0/3477731045 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7884022020 con 0x7f78940c5d40 2023-10-16T08:53:01.685 INFO:teuthology.orchestra.run.smithi094.stderr: removed all blocklist entries 2023-10-16T08:53:01.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.685+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f787806aea0 msgr2=0x7f787806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.685+0000 7f789ba09640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f787806aea0 0x7f787806d360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7890000c00 tx=0x7f7890013040 comp rx=0 tx=0).stop 2023-10-16T08:53:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 msgr2=0x7f789415cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 0x7f789415cc50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7884011960 tx=0x7f7884011e20 comp rx=0 tx=0).stop 2023-10-16T08:53:01.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 shutdown_connections 2023-10-16T08:53:01.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f789415d190 0x7f78941451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78940c5d40 0x7f789415cc50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f787806aea0 0x7f787806d360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 --2- 172.21.15.94:0/3477731045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78800051d0 0x7f78940c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.689 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 >> 172.21.15.94:0/3477731045 conn(0x7f78940cb1b0 msgr2=0x7f7894158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:01.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 shutdown_connections 2023-10-16T08:53:01.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.686+0000 7f789ba09640 1 -- 172.21.15.94:0/3477731045 wait complete. 2023-10-16T08:53:01.706 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T08:53:01.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.916+0000 7f3f7cc4f640 1 Processor -- start 2023-10-16T08:53:01.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.916+0000 7f3f7cc4f640 1 -- start start 2023-10-16T08:53:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7cc4f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3f7815ca80 0x7f3f780cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7cc4f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f7815ce60 0x7f3f780b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7cc4f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f780b0550 0x7f3f780c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7cc4f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f780b0980 con 0x7f3f7815ca80 2023-10-16T08:53:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7cc4f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f78161620 con 0x7f3f7815ce60 2023-10-16T08:53:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7cc4f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780cafa0 con 0x7f3f780b0550 2023-10-16T08:53:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3f7815ca80 0x7f3f780cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7659c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3f7815ca80 0x7f3f780cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42046/0 (socket says 172.21.15.94:42046) 2023-10-16T08:53:01.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f7659c640 1 -- 172.21.15.94:0/2311221142 learned_addr learned my addr 172.21.15.94:0/2311221142 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:01.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.918+0000 7f3f75d9b640 1 --2- 172.21.15.94:0/2311221142 >> v2:172.21.15.130:3300/0 conn(0x7f3f7815ce60 0x7f3f780b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:01.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f76d9d640 1 --2- 172.21.15.94:0/2311221142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f780b0550 0x7f3f780c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f7659c640 1 -- 172.21.15.94:0/2311221142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f780b0550 msgr2=0x7f3f780c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f7659c640 1 --2- 172.21.15.94:0/2311221142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f780b0550 0x7f3f780c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f7659c640 1 -- 172.21.15.94:0/2311221142 >> v2:172.21.15.130:3300/0 conn(0x7f3f7815ce60 msgr2=0x7f3f780b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f7659c640 1 --2- 172.21.15.94:0/2311221142 >> v2:172.21.15.130:3300/0 conn(0x7f3f7815ce60 0x7f3f780b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f7659c640 1 -- 172.21.15.94:0/2311221142 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780cb280 con 0x7f3f7815ca80 2023-10-16T08:53:01.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.919+0000 7f3f75d9b640 1 --2- 172.21.15.94:0/2311221142 >> v2:172.21.15.130:3300/0 conn(0x7f3f7815ce60 0x7f3f780b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:53:01.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.920+0000 7f3f7659c640 1 --2- 172.21.15.94:0/2311221142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7815ca80 0x7f3f780cddf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3f780b10e0 tx=0x7f3f6802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bd997ba659eaa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:01.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.921+0000 7f3f7559a640 1 -- 172.21.15.94:0/2311221142 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68031860 con 0x7f3f7815ca80 2023-10-16T08:53:01.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.921+0000 7f3f7559a640 1 -- 172.21.15.94:0/2311221142 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f680319c0 con 0x7f3f7815ca80 2023-10-16T08:53:01.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.921+0000 7f3f7559a640 1 -- 172.21.15.94:0/2311221142 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68031d50 con 0x7f3f7815ca80 2023-10-16T08:53:01.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.921+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/2311221142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7815ca80 msgr2=0x7f3f780cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:01.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.921+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/2311221142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7815ca80 0x7f3f780cddf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3f780b10e0 tx=0x7f3f6802b900 comp rx=0 tx=0).stop 2023-10-16T08:53:01.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/2311221142 shutdown_connections 2023-10-16T08:53:01.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/2311221142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f780b0550 0x7f3f780c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/2311221142 >> v2:172.21.15.130:3300/0 conn(0x7f3f7815ce60 0x7f3f780b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/2311221142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7815ca80 0x7f3f780cddf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/2311221142 >> 172.21.15.94:0/2311221142 conn(0x7f3f7806c1c0 msgr2=0x7f3f7806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:01.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/2311221142 shutdown_connections 2023-10-16T08:53:01.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.922+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/2311221142 wait complete. 2023-10-16T08:53:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.923+0000 7f3f7cc4f640 1 Processor -- start 2023-10-16T08:53:01.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 -- start start 2023-10-16T08:53:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 0x7f3f780c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f7815ca80 0x7f3f780af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7815ce60 0x7f3f781f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780c9540 con 0x7f3f780b0550 2023-10-16T08:53:01.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f781f2fc0 con 0x7f3f7815ce60 2023-10-16T08:53:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.924+0000 7f3f7cc4f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7815fc20 con 0x7f3f7815ca80 2023-10-16T08:53:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 0x7f3f780c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 0x7f3f780c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42048/0 (socket says 172.21.15.94:42048) 2023-10-16T08:53:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 -- 172.21.15.94:0/185560050 learned_addr learned my addr 172.21.15.94:0/185560050 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:01.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 -- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f7815ca80 msgr2=0x7f3f780af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f7815ca80 0x7f3f780af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 -- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7815ce60 msgr2=0x7f3f781f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f76d9d640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7815ce60 0x7f3f781f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7815ce60 0x7f3f781f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 -- 172.21.15.94:0/185560050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680094d0 con 0x7f3f780b0550 2023-10-16T08:53:01.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.925+0000 7f3f7659c640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 0x7f3f780c9000 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000c00 tx=0x7f3f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:01.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.926+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6803ad30 con 0x7f3f780b0550 2023-10-16T08:53:01.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.926+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6803ae90 con 0x7f3f780b0550 2023-10-16T08:53:01.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.926+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68044640 con 0x7f3f780b0550 2023-10-16T08:53:01.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.926+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7815f010 con 0x7f3f780b0550 2023-10-16T08:53:01.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.926+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7815f5d0 con 0x7f3f780b0550 2023-10-16T08:53:01.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.927+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f78073ef0 con 0x7f3f780b0550 2023-10-16T08:53:01.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.928+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f6804d430 con 0x7f3f780b0550 2023-10-16T08:53:01.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.929+0000 7f3f66ffd640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f5806aea0 0x7f3f5806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:01.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.929+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3f680aba60 con 0x7f3f780b0550 2023-10-16T08:53:01.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.929+0000 7f3f75d9b640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f5806aea0 0x7f3f5806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:01.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.930+0000 7f3f75d9b640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f5806aea0 0x7f3f5806d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3f7815c030 tx=0x7f3f6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:01.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:01.933+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f68076d20 con 0x7f3f780b0550 2023-10-16T08:53:02.195 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.194+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3f780b4510 con 0x7f3f780b0550 2023-10-16T08:53:02.196 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.195+0000 7f3f66ffd640 1 -- 172.21.15.94:0/185560050 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3f68035090 con 0x7f3f780b0550 2023-10-16T08:53:02.197 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:02.197 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:53:02.197 INFO:teuthology.orchestra.run.smithi094.stdout: "auth_dump": [ 2023-10-16T08:53:02.198 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.198 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.a", 2023-10-16T08:53:02.198 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA9+Sxl+N2vIRAAiVlhQbB4/KlaD0/uMzK2Nw==", 2023-10-16T08:53:02.198 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.198 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.199 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2023-10-16T08:53:02.199 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2023-10-16T08:53:02.199 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.199 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.200 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.200 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.b", 2023-10-16T08:53:02.200 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA++SxlzTvWBxAAu21opRN5YDIzcXioGIwj4g==", 2023-10-16T08:53:02.200 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.201 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.201 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2023-10-16T08:53:02.201 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2023-10-16T08:53:02.201 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.201 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.202 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.202 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.202 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.c", 2023-10-16T08:53:02.202 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA9+SxlQVukMhAAile0aHnbDQJs4QdXEBihrQ==", 2023-10-16T08:53:02.202 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.203 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.203 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2023-10-16T08:53:02.203 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2023-10-16T08:53:02.203 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.203 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.204 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.204 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mds.d", 2023-10-16T08:53:02.204 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA++SxlZvd/FxAAbaL43YEQM5WWWKanib8hEQ==", 2023-10-16T08:53:02.205 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.205 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.205 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2023-10-16T08:53:02.205 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2023-10-16T08:53:02.205 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.205 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.206 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.206 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.0", 2023-10-16T08:53:02.206 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBB+Sxl2F4cBBAAs2jLWhoNofJyqD73J2w4/Q==", 2023-10-16T08:53:02.206 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.207 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.207 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.207 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.207 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.207 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.208 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.208 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.1", 2023-10-16T08:53:02.208 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBE+Sxl5TeEDRAAgAmCwiHOlTdrQsxdecVXUA==", 2023-10-16T08:53:02.208 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.208 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.209 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.209 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.209 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.209 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.209 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.210 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.2", 2023-10-16T08:53:02.210 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBH+Sxl5YGMFhAA7uvjxqKupYur/uVW+1rz5w==", 2023-10-16T08:53:02.210 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.210 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.210 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.211 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.211 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.211 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.211 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.211 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.3", 2023-10-16T08:53:02.212 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBK+Sxl1oqULhAAs9NGpFAkY32Aqr20mwQtOw==", 2023-10-16T08:53:02.212 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.212 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.212 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.212 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.212 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.213 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.213 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.213 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.4", 2023-10-16T08:53:02.213 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBR+SxlHr2kLxAAl12On0rOGZE2njAIvVamow==", 2023-10-16T08:53:02.213 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.214 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.214 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.214 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.214 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.215 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.215 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.5", 2023-10-16T08:53:02.215 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBV+Sxl2UBkDhAAkO6mo4b5ipeFxhIQhXSKbw==", 2023-10-16T08:53:02.215 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.215 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.216 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.216 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.216 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.216 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.6", 2023-10-16T08:53:02.217 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBY+SxlWcKkGRAAu96syZk6nLkI84jo0jgnvQ==", 2023-10-16T08:53:02.217 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.217 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.217 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.217 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.217 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.218 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "osd.7", 2023-10-16T08:53:02.218 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBb+SxlsgnaIxAA29Lw6t6SqDToSW4m99Fy6w==", 2023-10-16T08:53:02.218 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.219 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow profile osd", 2023-10-16T08:53:02.219 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile osd", 2023-10-16T08:53:02.219 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.219 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.219 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.0", 2023-10-16T08:53:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA++SxlUlLsJRAAUJkmJH2I1H5D3uqFOH2BXQ==", 2023-10-16T08:53:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.220 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2023-10-16T08:53:02.221 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2023-10-16T08:53:02.221 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2023-10-16T08:53:02.221 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.221 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.221 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.222 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.1", 2023-10-16T08:53:02.222 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA/+SxlsfZqABAACwnSBQe73J17rnixyCh9kQ==", 2023-10-16T08:53:02.222 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.222 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.222 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2023-10-16T08:53:02.223 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2023-10-16T08:53:02.223 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2023-10-16T08:53:02.223 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.225 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.225 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.225 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.2", 2023-10-16T08:53:02.225 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA++SxlhE9vMRAAZQF2JzRY+9+0TvmQV5cctA==", 2023-10-16T08:53:02.226 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.226 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.226 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2023-10-16T08:53:02.226 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2023-10-16T08:53:02.226 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2023-10-16T08:53:02.227 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.227 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.227 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.3", 2023-10-16T08:53:02.227 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA/+Sxl6qfXCxAAQt4HpZUXnHRM2DSvu8roIQ==", 2023-10-16T08:53:02.228 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.228 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow", 2023-10-16T08:53:02.228 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow r", 2023-10-16T08:53:02.228 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow rw", 2023-10-16T08:53:02.228 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow rwx" 2023-10-16T08:53:02.228 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.229 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.229 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.admin", 2023-10-16T08:53:02.229 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA8+SxlMurHFxAAV1ShgYYNNPyCtBuw3sk4fw==", 2023-10-16T08:53:02.229 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.230 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2023-10-16T08:53:02.230 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr": "allow *", 2023-10-16T08:53:02.230 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow *", 2023-10-16T08:53:02.230 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.230 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.231 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.231 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-mds", 2023-10-16T08:53:02.231 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBu+SxlW7j+MhAA5nFgT2VGkVuxMOAaxOfJwg==", 2023-10-16T08:53:02.231 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.231 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T08:53:02.232 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.232 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.232 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.232 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T08:53:02.232 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBu+SxlENP+MhAApjeuPvgG/1VbI25Ldwprxg==", 2023-10-16T08:53:02.233 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.233 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T08:53:02.233 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.233 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.233 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.234 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-osd", 2023-10-16T08:53:02.234 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBu+SxlpOr+MhAAtpN4aG323pOzTgCgKTQURQ==", 2023-10-16T08:53:02.234 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.234 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T08:53:02.234 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.235 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.235 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T08:53:02.235 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBu+Sxldwv/MhAAlr9DHxxp1uvKFptgAycnUA==", 2023-10-16T08:53:02.235 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.236 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T08:53:02.236 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.236 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.236 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T08:53:02.236 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBu+Sxl1CT/MhAABdo7tQ429V463mtXVI/NJg==", 2023-10-16T08:53:02.237 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.237 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T08:53:02.237 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.237 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.237 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.237 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T08:53:02.238 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQBu+SxlZD7/MhAAKg+YNiGlECME0u8OPmxBDg==", 2023-10-16T08:53:02.238 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.238 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T08:53:02.238 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.238 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.239 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.239 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.x", 2023-10-16T08:53:02.239 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA9+SxlV++IFhAAXgG+5AmBo+BXL6/6ihyaqQ==", 2023-10-16T08:53:02.239 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.239 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2023-10-16T08:53:02.239 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2023-10-16T08:53:02.240 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.240 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:02.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:02.240 INFO:teuthology.orchestra.run.smithi094.stdout: "entity": "mgr.y", 2023-10-16T08:53:02.241 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "AQA9+Sxl5IsEDBAAM3U+Kq3lM5sbcEB52TWgrA==", 2023-10-16T08:53:02.241 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": { 2023-10-16T08:53:02.241 INFO:teuthology.orchestra.run.smithi094.stdout: "mds": "allow *", 2023-10-16T08:53:02.241 INFO:teuthology.orchestra.run.smithi094.stdout: "mon": "allow profile mgr", 2023-10-16T08:53:02.241 INFO:teuthology.orchestra.run.smithi094.stdout: "osd": "allow *" 2023-10-16T08:53:02.241 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.242 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:02.242 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2023-10-16T08:53:02.242 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:53:02.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f5806aea0 msgr2=0x7f3f5806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f5806aea0 0x7f3f5806d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3f7815c030 tx=0x7f3f6c008040 comp rx=0 tx=0).stop 2023-10-16T08:53:02.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 msgr2=0x7f3f780c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 0x7f3f780c9000 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000c00 tx=0x7f3f680046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 shutdown_connections 2023-10-16T08:53:02.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f3f5806aea0 0x7f3f5806d360 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f7815ce60 0x7f3f781f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f7815ca80 0x7f3f780af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.245 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 --2- 172.21.15.94:0/185560050 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f780b0550 0x7f3f780c9000 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 >> 172.21.15.94:0/185560050 conn(0x7f3f7806c1c0 msgr2=0x7f3f780acac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:02.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 shutdown_connections 2023-10-16T08:53:02.246 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.198+0000 7f3f7cc4f640 1 -- 172.21.15.94:0/185560050 wait complete. 2023-10-16T08:53:02.246 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T08:53:02.267 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:53:02.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:53:02.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.459+0000 7f2c134b4640 1 Processor -- start 2023-10-16T08:53:02.461 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.459+0000 7f2c134b4640 1 -- start start 2023-10-16T08:53:02.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c134b4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2c0c159c80 0x7f2c0c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.463 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c134b4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2c0c06d440 0x7f2c0c0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c134b4640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0c15a2c0 con 0x7f2c0c15d700 2023-10-16T08:53:02.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c134b4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0c15a5a0 con 0x7f2c0c06d440 2023-10-16T08:53:02.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c134b4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0c15a880 con 0x7f2c0c159c80 2023-10-16T08:53:02.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11a51640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2c0c06d440 0x7f2c0c0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.464 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11250640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2c0c15d700 0x7f2c0c15dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45924/0 (socket says 172.21.15.94:45924) 2023-10-16T08:53:02.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11250640 1 -- 172.21.15.94:0/2295396722 learned_addr learned my addr 172.21.15.94:0/2295396722 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:02.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11a51640 1 --2- 172.21.15.94:0/2295396722 >> v2:172.21.15.94:3300/0 conn(0x7f2c0c06d440 0x7f2c0c0b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42052/0 (socket says 172.21.15.94:42052) 2023-10-16T08:53:02.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c10a4f640 1 --2- 172.21.15.94:0/2295396722 >> v2:172.21.15.130:3300/0 conn(0x7f2c0c159c80 0x7f2c0c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11a51640 1 -- 172.21.15.94:0/2295396722 >> v2:172.21.15.130:3300/0 conn(0x7f2c0c159c80 msgr2=0x7f2c0c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:02.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11a51640 1 --2- 172.21.15.94:0/2295396722 >> v2:172.21.15.130:3300/0 conn(0x7f2c0c159c80 0x7f2c0c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.465 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11a51640 1 -- 172.21.15.94:0/2295396722 >> v1:172.21.15.94:6789/0 conn(0x7f2c0c15d700 legacy=0x7f2c0c15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.466 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.461+0000 7f2c11a51640 1 -- 172.21.15.94:0/2295396722 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c15ab60 con 0x7f2c0c06d440 2023-10-16T08:53:02.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c11a51640 1 --2- 172.21.15.94:0/2295396722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0b01b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c071730 tx=0x7f2c0402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a1521b8da8960 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:02.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c03fff640 1 -- 172.21.15.94:0/2295396722 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0402cc70 con 0x7f2c0c06d440 2023-10-16T08:53:02.467 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c03fff640 1 -- 172.21.15.94:0/2295396722 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0402cdd0 con 0x7f2c0c06d440 2023-10-16T08:53:02.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c03fff640 1 -- 172.21.15.94:0/2295396722 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04034660 con 0x7f2c0c06d440 2023-10-16T08:53:02.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c134b4640 1 -- 172.21.15.94:0/2295396722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c06d440 msgr2=0x7f2c0c0b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2295396722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0b01b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c071730 tx=0x7f2c0402bec0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c134b4640 1 -- 172.21.15.94:0/2295396722 shutdown_connections 2023-10-16T08:53:02.468 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2295396722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0b01b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2295396722 >> v2:172.21.15.130:3300/0 conn(0x7f2c0c159c80 0x7f2c0c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.463+0000 7f2c134b4640 1 -- 172.21.15.94:0/2295396722 >> 172.21.15.94:0/2295396722 conn(0x7f2c0c0cb1b0 msgr2=0x7f2c0c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:02.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.464+0000 7f2c134b4640 1 -- 172.21.15.94:0/2295396722 shutdown_connections 2023-10-16T08:53:02.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.464+0000 7f2c134b4640 1 -- 172.21.15.94:0/2295396722 wait complete. 2023-10-16T08:53:02.469 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.465+0000 7f2c134b4640 1 Processor -- start 2023-10-16T08:53:02.470 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.465+0000 7f2c134b4640 1 -- start start 2023-10-16T08:53:02.471 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.466+0000 7f2c134b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.466+0000 7f2c134b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c0c159c80 0x7f2c0c0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.466+0000 7f2c134b4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 0x7f2c0c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.466+0000 7f2c134b4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c150110 con 0x7f2c0c15d700 2023-10-16T08:53:02.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.466+0000 7f2c134b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0c50b0 con 0x7f2c0c06d440 2023-10-16T08:53:02.472 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.466+0000 7f2c134b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0ae450 con 0x7f2c0c159c80 2023-10-16T08:53:02.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 0x7f2c0c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 0x7f2c0c15b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42062/0 (socket says 172.21.15.94:42062) 2023-10-16T08:53:02.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 -- 172.21.15.94:0/2964761316 learned_addr learned my addr 172.21.15.94:0/2964761316 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:02.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11250640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.473 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 -- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c0c159c80 msgr2=0x7f2c0c0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c0c159c80 0x7f2c0c0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 -- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c0c06d440 msgr2=0x7f2c0c0c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 -- 172.21.15.94:0/2964761316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04009a70 con 0x7f2c0c15d700 2023-10-16T08:53:02.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.467+0000 7f2c11a51640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 0x7f2c0c15b620 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009e80 tx=0x7f2c04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:02.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.468+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04040650 con 0x7f2c0c15d700 2023-10-16T08:53:02.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.468+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040407d0 con 0x7f2c0c15d700 2023-10-16T08:53:02.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.468+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04040b80 con 0x7f2c0c15d700 2023-10-16T08:53:02.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.468+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0c0ae730 con 0x7f2c0c15d700 2023-10-16T08:53:02.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.468+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0c0aea10 con 0x7f2c0c15d700 2023-10-16T08:53:02.475 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.469+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0c073ef0 con 0x7f2c0c15d700 2023-10-16T08:53:02.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.470+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c04040ce0 con 0x7f2c0c15d700 2023-10-16T08:53:02.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.471+0000 7f2c01ffb640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2bf006aea0 0x7f2bf006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.471+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2c040ac170 con 0x7f2c0c15d700 2023-10-16T08:53:02.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.471+0000 7f2c11250640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2bf006aea0 0x7f2bf006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.472+0000 7f2c11250640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2bf006aea0 0x7f2bf006d360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c08005880 tx=0x7f2c08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:02.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.475+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c04077420 con 0x7f2c0c15d700 2023-10-16T08:53:02.738 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.736+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2c0c0b3500 con 0x7f2c0c15d700 2023-10-16T08:53:02.741 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.739+0000 7f2c01ffb640 1 -- 172.21.15.94:0/2964761316 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2c0407aa40 con 0x7f2c0c15d700 2023-10-16T08:53:02.745 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2bf006aea0 msgr2=0x7f2bf006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2bf006aea0 0x7f2bf006d360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c08005880 tx=0x7f2c08009040 comp rx=0 tx=0).stop 2023-10-16T08:53:02.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 msgr2=0x7f2c0c15b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 0x7f2c0c15b620 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009e80 tx=0x7f2c04004a40 comp rx=0 tx=0).stop 2023-10-16T08:53:02.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 shutdown_connections 2023-10-16T08:53:02.746 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c0c15d700 0x7f2c0c15b620 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c0c159c80 0x7f2c0c0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f2bf006aea0 0x7f2bf006d360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 --2- 172.21.15.94:0/2964761316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c0c06d440 0x7f2c0c0c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 >> 172.21.15.94:0/2964761316 conn(0x7f2c0c0cb1b0 msgr2=0x7f2c0c0ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:02.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 shutdown_connections 2023-10-16T08:53:02.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.743+0000 7f2c134b4640 1 -- 172.21.15.94:0/2964761316 wait complete. 2023-10-16T08:53:02.764 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T08:53:02.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.975+0000 7f4a8a5b0640 1 Processor -- start 2023-10-16T08:53:02.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.976+0000 7f4a8a5b0640 1 -- start start 2023-10-16T08:53:02.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a8a5b0640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4a8415cc20 0x7f4a840c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a8a5b0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a84161310 0x7f4a840ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a8a5b0640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840c9c70 con 0x7f4a840b01b0 2023-10-16T08:53:02.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a8a5b0640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a840cca90 con 0x7f4a8415cc20 2023-10-16T08:53:02.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a8a5b0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8415d000 con 0x7f4a84161310 2023-10-16T08:53:02.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a83fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4a8415cc20 0x7f4a840c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a88b4d640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4a840b01b0 0x7f4a840ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45928/0 (socket says 172.21.15.94:45928) 2023-10-16T08:53:02.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.977+0000 7f4a88b4d640 1 -- 172.21.15.94:0/1829351338 learned_addr learned my addr 172.21.15.94:0/1829351338 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.978+0000 7f4a7bfff640 1 --2- 172.21.15.94:0/1829351338 >> v2:172.21.15.130:3300/0 conn(0x7f4a84161310 0x7f4a840ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.978+0000 7f4a83fff640 1 -- 172.21.15.94:0/1829351338 >> v2:172.21.15.130:3300/0 conn(0x7f4a84161310 msgr2=0x7f4a840ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.978+0000 7f4a83fff640 1 --2- 172.21.15.94:0/1829351338 >> v2:172.21.15.130:3300/0 conn(0x7f4a84161310 0x7f4a840ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.978+0000 7f4a83fff640 1 -- 172.21.15.94:0/1829351338 >> v1:172.21.15.94:6789/0 conn(0x7f4a840b01b0 legacy=0x7f4a840ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.978+0000 7f4a83fff640 1 -- 172.21.15.94:0/1829351338 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840cc760 con 0x7f4a8415cc20 2023-10-16T08:53:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.978+0000 7f4a837fe640 1 -- 172.21.15.94:0/1829351338 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787929851 0 0) 0x7f4a840c9c70 con 0x7f4a840b01b0 2023-10-16T08:53:02.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.979+0000 7f4a83fff640 1 --2- 172.21.15.94:0/1829351338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a8415cc20 0x7f4a840c8d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4a84160620 tx=0x7f4a7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21249863ce8f9c8e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.979+0000 7f4a837fe640 1 -- 172.21.15.94:0/1829351338 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a74031830 con 0x7f4a8415cc20 2023-10-16T08:53:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.979+0000 7f4a837fe640 1 -- 172.21.15.94:0/1829351338 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a74031990 con 0x7f4a8415cc20 2023-10-16T08:53:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.979+0000 7f4a837fe640 1 -- 172.21.15.94:0/1829351338 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a74031d20 con 0x7f4a8415cc20 2023-10-16T08:53:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1829351338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a8415cc20 msgr2=0x7f4a840c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1829351338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a8415cc20 0x7f4a840c8d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4a84160620 tx=0x7f4a7402b8d0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1829351338 shutdown_connections 2023-10-16T08:53:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1829351338 >> v2:172.21.15.130:3300/0 conn(0x7f4a84161310 0x7f4a840ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1829351338 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a8415cc20 0x7f4a840c8d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1829351338 >> 172.21.15.94:0/1829351338 conn(0x7f4a840cb1b0 msgr2=0x7f4a840cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1829351338 shutdown_connections 2023-10-16T08:53:02.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.980+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1829351338 wait complete. 2023-10-16T08:53:02.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.982+0000 7f4a8a5b0640 1 Processor -- start 2023-10-16T08:53:02.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.982+0000 7f4a8a5b0640 1 -- start start 2023-10-16T08:53:02.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a8a5b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a840b01b0 0x7f4a841f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a8a5b0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a8415cc20 0x7f4a840b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a8a5b0640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 0x7f4a840b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a8a5b0640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8415e250 con 0x7f4a84161310 2023-10-16T08:53:02.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a8a5b0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8415e530 con 0x7f4a840b01b0 2023-10-16T08:53:02.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a8a5b0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8415e810 con 0x7f4a8415cc20 2023-10-16T08:53:02.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.983+0000 7f4a88b4d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 0x7f4a840b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 0x7f4a840b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42086/0 (socket says 172.21.15.94:42086) 2023-10-16T08:53:02.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 -- 172.21.15.94:0/1339542751 learned_addr learned my addr 172.21.15.94:0/1339542751 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:02.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a7bfff640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a8415cc20 0x7f4a840b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 -- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a8415cc20 msgr2=0x7f4a840b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a83fff640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a840b01b0 0x7f4a841f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a8415cc20 0x7f4a840b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 -- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a840b01b0 msgr2=0x7f4a841f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:02.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a840b01b0 0x7f4a841f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:02.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 -- 172.21.15.94:0/1339542751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74009400 con 0x7f4a84161310 2023-10-16T08:53:02.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a7bfff640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a8415cc20 0x7f4a840b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:02.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.984+0000 7f4a88b4d640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 0x7f4a840b37e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c7e0 tx=0x7f4a7c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:02.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.985+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00a640 con 0x7f4a84161310 2023-10-16T08:53:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.985+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c00a7c0 con 0x7f4a84161310 2023-10-16T08:53:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.985+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00ab70 con 0x7f4a84161310 2023-10-16T08:53:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.985+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8415eaf0 con 0x7f4a84161310 2023-10-16T08:53:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.985+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a841f2100 con 0x7f4a84161310 2023-10-16T08:53:02.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.986+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8415f010 con 0x7f4a84161310 2023-10-16T08:53:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.987+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a7c00acd0 con 0x7f4a84161310 2023-10-16T08:53:02.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.988+0000 7f4a817fa640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4a6406ae70 0x7f4a6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.988+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4a7c088a30 con 0x7f4a84161310 2023-10-16T08:53:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.988+0000 7f4a83fff640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4a6406ae70 0x7f4a6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.989+0000 7f4a83fff640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4a6406ae70 0x7f4a6406d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a74036000 tx=0x7f4a74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:02.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:02.992+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a8415f010 con 0x7f4a84161310 2023-10-16T08:53:03.251 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.249+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4a8415f010 con 0x7f4a84161310 2023-10-16T08:53:03.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.253+0000 7f4a817fa640 1 -- 172.21.15.94:0/1339542751 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4a8415f010 con 0x7f4a84161310 2023-10-16T08:53:03.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4a6406ae70 msgr2=0x7f4a6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4a6406ae70 0x7f4a6406d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a74036000 tx=0x7f4a74008030 comp rx=0 tx=0).stop 2023-10-16T08:53:03.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 msgr2=0x7f4a840b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 0x7f4a840b37e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c7e0 tx=0x7f4a7c00cca0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 shutdown_connections 2023-10-16T08:53:03.259 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a84161310 0x7f4a840b37e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a8415cc20 0x7f4a840b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f4a6406ae70 0x7f4a6406d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 --2- 172.21.15.94:0/1339542751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a840b01b0 0x7f4a841f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 >> 172.21.15.94:0/1339542751 conn(0x7f4a840cb1b0 msgr2=0x7f4a8415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:03.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 shutdown_connections 2023-10-16T08:53:03.261 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.256+0000 7f4a8a5b0640 1 -- 172.21.15.94:0/1339542751 wait complete. 2023-10-16T08:53:03.277 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T08:53:03.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.483+0000 7fa9a2d55640 1 Processor -- start 2023-10-16T08:53:03.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.483+0000 7fa9a2d55640 1 -- start start 2023-10-16T08:53:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a2d55640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa99c0c9260 0x7fa99c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a2d55640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c15ae40 con 0x7fa99c15aa60 2023-10-16T08:53:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a2d55640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0b1580 con 0x7fa99c0b08c0 2023-10-16T08:53:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a2d55640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0c96f0 con 0x7fa99c0c9260 2023-10-16T08:53:03.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a0af1640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa99c15aa60 0x7fa99c0b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45938/0 (socket says 172.21.15.94:45938) 2023-10-16T08:53:03.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a0af1640 1 -- 172.21.15.94:0/1913178628 learned_addr learned my addr 172.21.15.94:0/1913178628 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:03.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.485+0000 7fa9a12f2640 1 --2- 172.21.15.94:0/1913178628 >> v2:172.21.15.130:3300/0 conn(0x7fa99c0c9260 0x7fa99c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400235204 0 0) 0x7fa99c15ae40 con 0x7fa99c15aa60 2023-10-16T08:53:03.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c003520 con 0x7fa99c15aa60 2023-10-16T08:53:03.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678516075 0 0) 0x7fa98c003520 con 0x7fa99c15aa60 2023-10-16T08:53:03.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 >> v2:172.21.15.130:3300/0 conn(0x7fa99c0c9260 msgr2=0x7fa99c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:03.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 --2- 172.21.15.94:0/1913178628 >> v2:172.21.15.130:3300/0 conn(0x7fa99c0c9260 0x7fa99c06c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 >> v1:172.21.15.130:6789/0 conn(0x7fa99c0b08c0 legacy=0x7fa99c0b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0c98f0 con 0x7fa99c15aa60 2023-10-16T08:53:03.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fa990001670 con 0x7fa99c15aa60 2023-10-16T08:53:03.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 >> v1:172.21.15.94:6789/0 conn(0x7fa99c15aa60 legacy=0x7fa99c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa98c0047c0 0x7fa98c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c005180 0x7fa98c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c96f0 con 0x7fa98c003970 2023-10-16T08:53:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00c120 con 0x7fa98c005180 2023-10-16T08:53:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00c2e0 con 0x7fa98c0047c0 2023-10-16T08:53:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.486+0000 7fa9a0af1640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a0af1640 1 -- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa98c0047c0 msgr2=0x7fa98c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:03.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa99bfff640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa98c0047c0 0x7fa98c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a12f2640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c005180 0x7fa98c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a0af1640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa98c0047c0 0x7fa98c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a0af1640 1 -- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c005180 msgr2=0x7fa98c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a0af1640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c005180 0x7fa98c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a0af1640 1 -- 172.21.15.94:0/1913178628 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c003520 con 0x7fa98c003970 2023-10-16T08:53:03.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa9a12f2640 1 -- 172.21.15.94:0/1913178628 reap_dead start 2023-10-16T08:53:03.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.487+0000 7fa99bfff640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa98c0047c0 0x7fa98c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:03.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.488+0000 7fa9a0af1640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c240 tx=0x7fa98c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8c19cb87b4f202 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:03.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.488+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990005ad0 con 0x7fa98c003970 2023-10-16T08:53:03.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.488+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990005c30 con 0x7fa98c003970 2023-10-16T08:53:03.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.488+0000 7fa99b7fe640 1 -- 172.21.15.94:0/1913178628 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99002ca70 con 0x7fa98c003970 2023-10-16T08:53:03.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 -- 172.21.15.94:0/1913178628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa98c003970 msgr2=0x7fa98c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c240 tx=0x7fa98c0057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 -- 172.21.15.94:0/1913178628 shutdown_connections 2023-10-16T08:53:03.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/1913178628 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa98c003970 0x7fa98c003d90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 -- 172.21.15.94:0/1913178628 >> 172.21.15.94:0/1913178628 conn(0x7fa99c0cb1b0 msgr2=0x7fa99c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 -- 172.21.15.94:0/1913178628 shutdown_connections 2023-10-16T08:53:03.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.489+0000 7fa9a2d55640 1 -- 172.21.15.94:0/1913178628 wait complete. 2023-10-16T08:53:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.491+0000 7fa9a2d55640 1 Processor -- start 2023-10-16T08:53:03.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.491+0000 7fa9a2d55640 1 -- start start 2023-10-16T08:53:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a2d55640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c003970 0x7fa99c158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a2d55640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa99c15c080 0x7fa99c0c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a2d55640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 0x7fa99c0b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a2d55640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c48d0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a2d55640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c23e0 con 0x7fa98c003970 2023-10-16T08:53:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a2d55640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c15c7f0 con 0x7fa99c15c080 2023-10-16T08:53:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 0x7fa99c0b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 0x7fa99c0b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42100/0 (socket says 172.21.15.94:42100) 2023-10-16T08:53:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 -- 172.21.15.94:0/724462991 learned_addr learned my addr 172.21.15.94:0/724462991 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:03.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 -- 172.21.15.94:0/724462991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa99c15c080 msgr2=0x7fa99c0c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa99c15c080 0x7fa99c0c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 -- 172.21.15.94:0/724462991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c003970 msgr2=0x7fa99c158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c003970 0x7fa99c158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.492+0000 7fa9a12f2640 1 -- 172.21.15.94:0/724462991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c15cad0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.493+0000 7fa9a12f2640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 0x7fa99c0b2c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0adc40 tx=0x7fa99400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:03.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.493+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994016420 con 0x7fa99c0c65a0 2023-10-16T08:53:03.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.493+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9940165a0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.493+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994016950 con 0x7fa99c0c65a0 2023-10-16T08:53:03.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.493+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c15cdb0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.493+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c0c6a50 con 0x7fa99c0c65a0 2023-10-16T08:53:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.494+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c0cafb0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.495+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa994016ab0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.496+0000 7fa9997fa640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa98006aea0 0x7fa98006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.496+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa99408a2d0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.496+0000 7fa9a0af1640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa98006aea0 0x7fa98006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.497+0000 7fa9a0af1640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa98006aea0 0x7fa98006d360 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa990034000 tx=0x7fa990039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:03.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.500+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa994055580 con 0x7fa99c0c65a0 2023-10-16T08:53:03.740 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.738+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa99c0c2230 con 0x7fa99c0c65a0 2023-10-16T08:53:03.744 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.742+0000 7fa9997fa640 1 -- 172.21.15.94:0/724462991 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa994058ba0 con 0x7fa99c0c65a0 2023-10-16T08:53:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.744+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa98006aea0 msgr2=0x7fa98006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.744+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa98006aea0 0x7fa98006d360 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa990034000 tx=0x7fa990039040 comp rx=0 tx=0).stop 2023-10-16T08:53:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.744+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 msgr2=0x7fa99c0b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.747 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.744+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 0x7fa99c0b2c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0adc40 tx=0x7fa99400f520 comp rx=0 tx=0).stop 2023-10-16T08:53:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 shutdown_connections 2023-10-16T08:53:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa99c0c65a0 0x7fa99c0b2c90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa99c15c080 0x7fa99c0c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fa98006aea0 0x7fa98006d360 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.748 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 --2- 172.21.15.94:0/724462991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa98c003970 0x7fa99c158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 >> 172.21.15.94:0/724462991 conn(0x7fa99c0cb1b0 msgr2=0x7fa99c0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:03.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 shutdown_connections 2023-10-16T08:53:03.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.745+0000 7fa9a2d55640 1 -- 172.21.15.94:0/724462991 wait complete. 2023-10-16T08:53:03.764 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T08:53:03.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.973+0000 7f9196741640 1 Processor -- start 2023-10-16T08:53:03.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.973+0000 7f9196741640 1 -- start start 2023-10-16T08:53:03.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.974+0000 7f9196741640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f919015aa60 0x7f91900c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.974+0000 7f9196741640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f919006c760 0x7f91900b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.974+0000 7f9196741640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919015ae40 con 0x7f91900b06f0 2023-10-16T08:53:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.974+0000 7f9196741640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900b0b80 con 0x7f919006c760 2023-10-16T08:53:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.974+0000 7f9196741640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919006cbc0 con 0x7f919015aa60 2023-10-16T08:53:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f919006c760 0x7f91900b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f919006c760 0x7f91900b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42104/0 (socket says 172.21.15.94:42104) 2023-10-16T08:53:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 -- 172.21.15.94:0/324888903 learned_addr learned my addr 172.21.15.94:0/324888903 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f918ffff640 1 --2- 172.21.15.94:0/324888903 >> v2:172.21.15.130:3300/0 conn(0x7f919015aa60 0x7f91900c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 -- 172.21.15.94:0/324888903 >> v2:172.21.15.130:3300/0 conn(0x7f919015aa60 msgr2=0x7f91900c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 --2- 172.21.15.94:0/324888903 >> v2:172.21.15.130:3300/0 conn(0x7f919015aa60 0x7f91900c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 -- 172.21.15.94:0/324888903 >> v1:172.21.15.130:6789/0 conn(0x7f91900b06f0 legacy=0x7f9190070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:03.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f9187fff640 1 -- 172.21.15.94:0/324888903 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91900b1580 con 0x7f919006c760 2023-10-16T08:53:03.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.975+0000 7f918ffff640 1 --2- 172.21.15.94:0/324888903 >> v2:172.21.15.130:3300/0 conn(0x7f919015aa60 0x7f91900c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.976+0000 7f9187fff640 1 --2- 172.21.15.94:0/324888903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91900b01b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f919006e1e0 tx=0x7f917802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e83c73e0134d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.977+0000 7f918f7fe640 1 -- 172.21.15.94:0/324888903 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780317e0 con 0x7f919006c760 2023-10-16T08:53:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.977+0000 7f918f7fe640 1 -- 172.21.15.94:0/324888903 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178031940 con 0x7f919006c760 2023-10-16T08:53:03.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.977+0000 7f918f7fe640 1 -- 172.21.15.94:0/324888903 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178031cd0 con 0x7f919006c760 2023-10-16T08:53:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 -- 172.21.15.94:0/324888903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 msgr2=0x7f91900b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 --2- 172.21.15.94:0/324888903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91900b01b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f919006e1e0 tx=0x7f917802b880 comp rx=0 tx=0).stop 2023-10-16T08:53:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 -- 172.21.15.94:0/324888903 shutdown_connections 2023-10-16T08:53:03.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 --2- 172.21.15.94:0/324888903 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91900b01b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 --2- 172.21.15.94:0/324888903 >> v2:172.21.15.130:3300/0 conn(0x7f919015aa60 0x7f91900c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 -- 172.21.15.94:0/324888903 >> 172.21.15.94:0/324888903 conn(0x7f91900cb1b0 msgr2=0x7f91900cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:03.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 -- 172.21.15.94:0/324888903 shutdown_connections 2023-10-16T08:53:03.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.978+0000 7f9196741640 1 -- 172.21.15.94:0/324888903 wait complete. 2023-10-16T08:53:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.980+0000 7f9196741640 1 Processor -- start 2023-10-16T08:53:03.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.980+0000 7f9196741640 1 -- start start 2023-10-16T08:53:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.981+0000 7f9196741640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91901ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.981+0000 7f9196741640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91900b06f0 0x7f91901f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.981+0000 7f9196741640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919015aa60 0x7f91901f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.981+0000 7f9196741640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919014c940 con 0x7f919006c760 2023-10-16T08:53:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.981+0000 7f9196741640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900a7800 con 0x7f919015aa60 2023-10-16T08:53:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.981+0000 7f9196741640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900c5d70 con 0x7f91900b06f0 2023-10-16T08:53:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91901ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91901ef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42118/0 (socket says 172.21.15.94:42118) 2023-10-16T08:53:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 -- 172.21.15.94:0/3115739551 learned_addr learned my addr 172.21.15.94:0/3115739551 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:03.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f9187fff640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91900b06f0 0x7f91901f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f9194cde640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919015aa60 0x7f91901f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 -- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91900b06f0 msgr2=0x7f91901f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91900b06f0 0x7f91901f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 -- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919015aa60 msgr2=0x7f91901f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:03.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919015aa60 0x7f91901f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f918ffff640 1 -- 172.21.15.94:0/3115739551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780094d0 con 0x7f919006c760 2023-10-16T08:53:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.982+0000 7f9194cde640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919015aa60 0x7f91901f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.983+0000 7f918ffff640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91901ef770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f918000c7f0 tx=0x7f918000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.983+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180007820 con 0x7f919006c760 2023-10-16T08:53:03.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.983+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9180007980 con 0x7f919006c760 2023-10-16T08:53:03.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.983+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91900c6050 con 0x7f919006c760 2023-10-16T08:53:03.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.983+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180007cf0 con 0x7f919006c760 2023-10-16T08:53:03.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.983+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91900c6610 con 0x7f919006c760 2023-10-16T08:53:03.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.984+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91900cafb0 con 0x7f919006c760 2023-10-16T08:53:03.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.985+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f91800113f0 con 0x7f919006c760 2023-10-16T08:53:03.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.986+0000 7f918d7fa640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f917006ae70 0x7f917006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:03.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.986+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f91800897b0 con 0x7f919006c760 2023-10-16T08:53:03.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.987+0000 7f9187fff640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f917006ae70 0x7f917006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:03.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.987+0000 7f9187fff640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f917006ae70 0x7f917006d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9178036000 tx=0x7f917803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:03.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:03.991+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91800549d0 con 0x7f919006c760 2023-10-16T08:53:04.255 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.253+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f91900665e0 con 0x7f919006c760 2023-10-16T08:53:04.260 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.258+0000 7f918d7fa640 1 -- 172.21.15.94:0/3115739551 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9180057ff0 con 0x7f919006c760 2023-10-16T08:53:04.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f917006ae70 msgr2=0x7f917006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f917006ae70 0x7f917006d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9178036000 tx=0x7f917803d040 comp rx=0 tx=0).stop 2023-10-16T08:53:04.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 msgr2=0x7f91901ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91901ef770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f918000c7f0 tx=0x7f918000ccb0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 shutdown_connections 2023-10-16T08:53:04.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f917006ae70 0x7f917006d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919015aa60 0x7f91901f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91900b06f0 0x7f91901f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 --2- 172.21.15.94:0/3115739551 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919006c760 0x7f91901ef770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.261+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 >> 172.21.15.94:0/3115739551 conn(0x7f91900cb1b0 msgr2=0x7f91900b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:04.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.262+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 shutdown_connections 2023-10-16T08:53:04.266 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.262+0000 7f9196741640 1 -- 172.21.15.94:0/3115739551 wait complete. 2023-10-16T08:53:04.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T08:53:04.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.492+0000 7f6d51fa9640 1 Processor -- start 2023-10-16T08:53:04.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.492+0000 7f6d51fa9640 1 -- start start 2023-10-16T08:53:04.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d51fa9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 0x7f6d4c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d51fa9640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c15ae40 con 0x7f6d4c0b08c0 2023-10-16T08:53:04.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d51fa9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c0b1580 con 0x7f6d4c15aa60 2023-10-16T08:53:04.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d51fa9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c96f0 con 0x7f6d4c0c9260 2023-10-16T08:53:04.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d4affd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6d4c0b08c0 0x7f6d4c0b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:45942/0 (socket says 172.21.15.94:45942) 2023-10-16T08:53:04.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d4affd640 1 -- 172.21.15.94:0/2641307076 learned_addr learned my addr 172.21.15.94:0/2641307076 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:04.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967843854 0 0) 0x7f6d4c15ae40 con 0x7f6d4c0b08c0 2023-10-16T08:53:04.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d4bfff640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 0x7f6d4c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.494+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d34003520 con 0x7f6d4c0b08c0 2023-10-16T08:53:04.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196819069 0 0) 0x7f6d34003520 con 0x7f6d4c0b08c0 2023-10-16T08:53:04.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 msgr2=0x7f6d4c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:04.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 0x7f6d4c06c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 >> v1:172.21.15.130:6789/0 conn(0x7f6d4c15aa60 legacy=0x7f6d4c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0c98f0 con 0x7f6d4c0b08c0 2023-10-16T08:53:04.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f6d40001670 con 0x7f6d4c0b08c0 2023-10-16T08:53:04.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 >> v1:172.21.15.94:6789/0 conn(0x7f6d4c0b08c0 legacy=0x7f6d4c0b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 0x7f6d340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d34003f70 0x7f6d340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c96f0 con 0x7f6d34004d00 2023-10-16T08:53:04.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3400bb70 con 0x7f6d34003f70 2023-10-16T08:53:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3400bd30 con 0x7f6d4c0c9260 2023-10-16T08:53:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.495+0000 7f6d4bfff640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.496+0000 7f6d4bfff640 1 -- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 msgr2=0x7f6d340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.496+0000 7f6d4bfff640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c9260 0x7f6d340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.496+0000 7f6d4bfff640 1 -- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d34003f70 msgr2=0x7f6d340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.496+0000 7f6d4affd640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d34003f70 0x7f6d340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.496+0000 7f6d4bfff640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d34003f70 0x7f6d340047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.496+0000 7f6d4bfff640 1 -- 172.21.15.94:0/2641307076 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d34003520 con 0x7f6d34004d00 2023-10-16T08:53:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d4bfff640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d34005180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009fc0 tx=0x7f6d340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae84fe6380a13377 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4402cc60 con 0x7f6d34004d00 2023-10-16T08:53:04.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400f040 con 0x7f6d34004d00 2023-10-16T08:53:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d4a7fc640 1 -- 172.21.15.94:0/2641307076 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44034440 con 0x7f6d34004d00 2023-10-16T08:53:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d51fa9640 1 -- 172.21.15.94:0/2641307076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 msgr2=0x7f6d34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/2641307076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d34005180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009fc0 tx=0x7f6d340057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.497+0000 7f6d4bfff640 1 -- 172.21.15.94:0/2641307076 reap_dead start 2023-10-16T08:53:04.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.498+0000 7f6d51fa9640 1 -- 172.21.15.94:0/2641307076 shutdown_connections 2023-10-16T08:53:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.498+0000 7f6d51fa9640 1 -- 172.21.15.94:0/2641307076 >> 172.21.15.94:0/2641307076 conn(0x7f6d4c0cb1b0 msgr2=0x7f6d4c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.498+0000 7f6d51fa9640 1 -- 172.21.15.94:0/2641307076 shutdown_connections 2023-10-16T08:53:04.506 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.498+0000 7f6d51fa9640 1 -- 172.21.15.94:0/2641307076 wait complete. 2023-10-16T08:53:04.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.499+0000 7f6d51fa9640 1 Processor -- start 2023-10-16T08:53:04.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.500+0000 7f6d51fa9640 1 -- start start 2023-10-16T08:53:04.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.500+0000 7f6d51fa9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d4c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.500+0000 7f6d51fa9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c14d560 0x7f6d4c0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d51fa9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c72f0 0x7f6d4c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d51fa9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0ce090 con 0x7f6d34004d00 2023-10-16T08:53:04.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d51fa9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0ce2e0 con 0x7f6d4c14d560 2023-10-16T08:53:04.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d51fa9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c77f0 con 0x7f6d4c0c72f0 2023-10-16T08:53:04.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d4c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d4c0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:42146/0 (socket says 172.21.15.94:42146) 2023-10-16T08:53:04.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 -- 172.21.15.94:0/4053942025 learned_addr learned my addr 172.21.15.94:0/4053942025 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:04.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 -- 172.21.15.94:0/4053942025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c72f0 msgr2=0x7f6d4c14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c72f0 0x7f6d4c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 -- 172.21.15.94:0/4053942025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c14d560 msgr2=0x7f6d4c0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c14d560 0x7f6d4c0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 -- 172.21.15.94:0/4053942025 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0c7ad0 con 0x7f6d34004d00 2023-10-16T08:53:04.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.501+0000 7f6d4b7fe640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d4c0c85e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c450 tx=0x7f6d3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:04.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.502+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0052d0 con 0x7f6d34004d00 2023-10-16T08:53:04.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.502+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c005430 con 0x7f6d34004d00 2023-10-16T08:53:04.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.502+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c0c7db0 con 0x7f6d34004d00 2023-10-16T08:53:04.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.502+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c003830 con 0x7f6d34004d00 2023-10-16T08:53:04.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.502+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c14d0d0 con 0x7f6d34004d00 2023-10-16T08:53:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.503+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c0cafb0 con 0x7f6d34004d00 2023-10-16T08:53:04.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.504+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d3c003990 con 0x7f6d34004d00 2023-10-16T08:53:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.505+0000 7f6d33fff640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d3806ae70 0x7f6d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.505+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6d3c0889d0 con 0x7f6d34004d00 2023-10-16T08:53:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.505+0000 7f6d4affd640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d3806ae70 0x7f6d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.514 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.506+0000 7f6d4affd640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d3806ae70 0x7f6d3806d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001eb0 tx=0x7f6d40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:04.515 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.510+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d3c053c90 con 0x7f6d34004d00 2023-10-16T08:53:04.754 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.752+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6d4c14d350 con 0x7f6d34004d00 2023-10-16T08:53:04.759 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.757+0000 7f6d33fff640 1 -- 172.21.15.94:0/4053942025 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6d3c017020 con 0x7f6d34004d00 2023-10-16T08:53:04.761 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d3806ae70 msgr2=0x7f6d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d3806ae70 0x7f6d3806d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001eb0 tx=0x7f6d40009040 comp rx=0 tx=0).stop 2023-10-16T08:53:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 msgr2=0x7f6d4c0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d4c0c85e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c450 tx=0x7f6d3c00c910 comp rx=0 tx=0).stop 2023-10-16T08:53:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 shutdown_connections 2023-10-16T08:53:04.762 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d4c0c72f0 0x7f6d4c14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6d3806ae70 0x7f6d3806d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.759+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d4c14d560 0x7f6d4c0c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.760+0000 7f6d51fa9640 1 --2- 172.21.15.94:0/4053942025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d34004d00 0x7f6d4c0c85e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.763 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.760+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 >> 172.21.15.94:0/4053942025 conn(0x7f6d4c0cb1b0 msgr2=0x7f6d4c0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:04.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.760+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 shutdown_connections 2023-10-16T08:53:04.764 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.760+0000 7f6d51fa9640 1 -- 172.21.15.94:0/4053942025 wait complete. 2023-10-16T08:53:04.777 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T08:53:04.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.977+0000 7f369604f640 1 Processor -- start 2023-10-16T08:53:04.979 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.977+0000 7f369604f640 1 -- start start 2023-10-16T08:53:04.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.978+0000 7f369604f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f36900c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f369604f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369006cbf0 con 0x7f369006c760 2023-10-16T08:53:04.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f369604f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369015ae40 con 0x7f369015aa60 2023-10-16T08:53:04.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f369604f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900b1580 con 0x7f36900b08c0 2023-10-16T08:53:04.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f368ffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f369006c760 0x7f36900b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56492/0 (socket says 172.21.15.94:56492) 2023-10-16T08:53:04.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f368ffff640 1 -- 172.21.15.94:0/1695733982 learned_addr learned my addr 172.21.15.94:0/1695733982 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:04.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868333215 0 0) 0x7f369006cbf0 con 0x7f369006c760 2023-10-16T08:53:04.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f367c003520 con 0x7f369006c760 2023-10-16T08:53:04.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.979+0000 7f3687fff640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f36900c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 192247892 0 0) 0x7f367c003520 con 0x7f369006c760 2023-10-16T08:53:04.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 msgr2=0x7f36900c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:04.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f36900c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 >> v1:172.21.15.130:6789/0 conn(0x7f369015aa60 legacy=0x7f36900b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900c98f0 con 0x7f369006c760 2023-10-16T08:53:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f36880019f0 con 0x7f369006c760 2023-10-16T08:53:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 >> v1:172.21.15.94:6789/0 conn(0x7f369006c760 legacy=0x7f36900b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f367c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f367c003fd0 0x7f367c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f367c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900b1580 con 0x7f367c004d00 2023-10-16T08:53:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c00bbc0 con 0x7f367c003fd0 2023-10-16T08:53:04.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c00bd80 con 0x7f36900b08c0 2023-10-16T08:53:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368ffff640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f367c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368f7fe640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f367c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368ffff640 1 -- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 msgr2=0x7f367c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f368ffff640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f367c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.988 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.980+0000 7f3687fff640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f367c003fd0 0x7f367c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.981+0000 7f368ffff640 1 -- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f367c003fd0 msgr2=0x7f367c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.981+0000 7f368ffff640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f367c003fd0 0x7f367c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.981+0000 7f368ffff640 1 -- 172.21.15.94:0/1695733982 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c003520 con 0x7f367c004d00 2023-10-16T08:53:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.981+0000 7f368f7fe640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900b08c0 0x7f367c0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:04.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f368ffff640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f367c005180 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f368800a830 tx=0x7f367c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad64cbf3b3834def server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:04.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880072d0 con 0x7f367c004d00 2023-10-16T08:53:04.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368802f070 con 0x7f367c004d00 2023-10-16T08:53:04.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f368effd640 1 -- 172.21.15.94:0/1695733982 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880076f0 con 0x7f367c004d00 2023-10-16T08:53:04.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f369604f640 1 -- 172.21.15.94:0/1695733982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 msgr2=0x7f367c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f369604f640 1 --2- 172.21.15.94:0/1695733982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f367c005180 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f368800a830 tx=0x7f367c0057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f368ffff640 1 -- 172.21.15.94:0/1695733982 reap_dead start 2023-10-16T08:53:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f369604f640 1 -- 172.21.15.94:0/1695733982 shutdown_connections 2023-10-16T08:53:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f369604f640 1 -- 172.21.15.94:0/1695733982 >> 172.21.15.94:0/1695733982 conn(0x7f36900cb1b0 msgr2=0x7f36900cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.982+0000 7f369604f640 1 -- 172.21.15.94:0/1695733982 shutdown_connections 2023-10-16T08:53:04.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.983+0000 7f369604f640 1 -- 172.21.15.94:0/1695733982 wait complete. 2023-10-16T08:53:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.984+0000 7f369604f640 1 Processor -- start 2023-10-16T08:53:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.984+0000 7f369604f640 1 -- start start 2023-10-16T08:53:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f369604f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f3690157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f369604f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36900cc0b0 0x7f36900cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f369604f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900cc530 0x7f36900cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f369604f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690157590 con 0x7f367c004d00 2023-10-16T08:53:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f369604f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900ccb00 con 0x7f36900cc0b0 2023-10-16T08:53:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f369604f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900ccde0 con 0x7f36900cc530 2023-10-16T08:53:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f368f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f3690157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f368f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f3690157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33204/0 (socket says 172.21.15.94:33204) 2023-10-16T08:53:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.985+0000 7f368f7fe640 1 -- 172.21.15.94:0/2823868054 learned_addr learned my addr 172.21.15.94:0/2823868054 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368f7fe640 1 -- 172.21.15.94:0/2823868054 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900cc530 msgr2=0x7f36900cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368f7fe640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900cc530 0x7f36900cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368f7fe640 1 -- 172.21.15.94:0/2823868054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36900cc0b0 msgr2=0x7f36900cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368f7fe640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36900cc0b0 0x7f36900cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368f7fe640 1 -- 172.21.15.94:0/2823868054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900cd0c0 con 0x7f367c004d00 2023-10-16T08:53:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368f7fe640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f3690157050 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f368000d770 tx=0x7f368000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680005270 con 0x7f367c004d00 2023-10-16T08:53:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36800053d0 con 0x7f367c004d00 2023-10-16T08:53:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000b870 con 0x7f367c004d00 2023-10-16T08:53:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.986+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36900cd3a0 con 0x7f367c004d00 2023-10-16T08:53:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.987+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36900c7710 con 0x7f367c004d00 2023-10-16T08:53:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.988+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900cafb0 con 0x7f367c004d00 2023-10-16T08:53:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.988+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f368000b9d0 con 0x7f367c004d00 2023-10-16T08:53:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.989+0000 7f368cff9640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f367006ae70 0x7f367006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.989+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3680089410 con 0x7f367c004d00 2023-10-16T08:53:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.989+0000 7f3687fff640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f367006ae70 0x7f367006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:04.999 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.990+0000 7f3687fff640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f367006ae70 0x7f367006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3678006a90 tx=0x7f3678006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:04.994+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3680054630 con 0x7f367c004d00 2023-10-16T08:53:05.235 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.233+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f3690073ef0 con 0x7f367c004d00 2023-10-16T08:53:05.239 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.238+0000 7f368cff9640 1 -- 172.21.15.94:0/2823868054 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3680057c50 con 0x7f367c004d00 2023-10-16T08:53:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f367006ae70 msgr2=0x7f367006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.242 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f367006ae70 0x7f367006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3678006a90 tx=0x7f3678006a20 comp rx=0 tx=0).stop 2023-10-16T08:53:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 msgr2=0x7f3690157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f3690157050 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f368000d770 tx=0x7f368000dc30 comp rx=0 tx=0).stop 2023-10-16T08:53:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 shutdown_connections 2023-10-16T08:53:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f36900cc530 0x7f36900cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.243 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f367006ae70 0x7f367006d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36900cc0b0 0x7f36900cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 --2- 172.21.15.94:0/2823868054 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f367c004d00 0x7f3690157050 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 >> 172.21.15.94:0/2823868054 conn(0x7f36900cb1b0 msgr2=0x7f3690158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:05.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 shutdown_connections 2023-10-16T08:53:05.244 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.240+0000 7f369604f640 1 -- 172.21.15.94:0/2823868054 wait complete. 2023-10-16T08:53:05.261 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:53:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.472+0000 7f427ee7c640 1 Processor -- start 2023-10-16T08:53:05.474 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.472+0000 7f427ee7c640 1 -- start start 2023-10-16T08:53:05.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427ee7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f427815ad00 0x7f42780701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427ee7c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f427815f040 0x7f427815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.476 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427ee7c640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780707f0 con 0x7f42780b0010 2023-10-16T08:53:05.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427ee7c640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4278070ad0 con 0x7f427815f040 2023-10-16T08:53:05.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427ee7c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427815b1d0 con 0x7f427815ad00 2023-10-16T08:53:05.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427cc18640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f42780b0010 0x7f42780b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56504/0 (socket says 172.21.15.94:56504) 2023-10-16T08:53:05.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427cc18640 1 -- 172.21.15.94:0/4016681826 learned_addr learned my addr 172.21.15.94:0/4016681826 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:05.477 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427d419640 1 --2- 172.21.15.94:0/4016681826 >> v2:172.21.15.94:3300/0 conn(0x7f427815f040 0x7f427815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f42777fe640 1 -- 172.21.15.94:0/4016681826 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187696746 0 0) 0x7f42780707f0 con 0x7f42780b0010 2023-10-16T08:53:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f42777fe640 1 -- 172.21.15.94:0/4016681826 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4268003520 con 0x7f42780b0010 2023-10-16T08:53:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f4277fff640 1 --2- 172.21.15.94:0/4016681826 >> v2:172.21.15.130:3300/0 conn(0x7f427815ad00 0x7f42780701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427d419640 1 -- 172.21.15.94:0/4016681826 >> v2:172.21.15.130:3300/0 conn(0x7f427815ad00 msgr2=0x7f42780701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427d419640 1 --2- 172.21.15.94:0/4016681826 >> v2:172.21.15.130:3300/0 conn(0x7f427815ad00 0x7f42780701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.474+0000 7f427d419640 1 -- 172.21.15.94:0/4016681826 >> v1:172.21.15.94:6789/0 conn(0x7f42780b0010 legacy=0x7f42780b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.479 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.475+0000 7f427d419640 1 -- 172.21.15.94:0/4016681826 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427815b4b0 con 0x7f427815f040 2023-10-16T08:53:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427d419640 1 --2- 172.21.15.94:0/4016681826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815f040 0x7f427815b9d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f42780ce400 tx=0x7f427002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41573cc0877a2e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f42777fe640 1 -- 172.21.15.94:0/4016681826 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427002cc80 con 0x7f427815f040 2023-10-16T08:53:05.480 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f42777fe640 1 -- 172.21.15.94:0/4016681826 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427002cde0 con 0x7f427815f040 2023-10-16T08:53:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f42777fe640 1 -- 172.21.15.94:0/4016681826 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270034660 con 0x7f427815f040 2023-10-16T08:53:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427ee7c640 1 -- 172.21.15.94:0/4016681826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815f040 msgr2=0x7f427815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427ee7c640 1 --2- 172.21.15.94:0/4016681826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815f040 0x7f427815b9d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f42780ce400 tx=0x7f427002bed0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427ee7c640 1 -- 172.21.15.94:0/4016681826 shutdown_connections 2023-10-16T08:53:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427ee7c640 1 --2- 172.21.15.94:0/4016681826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815f040 0x7f427815b9d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427ee7c640 1 --2- 172.21.15.94:0/4016681826 >> v2:172.21.15.130:3300/0 conn(0x7f427815ad00 0x7f42780701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.476+0000 7f427ee7c640 1 -- 172.21.15.94:0/4016681826 >> 172.21.15.94:0/4016681826 conn(0x7f427806c1c0 msgr2=0x7f427806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.477+0000 7f427ee7c640 1 -- 172.21.15.94:0/4016681826 shutdown_connections 2023-10-16T08:53:05.482 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.477+0000 7f427ee7c640 1 -- 172.21.15.94:0/4016681826 wait complete. 2023-10-16T08:53:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.478+0000 7f427ee7c640 1 Processor -- start 2023-10-16T08:53:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.478+0000 7f427ee7c640 1 -- start start 2023-10-16T08:53:05.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.479+0000 7f427ee7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42780b0010 0x7f42780c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.479+0000 7f427ee7c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 0x7f427814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.485 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.479+0000 7f427ee7c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f427815f040 0x7f427815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.479+0000 7f427ee7c640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427814c400 con 0x7f427815ad00 2023-10-16T08:53:05.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.479+0000 7f427ee7c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c63e0 con 0x7f42780b0010 2023-10-16T08:53:05.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.479+0000 7f427ee7c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c66c0 con 0x7f427815f040 2023-10-16T08:53:05.486 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 0x7f427814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 0x7f427814bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33230/0 (socket says 172.21.15.94:33230) 2023-10-16T08:53:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 -- 172.21.15.94:0/573900194 learned_addr learned my addr 172.21.15.94:0/573900194 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 -- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f427815f040 msgr2=0x7f427815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f427d419640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f427815f040 0x7f427815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f427cc18640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42780b0010 0x7f42780c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f427815f040 0x7f427815da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 -- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42780b0010 msgr2=0x7f42780c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42780b0010 0x7f42780c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 -- 172.21.15.94:0/573900194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009a70 con 0x7f427815ad00 2023-10-16T08:53:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.480+0000 7f4277fff640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 0x7f427814bec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f426400c7f0 tx=0x7f426400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.481+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264004220 con 0x7f427815ad00 2023-10-16T08:53:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.481+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264004380 con 0x7f427815ad00 2023-10-16T08:53:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.481+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264007840 con 0x7f427815ad00 2023-10-16T08:53:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.481+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780c69a0 con 0x7f427815ad00 2023-10-16T08:53:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.481+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780c6f60 con 0x7f427815ad00 2023-10-16T08:53:05.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.482+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42780c7150 con 0x7f427815ad00 2023-10-16T08:53:05.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.483+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4264007bb0 con 0x7f427815ad00 2023-10-16T08:53:05.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.484+0000 7f42757fa640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f425c06ae70 0x7f425c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.484+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4264089370 con 0x7f427815ad00 2023-10-16T08:53:05.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.484+0000 7f427cc18640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f425c06ae70 0x7f425c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.491 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.485+0000 7f427cc18640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f425c06ae70 0x7f425c06d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f426c0011e0 tx=0x7f426c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.488+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4264054630 con 0x7f427815ad00 2023-10-16T08:53:05.684 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.683+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4278073ef0 con 0x7f427815ad00 2023-10-16T08:53:05.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.685+0000 7f42757fa640 1 -- 172.21.15.94:0/573900194 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13050 (secure 0 0 0) 0x7f4264007e60 con 0x7f427815ad00 2023-10-16T08:53:05.687 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:05.687 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":37,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:53:01.679687+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:53:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.687+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f425c06ae70 msgr2=0x7f425c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.687+0000 7f427ee7c640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f425c06ae70 0x7f425c06d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f426c0011e0 tx=0x7f426c009040 comp rx=0 tx=0).stop 2023-10-16T08:53:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.687+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 msgr2=0x7f427814bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.687+0000 7f427ee7c640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 0x7f427814bec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f426400c7f0 tx=0x7f426400ccb0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.690 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 shutdown_connections 2023-10-16T08:53:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f427815f040 0x7f427815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427815ad00 0x7f427814bec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f425c06ae70 0x7f425c06d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 --2- 172.21.15.94:0/573900194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42780b0010 0x7f42780c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.691 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 >> 172.21.15.94:0/573900194 conn(0x7f427806c1c0 msgr2=0x7f4278159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:05.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 shutdown_connections 2023-10-16T08:53:05.692 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.688+0000 7f427ee7c640 1 -- 172.21.15.94:0/573900194 wait complete. 2023-10-16T08:53:05.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T08:51:07.884479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T08:53:05.709 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T08:53:05.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.922+0000 7f8a1910f640 1 Processor -- start 2023-10-16T08:53:05.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.922+0000 7f8a1910f640 1 -- start start 2023-10-16T08:53:05.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a1910f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8a14159890 0x7f8a14071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a1910f640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a140ca5a0 0x7f8a1415db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a1910f640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14072480 con 0x7f8a140ca110 2023-10-16T08:53:05.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a1910f640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140cd0c0 con 0x7f8a140ca5a0 2023-10-16T08:53:05.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a1910f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140caa10 con 0x7f8a14159890 2023-10-16T08:53:05.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a0bfff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8a140ca110 0x7f8a1415d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56508/0 (socket says 172.21.15.94:56508) 2023-10-16T08:53:05.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a0bfff640 1 -- 172.21.15.94:0/4108880696 learned_addr learned my addr 172.21.15.94:0/4108880696 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:05.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.924+0000 7f8a1359e640 1 --2- 172.21.15.94:0/4108880696 >> v2:172.21.15.94:3300/0 conn(0x7f8a140ca5a0 0x7f8a1415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a12d9d640 1 --2- 172.21.15.94:0/4108880696 >> v2:172.21.15.130:3300/0 conn(0x7f8a14159890 0x7f8a14071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a1259c640 1 -- 172.21.15.94:0/4108880696 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653027000 0 0) 0x7f8a14072480 con 0x7f8a140ca110 2023-10-16T08:53:05.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a1259c640 1 -- 172.21.15.94:0/4108880696 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f4003520 con 0x7f8a140ca110 2023-10-16T08:53:05.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a1359e640 1 -- 172.21.15.94:0/4108880696 >> v2:172.21.15.130:3300/0 conn(0x7f8a14159890 msgr2=0x7f8a14071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:05.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a1359e640 1 --2- 172.21.15.94:0/4108880696 >> v2:172.21.15.130:3300/0 conn(0x7f8a14159890 0x7f8a14071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a1359e640 1 -- 172.21.15.94:0/4108880696 >> v1:172.21.15.94:6789/0 conn(0x7f8a140ca110 legacy=0x7f8a1415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.925+0000 7f8a1359e640 1 -- 172.21.15.94:0/4108880696 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140cc540 con 0x7f8a140ca5a0 2023-10-16T08:53:05.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.926+0000 7f8a1359e640 1 --2- 172.21.15.94:0/4108880696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca5a0 0x7f8a1415db00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8a1406e450 tx=0x7f8a0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f007f4af74865194 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.926+0000 7f8a1259c640 1 -- 172.21.15.94:0/4108880696 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c02cc80 con 0x7f8a140ca5a0 2023-10-16T08:53:05.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.926+0000 7f8a1259c640 1 -- 172.21.15.94:0/4108880696 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c02cde0 con 0x7f8a140ca5a0 2023-10-16T08:53:05.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.926+0000 7f8a1259c640 1 -- 172.21.15.94:0/4108880696 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c034660 con 0x7f8a140ca5a0 2023-10-16T08:53:05.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 -- 172.21.15.94:0/4108880696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca5a0 msgr2=0x7f8a1415db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 --2- 172.21.15.94:0/4108880696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca5a0 0x7f8a1415db00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8a1406e450 tx=0x7f8a0c02bed0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 -- 172.21.15.94:0/4108880696 shutdown_connections 2023-10-16T08:53:05.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 --2- 172.21.15.94:0/4108880696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca5a0 0x7f8a1415db00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 --2- 172.21.15.94:0/4108880696 >> v2:172.21.15.130:3300/0 conn(0x7f8a14159890 0x7f8a14071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 -- 172.21.15.94:0/4108880696 >> 172.21.15.94:0/4108880696 conn(0x7f8a140b0030 msgr2=0x7f8a140b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:05.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 -- 172.21.15.94:0/4108880696 shutdown_connections 2023-10-16T08:53:05.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.927+0000 7f8a1910f640 1 -- 172.21.15.94:0/4108880696 wait complete. 2023-10-16T08:53:05.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.929+0000 7f8a1910f640 1 Processor -- start 2023-10-16T08:53:05.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.929+0000 7f8a1910f640 1 -- start start 2023-10-16T08:53:05.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a1910f640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 0x7f8a141462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a1910f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a140ca5a0 0x7f8a140c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a1910f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a14159890 0x7f8a1415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a1910f640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1415bf30 con 0x7f8a140ca110 2023-10-16T08:53:05.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a1910f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a14149ac0 con 0x7f8a140ca5a0 2023-10-16T08:53:05.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a1910f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a141467e0 con 0x7f8a14159890 2023-10-16T08:53:05.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a12d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 0x7f8a141462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a12d9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 0x7f8a141462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33250/0 (socket says 172.21.15.94:33250) 2023-10-16T08:53:05.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.930+0000 7f8a12d9d640 1 -- 172.21.15.94:0/3400664627 learned_addr learned my addr 172.21.15.94:0/3400664627 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:05.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a1359e640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a14159890 0x7f8a1415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a12d9d640 1 -- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a14159890 msgr2=0x7f8a1415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a0bfff640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a140ca5a0 0x7f8a140c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.937 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a12d9d640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a14159890 0x7f8a1415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a12d9d640 1 -- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a140ca5a0 msgr2=0x7f8a140c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:05.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a12d9d640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a140ca5a0 0x7f8a140c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:05.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a12d9d640 1 -- 172.21.15.94:0/3400664627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009a70 con 0x7f8a140ca110 2023-10-16T08:53:05.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a1359e640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a14159890 0x7f8a1415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:05.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a12d9d640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 0x7f8a141462a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400d800 tx=0x7f8a0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.938 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400b6c0 con 0x7f8a140ca110 2023-10-16T08:53:05.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400b820 con 0x7f8a140ca110 2023-10-16T08:53:05.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400bbb0 con 0x7f8a140ca110 2023-10-16T08:53:05.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.931+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140c4eb0 con 0x7f8a140ca110 2023-10-16T08:53:05.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.932+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1415b630 con 0x7f8a140ca110 2023-10-16T08:53:05.939 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.933+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a14073ef0 con 0x7f8a140ca110 2023-10-16T08:53:05.940 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.934+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a0400bd10 con 0x7f8a140ca110 2023-10-16T08:53:05.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.935+0000 7f8a0b7fe640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f89f806ae70 0x7f89f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:05.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.935+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8a040896b0 con 0x7f8a140ca110 2023-10-16T08:53:05.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.935+0000 7f8a0bfff640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f89f806ae70 0x7f89f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:05.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.936+0000 7f8a0bfff640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f89f806ae70 0x7f89f806d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8a140b2ac0 tx=0x7f89fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:05.941 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:05.939+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a04054a00 con 0x7f8a140ca110 2023-10-16T08:53:06.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.114+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a140cd290 con 0x7f8a140ca110 2023-10-16T08:53:06.116 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.115+0000 7f8a0b7fe640 1 -- 172.21.15.94:0/3400664627 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a04058020 con 0x7f8a140ca110 2023-10-16T08:53:06.117 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2023-10-16T08:53:06.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f89f806ae70 msgr2=0x7f89f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f89f806ae70 0x7f89f806d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8a140b2ac0 tx=0x7f89fc009040 comp rx=0 tx=0).stop 2023-10-16T08:53:06.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 msgr2=0x7f8a141462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 0x7f8a141462a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400d800 tx=0x7f8a0400dcc0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.122 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 shutdown_connections 2023-10-16T08:53:06.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a14159890 0x7f8a1415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f89f806ae70 0x7f89f806d330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a140ca5a0 0x7f8a140c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.123 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 --2- 172.21.15.94:0/3400664627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a140ca110 0x7f8a141462a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.117+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 >> 172.21.15.94:0/3400664627 conn(0x7f8a140b0030 msgr2=0x7f8a140cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:06.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.118+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 shutdown_connections 2023-10-16T08:53:06.124 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.118+0000 7f8a1910f640 1 -- 172.21.15.94:0/3400664627 wait complete. 2023-10-16T08:53:06.136 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T08:53:06.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.340+0000 7fb2dcaec640 1 Processor -- start 2023-10-16T08:53:06.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.340+0000 7fb2dcaec640 1 -- start start 2023-10-16T08:53:06.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.342+0000 7fb2dcaec640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb2d80701a0 0x7fb2d815f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.342+0000 7fb2dcaec640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d815f580 con 0x7fb2d815ad00 2023-10-16T08:53:06.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.342+0000 7fb2dcaec640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80707f0 con 0x7fb2d80b0010 2023-10-16T08:53:06.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.342+0000 7fb2dcaec640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80705d0 con 0x7fb2d80701a0 2023-10-16T08:53:06.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.342+0000 7fb2cffff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb2d815ad00 0x7fb2d815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56520/0 (socket says 172.21.15.94:56520) 2023-10-16T08:53:06.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.342+0000 7fb2cffff640 1 -- 172.21.15.94:0/1166270127 learned_addr learned my addr 172.21.15.94:0/1166270127 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:06.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/1166270127 >> v2:172.21.15.130:3300/0 conn(0x7fb2d80701a0 0x7fb2d815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678230590 0 0) 0x7fb2c0001110 con 0x7fb2d815ad00 2023-10-16T08:53:06.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4003520 con 0x7fb2d815ad00 2023-10-16T08:53:06.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720695283 0 0) 0x7fb2c4003520 con 0x7fb2d815ad00 2023-10-16T08:53:06.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 >> v2:172.21.15.130:3300/0 conn(0x7fb2d80701a0 msgr2=0x7fb2d815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:06.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 --2- 172.21.15.94:0/1166270127 >> v2:172.21.15.130:3300/0 conn(0x7fb2d80701a0 0x7fb2d815f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 >> v1:172.21.15.130:6789/0 conn(0x7fb2d80b0010 legacy=0x7fb2d80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8070ad0 con 0x7fb2d815ad00 2023-10-16T08:53:06.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7fb2c0001800 con 0x7fb2d815ad00 2023-10-16T08:53:06.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 >> v1:172.21.15.94:6789/0 conn(0x7fb2d815ad00 legacy=0x7fb2d815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2c4003a30 0x7fb2c4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2c40047c0 0x7fb2c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.343+0000 7fb2d5d9b640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80705d0 con 0x7fb2c40051d0 2023-10-16T08:53:06.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400c100 con 0x7fb2c4003a30 2023-10-16T08:53:06.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400c2c0 con 0x7fb2c40047c0 2023-10-16T08:53:06.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d659c640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2c4003a30 0x7fb2c4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d6d9d640 1 -- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2c40047c0 msgr2=0x7fb2c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:06.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2c40047c0 0x7fb2c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d6d9d640 1 -- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2c4003a30 msgr2=0x7fb2c4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:06.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2c4003a30 0x7fb2c4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d6d9d640 1 -- 172.21.15.94:0/1166270127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4003520 con 0x7fb2c40051d0 2023-10-16T08:53:06.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.344+0000 7fb2d659c640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2c4003a30 0x7fb2c4003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:06.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.345+0000 7fb2d6d9d640 1 -- 172.21.15.94:0/1166270127 reap_dead start 2023-10-16T08:53:06.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.345+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2c400b980 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009fc0 tx=0x7fb2c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41ce2e6587956aa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:06.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.345+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d002cc60 con 0x7fb2c40051d0 2023-10-16T08:53:06.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.345+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000f040 con 0x7fb2c40051d0 2023-10-16T08:53:06.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.345+0000 7fb2d5d9b640 1 -- 172.21.15.94:0/1166270127 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0003990 con 0x7fb2c40051d0 2023-10-16T08:53:06.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 -- 172.21.15.94:0/1166270127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 msgr2=0x7fb2c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2c400b980 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009fc0 tx=0x7fb2c40057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 -- 172.21.15.94:0/1166270127 shutdown_connections 2023-10-16T08:53:06.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/1166270127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2c400b980 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 -- 172.21.15.94:0/1166270127 >> 172.21.15.94:0/1166270127 conn(0x7fb2d806c1c0 msgr2=0x7fb2d806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:06.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 -- 172.21.15.94:0/1166270127 shutdown_connections 2023-10-16T08:53:06.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.346+0000 7fb2dcaec640 1 -- 172.21.15.94:0/1166270127 wait complete. 2023-10-16T08:53:06.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.348+0000 7fb2dcaec640 1 Processor -- start 2023-10-16T08:53:06.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.348+0000 7fb2dcaec640 1 -- start start 2023-10-16T08:53:06.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2dcaec640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2d80c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2dcaec640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2d80c2530 0x7fb2d815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2dcaec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d815dca0 0x7fb2d8148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2dcaec640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c6a10 con 0x7fb2c40051d0 2023-10-16T08:53:06.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2dcaec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c6cf0 con 0x7fb2d815dca0 2023-10-16T08:53:06.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2dcaec640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c5ba0 con 0x7fb2d80c2530 2023-10-16T08:53:06.359 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2d659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2d80c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2d659c640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2d80c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33266/0 (socket says 172.21.15.94:33266) 2023-10-16T08:53:06.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.349+0000 7fb2d659c640 1 -- 172.21.15.94:0/385233709 learned_addr learned my addr 172.21.15.94:0/385233709 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:06.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d815dca0 0x7fb2d8148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2cffff640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2d80c2530 0x7fb2d815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d659c640 1 -- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2d80c2530 msgr2=0x7fb2d815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d659c640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2d80c2530 0x7fb2d815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d659c640 1 -- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d815dca0 msgr2=0x7fb2d8148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d659c640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d815dca0 0x7fb2d8148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d659c640 1 -- 172.21.15.94:0/385233709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80c5e70 con 0x7fb2c40051d0 2023-10-16T08:53:06.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2cffff640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2d80c2530 0x7fb2d815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:06.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d6d9d640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d815dca0 0x7fb2d8148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:06.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2d659c640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2d80c5660 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d7d0 tx=0x7fb2c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:06.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8017070 con 0x7fb2c40051d0 2023-10-16T08:53:06.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8005070 con 0x7fb2c40051d0 2023-10-16T08:53:06.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8005440 con 0x7fb2c40051d0 2023-10-16T08:53:06.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.350+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d80c6150 con 0x7fb2c40051d0 2023-10-16T08:53:06.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.351+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d8148fb0 con 0x7fb2c40051d0 2023-10-16T08:53:06.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.352+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d8073ef0 con 0x7fb2c40051d0 2023-10-16T08:53:06.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.353+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb2c8007030 con 0x7fb2c40051d0 2023-10-16T08:53:06.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.354+0000 7fb2ceffd640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb2b806aea0 0x7fb2b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.354+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb2c8088c30 con 0x7fb2c40051d0 2023-10-16T08:53:06.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.354+0000 7fb2cffff640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb2b806aea0 0x7fb2b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.354+0000 7fb2cffff640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb2b806aea0 0x7fb2b806d360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0001370 tx=0x7fb2c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:06.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.358+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2c8053f80 con 0x7fb2c40051d0 2023-10-16T08:53:06.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.547+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb2d815bcb0 con 0x7fb2c40051d0 2023-10-16T08:53:06.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.548+0000 7fb2ceffd640 1 -- 172.21.15.94:0/385233709 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb2c80575a0 con 0x7fb2c40051d0 2023-10-16T08:53:06.551 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:06.551 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2023-10-16T08:53:06.551 INFO:teuthology.orchestra.run.smithi094.stdout: { 2023-10-16T08:53:06.551 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2023-10-16T08:53:06.551 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2023-10-16T08:53:06.552 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:06.552 INFO:teuthology.orchestra.run.smithi094.stdout:] 2023-10-16T08:53:06.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb2b806aea0 msgr2=0x7fb2b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb2b806aea0 0x7fb2b806d360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0001370 tx=0x7fb2c0009040 comp rx=0 tx=0).stop 2023-10-16T08:53:06.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 msgr2=0x7fb2d80c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2d80c5660 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d7d0 tx=0x7fb2c800dc90 comp rx=0 tx=0).stop 2023-10-16T08:53:06.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 shutdown_connections 2023-10-16T08:53:06.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb2b806aea0 0x7fb2b806d360 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d815dca0 0x7fb2d8148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb2d80c2530 0x7fb2d815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 --2- 172.21.15.94:0/385233709 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2c40051d0 0x7fb2d80c5660 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.551+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 >> 172.21.15.94:0/385233709 conn(0x7fb2d806c1c0 msgr2=0x7fb2d80aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:06.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.552+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 shutdown_connections 2023-10-16T08:53:06.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.552+0000 7fb2dcaec640 1 -- 172.21.15.94:0/385233709 wait complete. 2023-10-16T08:53:06.573 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-16T08:53:06.574 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-16T08:53:06.793 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.791+0000 7f70d1fa7640 1 Processor -- start 2023-10-16T08:53:06.794 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.792+0000 7f70d1fa7640 1 -- start start 2023-10-16T08:53:06.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d1fa7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0cb400 0x7f70cc15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.795 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d1fa7640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f70cc0c8930 0x7f70cc0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d1fa7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0c8e40 con 0x7f70cc070400 2023-10-16T08:53:06.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d1fa7640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0c9090 con 0x7f70cc0c8930 2023-10-16T08:53:06.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d1fa7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c9370 con 0x7f70cc0cb400 2023-10-16T08:53:06.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d0fa5640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f70cc070400 0x7f70cc0cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56534/0 (socket says 172.21.15.94:56534) 2023-10-16T08:53:06.796 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.793+0000 7f70d0fa5640 1 -- 172.21.15.94:0/594444493 learned_addr learned my addr 172.21.15.94:0/594444493 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:06.797 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70d17a6640 1 --2- 172.21.15.94:0/594444493 >> v2:172.21.15.94:3300/0 conn(0x7f70cc0c8930 0x7f70cc0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70cbfff640 1 --2- 172.21.15.94:0/594444493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0cb400 0x7f70cc15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.798 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70d17a6640 1 -- 172.21.15.94:0/594444493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0cb400 msgr2=0x7f70cc15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:06.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70d17a6640 1 --2- 172.21.15.94:0/594444493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0cb400 0x7f70cc15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70d17a6640 1 -- 172.21.15.94:0/594444493 >> v1:172.21.15.94:6789/0 conn(0x7f70cc070400 legacy=0x7f70cc0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70d17a6640 1 -- 172.21.15.94:0/594444493 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0c9650 con 0x7f70cc0c8930 2023-10-16T08:53:06.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.794+0000 7f70cb7fe640 1 -- 172.21.15.94:0/594444493 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030922851 0 0) 0x7f70cc0c8e40 con 0x7f70cc070400 2023-10-16T08:53:06.799 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.795+0000 7f70d17a6640 1 --2- 172.21.15.94:0/594444493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0c8930 0x7f70cc0707e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097a0 tx=0x7f70c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0cdd43a6f28187 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:06.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70cb7fe640 1 -- 172.21.15.94:0/594444493 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4031830 con 0x7f70cc0c8930 2023-10-16T08:53:06.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70cb7fe640 1 -- 172.21.15.94:0/594444493 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4031990 con 0x7f70cc0c8930 2023-10-16T08:53:06.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70cb7fe640 1 -- 172.21.15.94:0/594444493 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4031d20 con 0x7f70cc0c8930 2023-10-16T08:53:06.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 -- 172.21.15.94:0/594444493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0c8930 msgr2=0x7f70cc0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.800 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/594444493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0c8930 0x7f70cc0707e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097a0 tx=0x7f70c402b8d0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 -- 172.21.15.94:0/594444493 shutdown_connections 2023-10-16T08:53:06.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/594444493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0c8930 0x7f70cc0707e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/594444493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0cb400 0x7f70cc15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 -- 172.21.15.94:0/594444493 >> 172.21.15.94:0/594444493 conn(0x7f70cc06a470 msgr2=0x7f70cc0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:06.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 -- 172.21.15.94:0/594444493 shutdown_connections 2023-10-16T08:53:06.801 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.796+0000 7f70d1fa7640 1 -- 172.21.15.94:0/594444493 wait complete. 2023-10-16T08:53:06.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.798+0000 7f70d1fa7640 1 Processor -- start 2023-10-16T08:53:06.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.798+0000 7f70d1fa7640 1 -- start start 2023-10-16T08:53:06.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d1fa7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70cc070400 0x7f70cc0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.804 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d1fa7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0c8930 0x7f70cc0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d1fa7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 0x7f70cc0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d1fa7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0b3650 con 0x7f70cc0cb400 2023-10-16T08:53:06.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d1fa7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc14d360 con 0x7f70cc070400 2023-10-16T08:53:06.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d1fa7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c1e10 con 0x7f70cc0c8930 2023-10-16T08:53:06.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d17a6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 0x7f70cc0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.805 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d17a6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 0x7f70cc0b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33282/0 (socket says 172.21.15.94:33282) 2023-10-16T08:53:06.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.799+0000 7f70d17a6640 1 -- 172.21.15.94:0/2944395340 learned_addr learned my addr 172.21.15.94:0/2944395340 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:06.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d0fa5640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70cc070400 0x7f70cc0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70cbfff640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0c8930 0x7f70cc0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d17a6640 1 -- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0c8930 msgr2=0x7f70cc0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.806 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d17a6640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0c8930 0x7f70cc0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d17a6640 1 -- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70cc070400 msgr2=0x7f70cc0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:06.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d17a6640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70cc070400 0x7f70cc0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:06.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d17a6640 1 -- 172.21.15.94:0/2944395340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009400 con 0x7f70cc0cb400 2023-10-16T08:53:06.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d0fa5640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70cc070400 0x7f70cc0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:06.807 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70cbfff640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0c8930 0x7f70cc0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:06.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d17a6640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 0x7f70cc0b0ec0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f70c40098c0 tx=0x7f70c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:06.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40317d0 con 0x7f70cc0cb400 2023-10-16T08:53:06.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c403b9f0 con 0x7f70cc0cb400 2023-10-16T08:53:06.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c403bda0 con 0x7f70cc0cb400 2023-10-16T08:53:06.808 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.800+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc0c20f0 con 0x7f70cc0cb400 2023-10-16T08:53:06.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.801+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc0c26b0 con 0x7f70cc0cb400 2023-10-16T08:53:06.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.802+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc04e9b0 con 0x7f70cc0cb400 2023-10-16T08:53:06.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.803+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70c40453f0 con 0x7f70cc0cb400 2023-10-16T08:53:06.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.804+0000 7f70c97fa640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70ac06ae70 0x7f70ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:06.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.804+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f70c40ab5f0 con 0x7f70cc0cb400 2023-10-16T08:53:06.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.804+0000 7f70d0fa5640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70ac06ae70 0x7f70ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:06.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.805+0000 7f70d0fa5640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70ac06ae70 0x7f70ac06d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0012e0 tx=0x7f70bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:06.811 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.808+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70c4076940 con 0x7f70cc0cb400 2023-10-16T08:53:06.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:06.993+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f70cc0c9930 con 0x7f70cc0cb400 2023-10-16T08:53:07.258 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.256+0000 7f70c97fa640 1 -- 172.21.15.94:0/2944395340 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v38) v1 ==== 148+0+0 (secure 0 0 0) 0x7f70c4035070 con 0x7f70cc0cb400 2023-10-16T08:53:07.259 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'testcephfs1_metadata' created 2023-10-16T08:53:07.262 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70ac06ae70 msgr2=0x7f70ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:07.262 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70ac06ae70 0x7f70ac06d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0012e0 tx=0x7f70bc009040 comp rx=0 tx=0).stop 2023-10-16T08:53:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 msgr2=0x7f70cc0b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 0x7f70cc0b0ec0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f70c40098c0 tx=0x7f70c40046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 shutdown_connections 2023-10-16T08:53:07.263 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70cc0cb400 0x7f70cc0b0ec0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70cc0c8930 0x7f70cc0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f70ac06ae70 0x7f70ac06d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 --2- 172.21.15.94:0/2944395340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70cc070400 0x7f70cc0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.260+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 >> 172.21.15.94:0/2944395340 conn(0x7f70cc06a470 msgr2=0x7f70cc0cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.261+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 shutdown_connections 2023-10-16T08:53:07.265 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.262+0000 7f70d1fa7640 1 -- 172.21.15.94:0/2944395340 wait complete. 2023-10-16T08:53:07.291 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T08:53:07.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.494+0000 7fce213e9640 1 Processor -- start 2023-10-16T08:53:07.496 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.494+0000 7fce213e9640 1 -- start start 2023-10-16T08:53:07.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.495+0000 7fce213e9640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce1c15a880 0x7fce1c15e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.495+0000 7fce213e9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce1c15ac60 0x7fce1c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.495+0000 7fce213e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0ad640 0x7fce1c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.495+0000 7fce213e9640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c0cbda0 con 0x7fce1c15a880 2023-10-16T08:53:07.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.495+0000 7fce213e9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c0704f0 con 0x7fce1c15ac60 2023-10-16T08:53:07.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.495+0000 7fce213e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c070740 con 0x7fce1c0ad640 2023-10-16T08:53:07.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce1c15a880 0x7fce1c15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce1c15a880 0x7fce1c15e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33286/0 (socket says 172.21.15.94:33286) 2023-10-16T08:53:07.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 -- 172.21.15.94:0/4000739548 learned_addr learned my addr 172.21.15.94:0/4000739548 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:07.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1a7fc640 1 --2- 172.21.15.94:0/4000739548 >> v2:172.21.15.130:3300/0 conn(0x7fce1c15ac60 0x7fce1c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1b7fe640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0ad640 0x7fce1c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 -- 172.21.15.94:0/4000739548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0ad640 msgr2=0x7fce1c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:07.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0ad640 0x7fce1c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 -- 172.21.15.94:0/4000739548 >> v2:172.21.15.130:3300/0 conn(0x7fce1c15ac60 msgr2=0x7fce1c0cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:07.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 --2- 172.21.15.94:0/4000739548 >> v2:172.21.15.130:3300/0 conn(0x7fce1c15ac60 0x7fce1c0cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1affd640 1 -- 172.21.15.94:0/4000739548 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c070a20 con 0x7fce1c15a880 2023-10-16T08:53:07.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1a7fc640 1 --2- 172.21.15.94:0/4000739548 >> v2:172.21.15.130:3300/0 conn(0x7fce1c15ac60 0x7fce1c0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:07.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.496+0000 7fce1b7fe640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0ad640 0x7fce1c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:07.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.497+0000 7fce1affd640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15a880 0x7fce1c15e620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fce1c06ad30 tx=0x7fce0c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ddc3d84553d111 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:07.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.498+0000 7fce19ffb640 1 -- 172.21.15.94:0/4000739548 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c031880 con 0x7fce1c15a880 2023-10-16T08:53:07.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.498+0000 7fce19ffb640 1 -- 172.21.15.94:0/4000739548 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c0319e0 con 0x7fce1c15a880 2023-10-16T08:53:07.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.498+0000 7fce19ffb640 1 -- 172.21.15.94:0/4000739548 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c031d70 con 0x7fce1c15a880 2023-10-16T08:53:07.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.498+0000 7fce213e9640 1 -- 172.21.15.94:0/4000739548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15a880 msgr2=0x7fce1c15e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:07.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.498+0000 7fce213e9640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15a880 0x7fce1c15e620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fce1c06ad30 tx=0x7fce0c02b920 comp rx=0 tx=0).stop 2023-10-16T08:53:07.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 -- 172.21.15.94:0/4000739548 shutdown_connections 2023-10-16T08:53:07.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0ad640 0x7fce1c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 --2- 172.21.15.94:0/4000739548 >> v2:172.21.15.130:3300/0 conn(0x7fce1c15ac60 0x7fce1c0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 --2- 172.21.15.94:0/4000739548 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15a880 0x7fce1c15e620 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.504 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 -- 172.21.15.94:0/4000739548 >> 172.21.15.94:0/4000739548 conn(0x7fce1c0660e0 msgr2=0x7fce1c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:07.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 -- 172.21.15.94:0/4000739548 shutdown_connections 2023-10-16T08:53:07.505 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.499+0000 7fce213e9640 1 -- 172.21.15.94:0/4000739548 wait complete. 2023-10-16T08:53:07.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.500+0000 7fce213e9640 1 Processor -- start 2023-10-16T08:53:07.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.500+0000 7fce213e9640 1 -- start start 2023-10-16T08:53:07.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.501+0000 7fce213e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c0ad640 0x7fce1c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.507 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.501+0000 7fce213e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15a880 0x7fce1c0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.501+0000 7fce213e9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 0x7fce1c0a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.501+0000 7fce213e9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0cd9c0 con 0x7fce1c15ac60 2023-10-16T08:53:07.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.501+0000 7fce213e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0ca310 con 0x7fce1c0ad640 2023-10-16T08:53:07.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.501+0000 7fce213e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0cd020 con 0x7fce1c15a880 2023-10-16T08:53:07.508 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 0x7fce1c0a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 0x7fce1c0a9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33290/0 (socket says 172.21.15.94:33290) 2023-10-16T08:53:07.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 -- 172.21.15.94:0/2496514839 learned_addr learned my addr 172.21.15.94:0/2496514839 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:07.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1a7fc640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15a880 0x7fce1c0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1affd640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c0ad640 0x7fce1c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 -- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15a880 msgr2=0x7fce1c0a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:07.509 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15a880 0x7fce1c0a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 -- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c0ad640 msgr2=0x7fce1c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:07.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c0ad640 0x7fce1c152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:07.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 -- 172.21.15.94:0/2496514839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0094d0 con 0x7fce1c15ac60 2023-10-16T08:53:07.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1affd640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c0ad640 0x7fce1c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:53:07.510 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.502+0000 7fce1b7fe640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 0x7fce1c0a9870 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce1400ce40 tx=0x7fce1400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:07.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.503+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1400d840 con 0x7fce1c15ac60 2023-10-16T08:53:07.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.503+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1400d9a0 con 0x7fce1c15ac60 2023-10-16T08:53:07.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.503+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1400dd50 con 0x7fce1c15ac60 2023-10-16T08:53:07.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.503+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c0cd300 con 0x7fce1c15ac60 2023-10-16T08:53:07.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.503+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c153170 con 0x7fce1c15ac60 2023-10-16T08:53:07.511 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.504+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c0cdb00 con 0x7fce1c15ac60 2023-10-16T08:53:07.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.505+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce1401e3b0 con 0x7fce1c15ac60 2023-10-16T08:53:07.512 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.506+0000 7fce037fe640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce0806ae70 0x7fce0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:07.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.506+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5552+0+0 (secure 0 0 0) 0x7fce1408a240 con 0x7fce1c15ac60 2023-10-16T08:53:07.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.506+0000 7fce1affd640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce0806ae70 0x7fce0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:07.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.507+0000 7fce1affd640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce0806ae70 0x7fce0806d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fce0c036000 tx=0x7fce0c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:07.513 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.510+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce14055520 con 0x7fce1c15ac60 2023-10-16T08:53:07.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:07.684+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fce1c073ef0 con 0x7fce1c15ac60 2023-10-16T08:53:08.264 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.262+0000 7fce037fe640 1 -- 172.21.15.94:0/2496514839 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v39) v1 ==== 180+0+0 (secure 0 0 0) 0x7fce1401a0d0 con 0x7fce1c15ac60 2023-10-16T08:53:08.264 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'testcephfs1_data' created 2023-10-16T08:53:08.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.265+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce0806ae70 msgr2=0x7fce0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:08.268 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.265+0000 7fce213e9640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce0806ae70 0x7fce0806d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fce0c036000 tx=0x7fce0c03c040 comp rx=0 tx=0).stop 2023-10-16T08:53:08.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 msgr2=0x7fce1c0a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:08.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 0x7fce1c0a9870 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce1400ce40 tx=0x7fce1400a710 comp rx=0 tx=0).stop 2023-10-16T08:53:08.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 shutdown_connections 2023-10-16T08:53:08.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce1c15ac60 0x7fce1c0a9870 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.269 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15a880 0x7fce1c0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fce0806ae70 0x7fce0806d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 --2- 172.21.15.94:0/2496514839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c0ad640 0x7fce1c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 >> 172.21.15.94:0/2496514839 conn(0x7fce1c0660e0 msgr2=0x7fce1c15b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 shutdown_connections 2023-10-16T08:53:08.270 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.266+0000 7fce213e9640 1 -- 172.21.15.94:0/2496514839 wait complete. 2023-10-16T08:53:08.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-16T08:53:08.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.486+0000 7fba8f59e640 1 Processor -- start 2023-10-16T08:53:08.488 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.486+0000 7fba8f59e640 1 -- start start 2023-10-16T08:53:08.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8f59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fba900cf030 0x7fba9006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:08.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8f59e640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba9006d360 0x7fba900ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:08.489 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8f59e640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba901550f0 con 0x7fba90154d10 2023-10-16T08:53:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8f59e640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9006db50 con 0x7fba9006d360 2023-10-16T08:53:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8f59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900b13f0 con 0x7fba900cf030 2023-10-16T08:53:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8ed9d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fba9006d360 0x7fba900ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8e59c640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fba90154d10 0x7fba900ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56544/0 (socket says 172.21.15.94:56544) 2023-10-16T08:53:08.490 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.487+0000 7fba8e59c640 1 -- 172.21.15.94:0/3702692965 learned_addr learned my addr 172.21.15.94:0/3702692965 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:08.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.488+0000 7fba8ed9d640 1 -- 172.21.15.94:0/3702692965 >> v2:172.21.15.130:3300/0 conn(0x7fba900cf030 msgr2=0x7fba9006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:08.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.488+0000 7fba8ed9d640 1 --2- 172.21.15.94:0/3702692965 >> v2:172.21.15.130:3300/0 conn(0x7fba900cf030 0x7fba9006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.488+0000 7fba8ed9d640 1 -- 172.21.15.94:0/3702692965 >> v1:172.21.15.94:6789/0 conn(0x7fba90154d10 legacy=0x7fba900ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:08.492 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.488+0000 7fba8ed9d640 1 -- 172.21.15.94:0/3702692965 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900b16d0 con 0x7fba9006d360 2023-10-16T08:53:08.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.489+0000 7fba8ed9d640 1 --2- 172.21.15.94:0/3702692965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9006d360 0x7fba900ac1d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba900c8ae0 tx=0x7fba8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19021fb1d0d59ac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:08.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.489+0000 7fba8d59a640 1 -- 172.21.15.94:0/3702692965 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88031830 con 0x7fba9006d360 2023-10-16T08:53:08.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.489+0000 7fba8d59a640 1 -- 172.21.15.94:0/3702692965 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88031990 con 0x7fba9006d360 2023-10-16T08:53:08.493 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.489+0000 7fba8d59a640 1 -- 172.21.15.94:0/3702692965 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88031d20 con 0x7fba9006d360 2023-10-16T08:53:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 -- 172.21.15.94:0/3702692965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9006d360 msgr2=0x7fba900ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 --2- 172.21.15.94:0/3702692965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9006d360 0x7fba900ac1d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba900c8ae0 tx=0x7fba8802b8d0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 -- 172.21.15.94:0/3702692965 shutdown_connections 2023-10-16T08:53:08.494 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 --2- 172.21.15.94:0/3702692965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba9006d360 0x7fba900ac1d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 --2- 172.21.15.94:0/3702692965 >> v2:172.21.15.130:3300/0 conn(0x7fba900cf030 0x7fba9006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 -- 172.21.15.94:0/3702692965 >> 172.21.15.94:0/3702692965 conn(0x7fba9006a200 msgr2=0x7fba9006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:08.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 -- 172.21.15.94:0/3702692965 shutdown_connections 2023-10-16T08:53:08.495 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.490+0000 7fba8f59e640 1 -- 172.21.15.94:0/3702692965 wait complete. 2023-10-16T08:53:08.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.491+0000 7fba8f59e640 1 Processor -- start 2023-10-16T08:53:08.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.492+0000 7fba8f59e640 1 -- start start 2023-10-16T08:53:08.497 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.492+0000 7fba8f59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba9006d360 0x7fba9015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:08.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.492+0000 7fba8f59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba900cf030 0x7fba90159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:08.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8f59e640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 0x7fba900c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:08.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8f59e640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900c14e0 con 0x7fba90154d10 2023-10-16T08:53:08.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8f59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900cc560 con 0x7fba9006d360 2023-10-16T08:53:08.498 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8f59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900cc840 con 0x7fba900cf030 2023-10-16T08:53:08.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 0x7fba900c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:08.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 0x7fba900c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33302/0 (socket says 172.21.15.94:33302) 2023-10-16T08:53:08.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 -- 172.21.15.94:0/1017967508 learned_addr learned my addr 172.21.15.94:0/1017967508 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:08.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 -- 172.21.15.94:0/1017967508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba900cf030 msgr2=0x7fba90159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:08.499 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba900cf030 0x7fba90159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 -- 172.21.15.94:0/1017967508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba9006d360 msgr2=0x7fba9015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:08.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba9006d360 0x7fba9015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:08.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.493+0000 7fba8ed9d640 1 -- 172.21.15.94:0/1017967508 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009400 con 0x7fba90154d10 2023-10-16T08:53:08.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.494+0000 7fba8ed9d640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 0x7fba900c2320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fba8802b910 tx=0x7fba880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:08.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.494+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8803a9e0 con 0x7fba90154d10 2023-10-16T08:53:08.500 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.494+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8803ab60 con 0x7fba90154d10 2023-10-16T08:53:08.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.494+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba880443f0 con 0x7fba90154d10 2023-10-16T08:53:08.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.494+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900ccb20 con 0x7fba90154d10 2023-10-16T08:53:08.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.494+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900cd0e0 con 0x7fba90154d10 2023-10-16T08:53:08.501 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.495+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9004e9b0 con 0x7fba90154d10 2023-10-16T08:53:08.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.496+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fba88044550 con 0x7fba90154d10 2023-10-16T08:53:08.502 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.497+0000 7fba86ffd640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fba7006ae70 0x7fba7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:08.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.497+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fba880abae0 con 0x7fba90154d10 2023-10-16T08:53:08.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.497+0000 7fba8e59c640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fba7006ae70 0x7fba7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:08.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.498+0000 7fba8e59c640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fba7006ae70 0x7fba7006d330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba80002070 tx=0x7fba80001660 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:08.503 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.502+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba88076b20 con 0x7fba90154d10 2023-10-16T08:53:08.733 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:08.731+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fba900cd2d0 con 0x7fba90154d10 2023-10-16T08:53:09.312 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.310+0000 7fba86ffd640 1 -- 172.21.15.94:0/1017967508 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 187+0+0 (secure 0 0 0) 0x7fba88035020 con 0x7fba90154d10 2023-10-16T08:53:09.315 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 5 and data pool 6 2023-10-16T08:53:09.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.321+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fba7006ae70 msgr2=0x7fba7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.321+0000 7fba8f59e640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fba7006ae70 0x7fba7006d330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba80002070 tx=0x7fba80001660 comp rx=0 tx=0).stop 2023-10-16T08:53:09.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.321+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 msgr2=0x7fba900c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.321+0000 7fba8f59e640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 0x7fba900c2320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fba8802b910 tx=0x7fba880046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.324+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 shutdown_connections 2023-10-16T08:53:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.324+0000 7fba8f59e640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba90154d10 0x7fba900c2320 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.324+0000 7fba8f59e640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba900cf030 0x7fba90159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.324+0000 7fba8f59e640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fba7006ae70 0x7fba7006d330 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.324+0000 7fba8f59e640 1 --2- 172.21.15.94:0/1017967508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba9006d360 0x7fba9015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.324+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 >> 172.21.15.94:0/1017967508 conn(0x7fba9006a200 msgr2=0x7fba900b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.326+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 shutdown_connections 2023-10-16T08:53:09.329 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.327+0000 7fba8f59e640 1 -- 172.21.15.94:0/1017967508 wait complete. 2023-10-16T08:53:09.356 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:53:09.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.536+0000 7fe6a1fc5640 1 Processor -- start 2023-10-16T08:53:09.538 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.536+0000 7fe6a1fc5640 1 -- start start 2023-10-16T08:53:09.539 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.537+0000 7fe6a1fc5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe69c15cd10 0x7fe69c0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.539 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.537+0000 7fe6a1fc5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 0x7fe69c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.540 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.537+0000 7fe6a1fc5640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c0ce370 con 0x7fe69c160aa0 2023-10-16T08:53:09.540 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.537+0000 7fe6a1fc5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c1617d0 con 0x7fe69c15cd10 2023-10-16T08:53:09.540 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.537+0000 7fe6a1fc5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0d0c30 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.538+0000 7fe693fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 0x7fe69c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.538+0000 7fe69b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe69c15cd10 0x7fe69c0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.541 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.538+0000 7fe693fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 0x7fe69c0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:36626/0 (socket says 172.21.15.94:36626) 2023-10-16T08:53:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.538+0000 7fe693fff640 1 -- 172.21.15.94:0/3213221732 learned_addr learned my addr 172.21.15.94:0/3213221732 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.539+0000 7fe693fff640 1 -- 172.21.15.94:0/3213221732 >> v2:172.21.15.130:3300/0 conn(0x7fe69c15cd10 msgr2=0x7fe69c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.539+0000 7fe693fff640 1 --2- 172.21.15.94:0/3213221732 >> v2:172.21.15.130:3300/0 conn(0x7fe69c15cd10 0x7fe69c0d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.539+0000 7fe693fff640 1 -- 172.21.15.94:0/3213221732 >> v1:172.21.15.130:6789/0 conn(0x7fe69c160aa0 legacy=0x7fe69c160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.542 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.539+0000 7fe693fff640 1 -- 172.21.15.94:0/3213221732 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0d0f10 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.543 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.539+0000 7fe69b7fe640 1 --2- 172.21.15.94:0/3213221732 >> v2:172.21.15.130:3300/0 conn(0x7fe69c15cd10 0x7fe69c0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:53:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.540+0000 7fe693fff640 1 --2- 172.21.15.94:0/3213221732 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 0x7fe69c0cde30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe684009870 tx=0x7fe68402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f427999bd71107ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.541+0000 7fe69affd640 1 -- 172.21.15.94:0/3213221732 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684031640 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.541+0000 7fe69affd640 1 -- 172.21.15.94:0/3213221732 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840317a0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.544 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.541+0000 7fe69affd640 1 -- 172.21.15.94:0/3213221732 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684031b30 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.541+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3213221732 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 msgr2=0x7fe69c0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.541+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3213221732 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 0x7fe69c0cde30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe684009870 tx=0x7fe68402b8f0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.542+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3213221732 shutdown_connections 2023-10-16T08:53:09.545 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.542+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3213221732 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c0cd9b0 0x7fe69c0cde30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.542+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3213221732 >> v2:172.21.15.130:3300/0 conn(0x7fe69c15cd10 0x7fe69c0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.542+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3213221732 >> 172.21.15.94:0/3213221732 conn(0x7fe69c0b44a0 msgr2=0x7fe69c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.542+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3213221732 shutdown_connections 2023-10-16T08:53:09.546 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.542+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3213221732 wait complete. 2023-10-16T08:53:09.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.543+0000 7fe6a1fc5640 1 Processor -- start 2023-10-16T08:53:09.548 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 -- start start 2023-10-16T08:53:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 0x7fe69c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c15cd10 0x7fe69c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe69c160aa0 0x7fe69c0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0c9440 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c152cf0 con 0x7fe69c160aa0 2023-10-16T08:53:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.544+0000 7fe6a1fc5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0cc880 con 0x7fe69c15cd10 2023-10-16T08:53:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 0x7fe69c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 0x7fe69c1527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33318/0 (socket says 172.21.15.94:33318) 2023-10-16T08:53:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 -- 172.21.15.94:0/3298297570 learned_addr learned my addr 172.21.15.94:0/3298297570 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:09.550 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69bfff640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe69c160aa0 0x7fe69c0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 -- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c15cd10 msgr2=0x7fe69c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe693fff640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c15cd10 0x7fe69c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c15cd10 0x7fe69c0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 -- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe69c160aa0 msgr2=0x7fe69c0c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.551 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe69c160aa0 0x7fe69c0c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69b7fe640 1 -- 172.21.15.94:0/3298297570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c009400 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.545+0000 7fe69bfff640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe69c160aa0 0x7fe69c0c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.546+0000 7fe69b7fe640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 0x7fe69c1527b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00ebe0 tx=0x7fe68c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.546+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c009760 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.552 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.546+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c00cc30 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.546+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6840094d0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.546+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00eee0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.553 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.546+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c1f3070 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.547+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c073ef0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.554 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.548+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe68c013470 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.549+0000 7fe698ff9640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe67c06aec0 0x7fe67c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.549+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe68c0899f0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.549+0000 7fe693fff640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe67c06aec0 0x7fe67c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.555 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.550+0000 7fe693fff640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe67c06aec0 0x7fe67c06d380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe684036000 tx=0x7fe68403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:09.556 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.554+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe68c0549b0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.749 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.747+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69c0d08e0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.752 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.750+0000 7fe698ff9640 1 -- 172.21.15.94:0/3298297570 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16795 (secure 0 0 0) 0x7fe68c057fd0 con 0x7fe69c0cd9b0 2023-10-16T08:53:09.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:09.753 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:53:08.733777+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T08:53:07.043696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T08:53:07.738370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:53:09.755 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.753+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe67c06aec0 msgr2=0x7fe67c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.753+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe67c06aec0 0x7fe67c06d380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe684036000 tx=0x7fe68403c040 comp rx=0 tx=0).stop 2023-10-16T08:53:09.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.753+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 msgr2=0x7fe69c1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.753+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 0x7fe69c1527b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00ebe0 tx=0x7fe68c00c520 comp rx=0 tx=0).stop 2023-10-16T08:53:09.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.753+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 shutdown_connections 2023-10-16T08:53:09.756 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.753+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe67c06aec0 0x7fe67c06d380 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.754+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe69c160aa0 0x7fe69c0c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.754+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe69c15cd10 0x7fe69c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.754+0000 7fe6a1fc5640 1 --2- 172.21.15.94:0/3298297570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe69c0cd9b0 0x7fe69c1527b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.754+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 >> 172.21.15.94:0/3298297570 conn(0x7fe69c0b44a0 msgr2=0x7fe69c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:09.757 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.754+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 shutdown_connections 2023-10-16T08:53:09.758 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.754+0000 7fe6a1fc5640 1 -- 172.21.15.94:0/3298297570 wait complete. 2023-10-16T08:53:09.772 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:53:09.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.973+0000 7f27673d7640 1 Processor -- start 2023-10-16T08:53:09.975 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.973+0000 7f27673d7640 1 -- start start 2023-10-16T08:53:09.976 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.974+0000 7f27673d7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27600c9e00 0x7f27600c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f27673d7640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2760071c10 con 0x7f2760071800 2023-10-16T08:53:09.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f27673d7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2760071e40 con 0x7f27600ca1e0 2023-10-16T08:53:09.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f27673d7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600cde00 con 0x7f27600c9e00 2023-10-16T08:53:09.977 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f2765974640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2760071800 0x7f27600cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56546/0 (socket says 172.21.15.94:56546) 2023-10-16T08:53:09.978 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f2765974640 1 -- 172.21.15.94:0/382379812 learned_addr learned my addr 172.21.15.94:0/382379812 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:09.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843378446 0 0) 0x7f2760071c10 con 0x7f2760071800 2023-10-16T08:53:09.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c003520 con 0x7f2760071800 2023-10-16T08:53:09.980 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.975+0000 7f2765173640 1 --2- 172.21.15.94:0/382379812 >> v2:172.21.15.130:3300/0 conn(0x7f27600c9e00 0x7f27600c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198118368 0 0) 0x7f274c003520 con 0x7f2760071800 2023-10-16T08:53:09.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 >> v2:172.21.15.130:3300/0 conn(0x7f27600c9e00 msgr2=0x7f27600c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:09.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 --2- 172.21.15.94:0/382379812 >> v2:172.21.15.130:3300/0 conn(0x7f27600c9e00 0x7f27600c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 >> v1:172.21.15.130:6789/0 conn(0x7f27600ca1e0 legacy=0x7f27600710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.981 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760072120 con 0x7f2760071800 2023-10-16T08:53:09.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f27580019f0 con 0x7f2760071800 2023-10-16T08:53:09.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 >> v1:172.21.15.94:6789/0 conn(0x7f2760071800 legacy=0x7f27600cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f274c0039e0 0x7f274c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0047c0 0x7f274c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.982 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f274c0051f0 0x7f274c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600cde00 con 0x7f274c0039e0 2023-10-16T08:53:09.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c00e360 con 0x7f274c0047c0 2023-10-16T08:53:09.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c00e520 con 0x7f274c0051f0 2023-10-16T08:53:09.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765173640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f274c0039e0 0x7f274c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.983 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765173640 1 -- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f274c0051f0 msgr2=0x7f274c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:09.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765173640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f274c0051f0 0x7f274c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765173640 1 -- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0047c0 msgr2=0x7f274c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:09.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2764972640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0047c0 0x7f274c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765173640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0047c0 0x7f274c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.984 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765974640 1 -- 172.21.15.94:0/382379812 reap_dead start 2023-10-16T08:53:09.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2765173640 1 -- 172.21.15.94:0/382379812 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c003520 con 0x7f274c0039e0 2023-10-16T08:53:09.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.976+0000 7f2764972640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0047c0 0x7f274c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:09.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.977+0000 7f2765173640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f274c0039e0 0x7f274c003e00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f275c00ba30 tx=0x7f274c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e5aadc18d55627 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:09.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c032640 con 0x7f274c0039e0 2023-10-16T08:53:09.985 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c0327a0 con 0x7f274c0039e0 2023-10-16T08:53:09.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f2757fff640 1 -- 172.21.15.94:0/382379812 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c032b30 con 0x7f274c0039e0 2023-10-16T08:53:09.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 -- 172.21.15.94:0/382379812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f274c0039e0 msgr2=0x7f274c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f274c0039e0 0x7f274c003e00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f275c00ba30 tx=0x7f274c0057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.986 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 -- 172.21.15.94:0/382379812 shutdown_connections 2023-10-16T08:53:09.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 --2- 172.21.15.94:0/382379812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f274c0039e0 0x7f274c003e00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 -- 172.21.15.94:0/382379812 >> 172.21.15.94:0/382379812 conn(0x7f276006c1c0 msgr2=0x7f276006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:09.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 -- 172.21.15.94:0/382379812 shutdown_connections 2023-10-16T08:53:09.987 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.978+0000 7f27673d7640 1 -- 172.21.15.94:0/382379812 wait complete. 2023-10-16T08:53:09.989 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.980+0000 7f27673d7640 1 Processor -- start 2023-10-16T08:53:09.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.980+0000 7f27673d7640 1 -- start start 2023-10-16T08:53:09.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f27673d7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0039e0 0x7f2760146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f27673d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 0x7f27600c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.990 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f27673d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27600b3c20 0x7f27600ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f27673d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b2bc0 con 0x7f27601560c0 2023-10-16T08:53:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f27673d7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b2e60 con 0x7f274c0039e0 2023-10-16T08:53:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f27673d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b3140 con 0x7f27600b3c20 2023-10-16T08:53:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f2764972640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 0x7f27600c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.991 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f2764972640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 0x7f27600c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33332/0 (socket says 172.21.15.94:33332) 2023-10-16T08:53:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.981+0000 7f2764972640 1 -- 172.21.15.94:0/1006443389 learned_addr learned my addr 172.21.15.94:0/1006443389 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2765173640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0039e0 0x7f2760146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2764972640 1 -- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27600b3c20 msgr2=0x7f27600ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2764972640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27600b3c20 0x7f27600ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.992 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2764972640 1 -- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0039e0 msgr2=0x7f2760146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2764972640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0039e0 0x7f2760146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2764972640 1 -- 172.21.15.94:0/1006443389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600b3420 con 0x7f27601560c0 2023-10-16T08:53:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2765173640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0039e0 0x7f2760146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2764972640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 0x7f27600c6b60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f275000d4a0 tx=0x7f275000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750005480 con 0x7f27601560c0 2023-10-16T08:53:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750007030 con 0x7f27601560c0 2023-10-16T08:53:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750007400 con 0x7f27601560c0 2023-10-16T08:53:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27600b3700 con 0x7f27601560c0 2023-10-16T08:53:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.982+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27600c70a0 con 0x7f27601560c0 2023-10-16T08:53:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.984+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2760073ef0 con 0x7f27601560c0 2023-10-16T08:53:09.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.985+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2750007560 con 0x7f27601560c0 2023-10-16T08:53:09.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.986+0000 7f2755ffb640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f274406ae70 0x7f274406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:09.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.986+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2750088bc0 con 0x7f27601560c0 2023-10-16T08:53:09.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.986+0000 7f2765173640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f274406ae70 0x7f274406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:09.995 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.987+0000 7f2765173640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f274406ae70 0x7f274406d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f275c00ba00 tx=0x7f275c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:09.991+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2750053bb0 con 0x7f27601560c0 2023-10-16T08:53:10.183 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.181+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27600cd9b0 con 0x7f27601560c0 2023-10-16T08:53:10.187 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.184+0000 7f2755ffb640 1 -- 172.21.15.94:0/1006443389 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f2750019020 con 0x7f27601560c0 2023-10-16T08:53:10.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:10.187 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":40,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:53:08.733777+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T08:53:07.043696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T08:53:07.738370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:53:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f274406ae70 msgr2=0x7f274406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f274406ae70 0x7f274406d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f275c00ba00 tx=0x7f275c03d040 comp rx=0 tx=0).stop 2023-10-16T08:53:10.189 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 msgr2=0x7f27600c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 0x7f27600c6b60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f275000d4a0 tx=0x7f275000d960 comp rx=0 tx=0).stop 2023-10-16T08:53:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 shutdown_connections 2023-10-16T08:53:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27600b3c20 0x7f27600ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27601560c0 0x7f27600c6b60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.190 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f274406ae70 0x7f274406d330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 --2- 172.21.15.94:0/1006443389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c0039e0 0x7f2760146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 >> 172.21.15.94:0/1006443389 conn(0x7f276006c1c0 msgr2=0x7f2760157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 shutdown_connections 2023-10-16T08:53:10.191 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.187+0000 7f27673d7640 1 -- 172.21.15.94:0/1006443389 wait complete. 2023-10-16T08:53:10.207 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-16T08:53:10.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.425+0000 7ff9a2ebb640 1 Processor -- start 2023-10-16T08:53:10.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.425+0000 7ff9a2ebb640 1 -- start start 2023-10-16T08:53:10.428 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.426+0000 7ff9a2ebb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff99c154d10 0x7ff99c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.426+0000 7ff9a2ebb640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff99c0cee60 0x7ff99c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.426+0000 7ff9a2ebb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c06d360 0x7ff99c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.426+0000 7ff9a2ebb640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0cf310 con 0x7ff99c0cee60 2023-10-16T08:53:10.429 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.426+0000 7ff9a2ebb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c1550f0 con 0x7ff99c154d10 2023-10-16T08:53:10.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.426+0000 7ff9a2ebb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c06db50 con 0x7ff99c06d360 2023-10-16T08:53:10.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff99c0cee60 0x7ff99c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:10.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff99c0cee60 0x7ff99c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33344/0 (socket says 172.21.15.94:33344) 2023-10-16T08:53:10.430 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 -- 172.21.15.94:0/3884552588 learned_addr learned my addr 172.21.15.94:0/3884552588 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:10.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 -- 172.21.15.94:0/3884552588 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c06d360 msgr2=0x7ff99c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:10.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 --2- 172.21.15.94:0/3884552588 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c06d360 0x7ff99c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 -- 172.21.15.94:0/3884552588 >> v2:172.21.15.130:3300/0 conn(0x7ff99c154d10 msgr2=0x7ff99c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:10.432 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 --2- 172.21.15.94:0/3884552588 >> v2:172.21.15.130:3300/0 conn(0x7ff99c154d10 0x7ff99c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.427+0000 7ff9a16b8640 1 -- 172.21.15.94:0/3884552588 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0b13f0 con 0x7ff99c0cee60 2023-10-16T08:53:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.428+0000 7ff9a16b8640 1 --2- 172.21.15.94:0/3884552588 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c06ce20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0724f0 tx=0x7ff98c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66226cc4239d6daa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.429+0000 7ff9a0eb7640 1 -- 172.21.15.94:0/3884552588 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031860 con 0x7ff99c0cee60 2023-10-16T08:53:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.429+0000 7ff9a0eb7640 1 -- 172.21.15.94:0/3884552588 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0319c0 con 0x7ff99c0cee60 2023-10-16T08:53:10.433 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.429+0000 7ff9a0eb7640 1 -- 172.21.15.94:0/3884552588 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031d50 con 0x7ff99c0cee60 2023-10-16T08:53:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.429+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/3884552588 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 msgr2=0x7ff99c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.429+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/3884552588 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c06ce20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0724f0 tx=0x7ff98c02b900 comp rx=0 tx=0).stop 2023-10-16T08:53:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/3884552588 shutdown_connections 2023-10-16T08:53:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/3884552588 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c06d360 0x7ff99c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.434 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/3884552588 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c06ce20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/3884552588 >> v2:172.21.15.130:3300/0 conn(0x7ff99c154d10 0x7ff99c0ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/3884552588 >> 172.21.15.94:0/3884552588 conn(0x7ff99c06a200 msgr2=0x7ff99c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:10.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/3884552588 shutdown_connections 2023-10-16T08:53:10.435 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.430+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/3884552588 wait complete. 2023-10-16T08:53:10.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.431+0000 7ff9a2ebb640 1 Processor -- start 2023-10-16T08:53:10.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.431+0000 7ff9a2ebb640 1 -- start start 2023-10-16T08:53:10.437 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.432+0000 7ff9a2ebb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c06d360 0x7ff99c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.432+0000 7ff9a2ebb640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.432+0000 7ff9a2ebb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c154d10 0x7ff99c0c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.432+0000 7ff9a2ebb640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c157280 con 0x7ff99c0cee60 2023-10-16T08:53:10.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.432+0000 7ff9a2ebb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c154830 con 0x7ff99c06d360 2023-10-16T08:53:10.438 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.432+0000 7ff9a2ebb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c156670 con 0x7ff99c154d10 2023-10-16T08:53:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33360/0 (socket says 172.21.15.94:33360) 2023-10-16T08:53:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 -- 172.21.15.94:0/1181229632 learned_addr learned my addr 172.21.15.94:0/1181229632 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 -- 172.21.15.94:0/1181229632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c154d10 msgr2=0x7ff99c0c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:10.439 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c154d10 0x7ff99c0c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 -- 172.21.15.94:0/1181229632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c06d360 msgr2=0x7ff99c1542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c06d360 0x7ff99c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 -- 172.21.15.94:0/1181229632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0094d0 con 0x7ff99c0cee60 2023-10-16T08:53:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.433+0000 7ff9a16b8640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c155d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff98c000c00 tx=0x7ff98c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:10.440 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.434+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031830 con 0x7ff99c0cee60 2023-10-16T08:53:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.434+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0443f0 con 0x7ff99c0cee60 2023-10-16T08:53:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.434+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c156950 con 0x7ff99c0cee60 2023-10-16T08:53:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.434+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0447a0 con 0x7ff99c0cee60 2023-10-16T08:53:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.434+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c156f10 con 0x7ff99c0cee60 2023-10-16T08:53:10.441 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.435+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c04e9b0 con 0x7ff99c0cee60 2023-10-16T08:53:10.442 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.436+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff98c04d450 con 0x7ff99c0cee60 2023-10-16T08:53:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.437+0000 7ff9927fc640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff98006ae70 0x7ff98006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.437+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff98c0abfc0 con 0x7ff99c0cee60 2023-10-16T08:53:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.437+0000 7ff9a1eb9640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff98006ae70 0x7ff98006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:10.443 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.438+0000 7ff9a1eb9640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff98006ae70 0x7ff98006d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff998009710 tx=0x7ff998006c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:10.444 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.441+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff98c076e70 con 0x7ff99c0cee60 2023-10-16T08:53:10.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:10.674+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff99c06c9d0 con 0x7ff99c0cee60 2023-10-16T08:53:11.194 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T08:53:11.192+0000 7f1c34abc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T08:53:11.672 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.669+0000 7ff9927fc640 1 -- 172.21.15.94:0/1181229632 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff98c07a490 con 0x7ff99c0cee60 2023-10-16T08:53:11.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff98006ae70 msgr2=0x7ff98006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:11.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff98006ae70 0x7ff98006d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff998009710 tx=0x7ff998006c90 comp rx=0 tx=0).stop 2023-10-16T08:53:11.675 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 msgr2=0x7ff99c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:11.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c155d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff98c000c00 tx=0x7ff98c0046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 shutdown_connections 2023-10-16T08:53:11.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff99c154d10 0x7ff99c0c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff99c0cee60 0x7ff99c155d00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.676 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff98006ae70 0x7ff98006d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 --2- 172.21.15.94:0/1181229632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c06d360 0x7ff99c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 >> 172.21.15.94:0/1181229632 conn(0x7ff99c06a200 msgr2=0x7ff99c0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:11.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 shutdown_connections 2023-10-16T08:53:11.677 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.673+0000 7ff9a2ebb640 1 -- 172.21.15.94:0/1181229632 wait complete. 2023-10-16T08:53:11.695 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T08:53:11.696 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-16T08:53:11.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.916+0000 7fb125b1d640 1 Processor -- start 2023-10-16T08:53:11.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.916+0000 7fb125b1d640 1 -- start start 2023-10-16T08:53:11.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb125b1d640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1201611f0 0x7fb12015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:11.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb125b1d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1200cb3b0 0x7fb12015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:11.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb125b1d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb120160730 con 0x7fb12015cbf0 2023-10-16T08:53:11.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb125b1d640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12015dd60 con 0x7fb1201611f0 2023-10-16T08:53:11.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb125b1d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1201609f0 con 0x7fb1200cb3b0 2023-10-16T08:53:11.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb117fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1201611f0 0x7fb12015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:11.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb117fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb1201611f0 0x7fb12015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33362/0 (socket says 172.21.15.94:33362) 2023-10-16T08:53:11.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.918+0000 7fb117fff640 1 -- 172.21.15.94:0/867266497 learned_addr learned my addr 172.21.15.94:0/867266497 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:11.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.919+0000 7fb117fff640 1 -- 172.21.15.94:0/867266497 >> v2:172.21.15.130:3300/0 conn(0x7fb1200cb3b0 msgr2=0x7fb12015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:11.922 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.919+0000 7fb117fff640 1 --2- 172.21.15.94:0/867266497 >> v2:172.21.15.130:3300/0 conn(0x7fb1200cb3b0 0x7fb12015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.919+0000 7fb117fff640 1 -- 172.21.15.94:0/867266497 >> v1:172.21.15.130:6789/0 conn(0x7fb12015cbf0 legacy=0x7fb1200caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:11.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.919+0000 7fb117fff640 1 -- 172.21.15.94:0/867266497 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120160cd0 con 0x7fb1201611f0 2023-10-16T08:53:11.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.920+0000 7fb117fff640 1 --2- 172.21.15.94:0/867266497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1201611f0 0x7fb12015cfd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1200b0cd0 tx=0x7fb10802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46222bfb42637617 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:11.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.920+0000 7fb11effd640 1 -- 172.21.15.94:0/867266497 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080317e0 con 0x7fb1201611f0 2023-10-16T08:53:11.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.920+0000 7fb11effd640 1 -- 172.21.15.94:0/867266497 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108031940 con 0x7fb1201611f0 2023-10-16T08:53:11.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.920+0000 7fb11effd640 1 -- 172.21.15.94:0/867266497 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108031cd0 con 0x7fb1201611f0 2023-10-16T08:53:11.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 -- 172.21.15.94:0/867266497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1201611f0 msgr2=0x7fb12015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:11.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 --2- 172.21.15.94:0/867266497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1201611f0 0x7fb12015cfd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1200b0cd0 tx=0x7fb10802b880 comp rx=0 tx=0).stop 2023-10-16T08:53:11.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 -- 172.21.15.94:0/867266497 shutdown_connections 2023-10-16T08:53:11.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 --2- 172.21.15.94:0/867266497 >> v2:172.21.15.130:3300/0 conn(0x7fb1200cb3b0 0x7fb12015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 --2- 172.21.15.94:0/867266497 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1201611f0 0x7fb12015cfd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 -- 172.21.15.94:0/867266497 >> 172.21.15.94:0/867266497 conn(0x7fb1200b0030 msgr2=0x7fb1200b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:11.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 -- 172.21.15.94:0/867266497 shutdown_connections 2023-10-16T08:53:11.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.921+0000 7fb125b1d640 1 -- 172.21.15.94:0/867266497 wait complete. 2023-10-16T08:53:11.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.923+0000 7fb125b1d640 1 Processor -- start 2023-10-16T08:53:11.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.923+0000 7fb125b1d640 1 -- start start 2023-10-16T08:53:11.929 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb125b1d640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 0x7fb12015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:11.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb125b1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb12015cbf0 0x7fb12015f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:11.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb125b1d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1201611f0 0x7fb1200ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:11.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb125b1d640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120151c50 con 0x7fb1200cb3b0 2023-10-16T08:53:11.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb125b1d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12015fa80 con 0x7fb12015cbf0 2023-10-16T08:53:11.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb125b1d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12015e530 con 0x7fb1201611f0 2023-10-16T08:53:11.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb11f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 0x7fb12015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:11.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb11f7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 0x7fb12015dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33370/0 (socket says 172.21.15.94:33370) 2023-10-16T08:53:11.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.924+0000 7fb11f7fe640 1 -- 172.21.15.94:0/678966282 learned_addr learned my addr 172.21.15.94:0/678966282 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:11.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11ffff640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1201611f0 0x7fb1200ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:11.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11f7fe640 1 -- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1201611f0 msgr2=0x7fb1200ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:11.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11f7fe640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1201611f0 0x7fb1200ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11f7fe640 1 -- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb12015cbf0 msgr2=0x7fb12015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:11.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11f7fe640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb12015cbf0 0x7fb12015f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:11.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11f7fe640 1 -- 172.21.15.94:0/678966282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080094d0 con 0x7fb1200cb3b0 2023-10-16T08:53:11.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11ffff640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1201611f0 0x7fb1200ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:11.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11f7fe640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 0x7fb12015dea0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c410 tx=0x7fb11000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:11.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1100035f0 con 0x7fb1200cb3b0 2023-10-16T08:53:11.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb110003750 con 0x7fb1200cb3b0 2023-10-16T08:53:11.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110003b40 con 0x7fb1200cb3b0 2023-10-16T08:53:11.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.925+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12015e810 con 0x7fb1200cb3b0 2023-10-16T08:53:11.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.926+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12015edd0 con 0x7fb1200cb3b0 2023-10-16T08:53:11.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.927+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1201519b0 con 0x7fb1200cb3b0 2023-10-16T08:53:11.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.928+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb110003ca0 con 0x7fb1200cb3b0 2023-10-16T08:53:11.935 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.928+0000 7fb11cff9640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb10006ae70 0x7fb10006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:11.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.929+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb110088a70 con 0x7fb1200cb3b0 2023-10-16T08:53:11.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.929+0000 7fb117fff640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb10006ae70 0x7fb10006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:11.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.930+0000 7fb117fff640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb10006ae70 0x7fb10006d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb108036000 tx=0x7fb108030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:11.936 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:11.933+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1201519b0 con 0x7fb1200cb3b0 2023-10-16T08:53:12.163 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.161+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb1201519b0 con 0x7fb1200cb3b0 2023-10-16T08:53:12.682 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.680+0000 7fb11cff9640 1 -- 172.21.15.94:0/678966282 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb1201519b0 con 0x7fb1200cb3b0 2023-10-16T08:53:12.685 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb10006ae70 msgr2=0x7fb10006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:12.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb10006ae70 0x7fb10006d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb108036000 tx=0x7fb108030000 comp rx=0 tx=0).stop 2023-10-16T08:53:12.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 msgr2=0x7fb12015dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:12.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 0x7fb12015dea0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c410 tx=0x7fb11000c8d0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 shutdown_connections 2023-10-16T08:53:12.686 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1201611f0 0x7fb1200ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb10006ae70 0x7fb10006d330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb12015cbf0 0x7fb12015f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 --2- 172.21.15.94:0/678966282 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb1200cb3b0 0x7fb12015dea0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 >> 172.21.15.94:0/678966282 conn(0x7fb1200b0030 msgr2=0x7fb1200ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:12.687 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.683+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 shutdown_connections 2023-10-16T08:53:12.688 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.684+0000 7fb125b1d640 1 -- 172.21.15.94:0/678966282 wait complete. 2023-10-16T08:53:12.706 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-16T08:53:12.707 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:53:12.915 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.913+0000 7f40de264640 1 Processor -- start 2023-10-16T08:53:12.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.913+0000 7f40de264640 1 -- start start 2023-10-16T08:53:12.916 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40de264640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f40d815ca80 0x7f40d80cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40de264640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f40d815ce60 0x7f40d80b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40de264640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d80b0550 0x7f40d80c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40de264640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80b0980 con 0x7f40d815ca80 2023-10-16T08:53:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40de264640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d8161620 con 0x7f40d815ce60 2023-10-16T08:53:12.917 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40de264640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80cafa0 con 0x7f40d80b0550 2023-10-16T08:53:12.918 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40d7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f40d815ca80 0x7f40d80cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40d7fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f40d815ca80 0x7f40d80cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33376/0 (socket says 172.21.15.94:33376) 2023-10-16T08:53:12.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40d7fff640 1 -- 172.21.15.94:0/2677699020 learned_addr learned my addr 172.21.15.94:0/2677699020 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:12.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.915+0000 7f40dc801640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d80b0550 0x7f40d80c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.919 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40d77fe640 1 --2- 172.21.15.94:0/2677699020 >> v2:172.21.15.130:3300/0 conn(0x7f40d815ce60 0x7f40d80b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40d7fff640 1 -- 172.21.15.94:0/2677699020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d80b0550 msgr2=0x7f40d80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:12.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40d7fff640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d80b0550 0x7f40d80c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40d7fff640 1 -- 172.21.15.94:0/2677699020 >> v2:172.21.15.130:3300/0 conn(0x7f40d815ce60 msgr2=0x7f40d80b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:12.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40d7fff640 1 --2- 172.21.15.94:0/2677699020 >> v2:172.21.15.130:3300/0 conn(0x7f40d815ce60 0x7f40d80b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.920 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40d7fff640 1 -- 172.21.15.94:0/2677699020 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80cb280 con 0x7f40d815ca80 2023-10-16T08:53:12.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.916+0000 7f40dc801640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d80b0550 0x7f40d80c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:12.921 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.917+0000 7f40d7fff640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ca80 0x7f40d80cddf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f40d80b10e0 tx=0x7f40c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64849de16b217563 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.917+0000 7f40d6ffd640 1 -- 172.21.15.94:0/2677699020 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c802ca70 con 0x7f40d815ca80 2023-10-16T08:53:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.917+0000 7f40d6ffd640 1 -- 172.21.15.94:0/2677699020 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c802cbd0 con 0x7f40d815ca80 2023-10-16T08:53:12.923 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.917+0000 7f40d6ffd640 1 -- 172.21.15.94:0/2677699020 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80343f0 con 0x7f40d815ca80 2023-10-16T08:53:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 -- 172.21.15.94:0/2677699020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ca80 msgr2=0x7f40d80cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ca80 0x7f40d80cddf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f40d80b10e0 tx=0x7f40c802bed0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 -- 172.21.15.94:0/2677699020 shutdown_connections 2023-10-16T08:53:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d80b0550 0x7f40d80c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.924 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 --2- 172.21.15.94:0/2677699020 >> v2:172.21.15.130:3300/0 conn(0x7f40d815ce60 0x7f40d80b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 --2- 172.21.15.94:0/2677699020 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ca80 0x7f40d80cddf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 -- 172.21.15.94:0/2677699020 >> 172.21.15.94:0/2677699020 conn(0x7f40d806c1c0 msgr2=0x7f40d806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:12.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 -- 172.21.15.94:0/2677699020 shutdown_connections 2023-10-16T08:53:12.925 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.918+0000 7f40de264640 1 -- 172.21.15.94:0/2677699020 wait complete. 2023-10-16T08:53:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.920+0000 7f40de264640 1 Processor -- start 2023-10-16T08:53:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.920+0000 7f40de264640 1 -- start start 2023-10-16T08:53:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40de264640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d80b0550 0x7f40d81f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.926 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40de264640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d815ca80 0x7f40d8158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40de264640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 0x7f40d81f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40de264640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81f3e80 con 0x7f40d815ce60 2023-10-16T08:53:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40de264640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81f4160 con 0x7f40d80b0550 2023-10-16T08:53:12.927 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40de264640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81f4440 con 0x7f40d815ca80 2023-10-16T08:53:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40dc801640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 0x7f40d81f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40dc801640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 0x7f40d81f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33390/0 (socket says 172.21.15.94:33390) 2023-10-16T08:53:12.928 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40dc801640 1 -- 172.21.15.94:0/3535258978 learned_addr learned my addr 172.21.15.94:0/3535258978 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:12.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.921+0000 7f40d77fe640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d815ca80 0x7f40d8158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.930 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40dc801640 1 -- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d815ca80 msgr2=0x7f40d8158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40dc801640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d815ca80 0x7f40d8158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40d7fff640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d80b0550 0x7f40d81f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40dc801640 1 -- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d80b0550 msgr2=0x7f40d81f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:12.931 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40dc801640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d80b0550 0x7f40d81f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:12.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40dc801640 1 -- 172.21.15.94:0/3535258978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009b30 con 0x7f40d815ce60 2023-10-16T08:53:12.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40dc801640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 0x7f40d81f3360 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f40d000c7c0 tx=0x7f40d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:12.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0004230 con 0x7f40d815ce60 2023-10-16T08:53:12.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d0004390 con 0x7f40d815ce60 2023-10-16T08:53:12.932 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d81f4720 con 0x7f40d815ce60 2023-10-16T08:53:12.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0007860 con 0x7f40d815ce60 2023-10-16T08:53:12.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.922+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d80b3ec0 con 0x7f40d815ce60 2023-10-16T08:53:12.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.923+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d81f4c40 con 0x7f40d815ce60 2023-10-16T08:53:12.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.924+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40d00079c0 con 0x7f40d815ce60 2023-10-16T08:53:12.933 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.925+0000 7f40d4ff9640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f40b806ae70 0x7f40b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:12.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.925+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f40d0089a60 con 0x7f40d815ce60 2023-10-16T08:53:12.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.925+0000 7f40d7fff640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f40b806ae70 0x7f40b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:12.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.926+0000 7f40d7fff640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f40b806ae70 0x7f40b806d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40c8035000 tx=0x7f40c8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:12.934 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:12.929+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40d00549d0 con 0x7f40d815ce60 2023-10-16T08:53:13.164 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.162+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d8073ef0 con 0x7f40d815ce60 2023-10-16T08:53:13.165 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.163+0000 7f40d4ff9640 1 -- 172.21.15.94:0/3535258978 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f40d0015090 con 0x7f40d815ce60 2023-10-16T08:53:13.166 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:13.166 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/3622211172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":3622211172},{"type":"v1","addr":"172.21.15.130:6834","nonce":3622211172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/612045765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":612045765},{"type":"v1","addr":"172.21.15.130:6835","nonce":612045765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6836/3279734748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3279734748},{"type":"v1","addr":"172.21.15.94:6836","nonce":3279734748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:53:08.734532+0000","modified":"2023-10-16T08:53:12.163933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6837/129304957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":129304957},{"type":"v1","addr":"172.21.15.94:6837","nonce":129304957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T08:53:13.166 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2023-10-16T08:53:13.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.166+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f40b806ae70 msgr2=0x7f40b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.166+0000 7f40de264640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f40b806ae70 0x7f40b806d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40c8035000 tx=0x7f40c8030000 comp rx=0 tx=0).stop 2023-10-16T08:53:13.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.166+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 msgr2=0x7f40d81f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.166+0000 7f40de264640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 0x7f40d81f3360 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f40d000c7c0 tx=0x7f40d000cc80 comp rx=0 tx=0).stop 2023-10-16T08:53:13.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 shutdown_connections 2023-10-16T08:53:13.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40d815ce60 0x7f40d81f3360 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40d815ca80 0x7f40d8158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f40b806ae70 0x7f40b806d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 --2- 172.21.15.94:0/3535258978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d80b0550 0x7f40d81f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 >> 172.21.15.94:0/3535258978 conn(0x7f40d806c1c0 msgr2=0x7f40d815bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:13.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 shutdown_connections 2023-10-16T08:53:13.171 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.167+0000 7f40de264640 1 -- 172.21.15.94:0/3535258978 wait complete. 2023-10-16T08:53:13.187 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T08:53:13.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.402+0000 7f9303106640 1 Processor -- start 2023-10-16T08:53:13.404 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.402+0000 7f9303106640 1 -- start start 2023-10-16T08:53:13.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9303106640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92fc0af8f0 0x7f92fc0cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9303106640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9303106640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f92fc0affa0 0x7f92fc06be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.406 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9303106640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0cac90 con 0x7f92fc0af8f0 2023-10-16T08:53:13.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9303106640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0cb810 con 0x7f92fc0affa0 2023-10-16T08:53:13.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9303106640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0caee0 con 0x7f92fc0cf8a0 2023-10-16T08:53:13.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92fc0af8f0 0x7f92fc0cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f92fc0af8f0 0x7f92fc0cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33400/0 (socket says 172.21.15.94:33400) 2023-10-16T08:53:13.407 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 -- 172.21.15.94:0/1536386887 learned_addr learned my addr 172.21.15.94:0/1536386887 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:13.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9301903640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.409 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302905640 1 --2- 172.21.15.94:0/1536386887 >> v2:172.21.15.130:3300/0 conn(0x7f92fc0affa0 0x7f92fc06be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 -- 172.21.15.94:0/1536386887 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 msgr2=0x7f92fc06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:13.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc06b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 -- 172.21.15.94:0/1536386887 >> v2:172.21.15.130:3300/0 conn(0x7f92fc0affa0 msgr2=0x7f92fc06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:13.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.404+0000 7f9302104640 1 --2- 172.21.15.94:0/1536386887 >> v2:172.21.15.130:3300/0 conn(0x7f92fc0affa0 0x7f92fc06be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.410 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.405+0000 7f9302104640 1 -- 172.21.15.94:0/1536386887 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0cb1c0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.405+0000 7f9301903640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:13.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.406+0000 7f9302104640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0cf360 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f92fc06e030 tx=0x7f92ec02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f55c51292cd6c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:13.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.406+0000 7f9301102640 1 -- 172.21.15.94:0/1536386887 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec031860 con 0x7f92fc0af8f0 2023-10-16T08:53:13.411 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.406+0000 7f9301102640 1 -- 172.21.15.94:0/1536386887 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0319c0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.406+0000 7f9301102640 1 -- 172.21.15.94:0/1536386887 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec031d50 con 0x7f92fc0af8f0 2023-10-16T08:53:13.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 -- 172.21.15.94:0/1536386887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 msgr2=0x7f92fc0cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0cf360 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f92fc06e030 tx=0x7f92ec02b900 comp rx=0 tx=0).stop 2023-10-16T08:53:13.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 -- 172.21.15.94:0/1536386887 shutdown_connections 2023-10-16T08:53:13.412 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 --2- 172.21.15.94:0/1536386887 >> v2:172.21.15.130:3300/0 conn(0x7f92fc0affa0 0x7f92fc06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 --2- 172.21.15.94:0/1536386887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0cf360 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 -- 172.21.15.94:0/1536386887 >> 172.21.15.94:0/1536386887 conn(0x7f92fc0d0640 msgr2=0x7f92fc0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:13.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 -- 172.21.15.94:0/1536386887 shutdown_connections 2023-10-16T08:53:13.413 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.407+0000 7f9303106640 1 -- 172.21.15.94:0/1536386887 wait complete. 2023-10-16T08:53:13.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.408+0000 7f9303106640 1 Processor -- start 2023-10-16T08:53:13.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.409+0000 7f9303106640 1 -- start start 2023-10-16T08:53:13.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.409+0000 7f9303106640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.416 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9303106640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92fc0affa0 0x7f92fc14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9303106640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc15e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9303106640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc14f2e0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9303106640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0aeb80 con 0x7f92fc0affa0 2023-10-16T08:53:13.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9303106640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0ae2e0 con 0x7f92fc0cf8a0 2023-10-16T08:53:13.417 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33412/0 (socket says 172.21.15.94:33412) 2023-10-16T08:53:13.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 -- 172.21.15.94:0/454849689 learned_addr learned my addr 172.21.15.94:0/454849689 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:13.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302905640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 -- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 msgr2=0x7f92fc15e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.418 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc15e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 -- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92fc0affa0 msgr2=0x7f92fc14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92fc0affa0 0x7f92fc14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.410+0000 7f9302104640 1 -- 172.21.15.94:0/454849689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0094d0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.411+0000 7f9302104640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0adc20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f92ec02b940 tx=0x7f92ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:13.419 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.411+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec031830 con 0x7f92fc0af8f0 2023-10-16T08:53:13.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.411+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0443f0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.411+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0447a0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.411+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc0ae5c0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.411+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc14c3c0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.420 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.412+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc04e9b0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.413+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92ec044900 con 0x7f92fc0af8f0 2023-10-16T08:53:13.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.414+0000 7f92faffd640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f92e806ae70 0x7f92e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.421 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.414+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f92ec0abf30 con 0x7f92fc0af8f0 2023-10-16T08:53:13.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.414+0000 7f9301903640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f92e806ae70 0x7f92e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.415+0000 7f9301903640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f92e806ae70 0x7f92e806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92f0006fd0 tx=0x7f92f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:13.422 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.418+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92ec076f90 con 0x7f92fc0af8f0 2023-10-16T08:53:13.613 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.611+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92fc06c160 con 0x7f92fc0af8f0 2023-10-16T08:53:13.616 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.614+0000 7f92faffd640 1 -- 172.21.15.94:0/454849689 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16782 (secure 0 0 0) 0x7f92ec07a5b0 con 0x7f92fc0af8f0 2023-10-16T08:53:13.616 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:13.617 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":41,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","created":"2023-10-16T08:50:54.853831+0000","modified":"2023-10-16T08:53:10.287322+0000","last_up_change":"2023-10-16T08:51:07.272962+0000","last_in_change":"2023-10-16T08:50:58.301863+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T08:51:07.884479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T08:53:07.043696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T08:53:07.738370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d86dc3f4-fa7d-4275-b6da-da86ccad7188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6801","nonce":838690499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6803","nonce":838690499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6807","nonce":838690499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":838690499},{"type":"v1","addr":"172.21.15.94:6805","nonce":838690499}]},"public_addr":"172.21.15.94:6801/838690499","cluster_addr":"172.21.15.94:6803/838690499","heartbeat_back_addr":"172.21.15.94:6807/838690499","heartbeat_front_addr":"172.21.15.94:6805/838690499","state":["exists","up"]},{"osd":1,"uuid":"d96d9a3f-5002-4580-bde8-303c29927087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6809","nonce":3630710263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6811","nonce":3630710263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6815","nonce":3630710263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":3630710263},{"type":"v1","addr":"172.21.15.94:6813","nonce":3630710263}]},"public_addr":"172.21.15.94:6809/3630710263","cluster_addr":"172.21.15.94:6811/3630710263","heartbeat_back_addr":"172.21.15.94:6815/3630710263","heartbeat_front_addr":"172.21.15.94:6813/3630710263","state":["exists","up"]},{"osd":2,"uuid":"4f1e1bf7-5cf2-4e9d-8228-97bfc42f9079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6817","nonce":2790169838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6819","nonce":2790169838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6825","nonce":2790169838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2790169838},{"type":"v1","addr":"172.21.15.94:6821","nonce":2790169838}]},"public_addr":"172.21.15.94:6817/2790169838","cluster_addr":"172.21.15.94:6819/2790169838","heartbeat_back_addr":"172.21.15.94:6825/2790169838","heartbeat_front_addr":"172.21.15.94:6821/2790169838","state":["exists","up"]},{"osd":3,"uuid":"47dab8eb-15dc-4442-871a-b77860998a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6824","nonce":1791163836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6827","nonce":1791163836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6831","nonce":1791163836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1791163836},{"type":"v1","addr":"172.21.15.94:6829","nonce":1791163836}]},"public_addr":"172.21.15.94:6824/1791163836","cluster_addr":"172.21.15.94:6827/1791163836","heartbeat_back_addr":"172.21.15.94:6831/1791163836","heartbeat_front_addr":"172.21.15.94:6829/1791163836","state":["exists","up"]},{"osd":4,"uuid":"79c3ae33-4a13-4e20-99a9-380c938cfda4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6825","nonce":4232198053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6827","nonce":4232198053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6831","nonce":4232198053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":4232198053},{"type":"v1","addr":"172.21.15.130:6829","nonce":4232198053}]},"public_addr":"172.21.15.130:6825/4232198053","cluster_addr":"172.21.15.130:6827/4232198053","heartbeat_back_addr":"172.21.15.130:6831/4232198053","heartbeat_front_addr":"172.21.15.130:6829/4232198053","state":["exists","up"]},{"osd":5,"uuid":"e49c8ff4-02b7-4c23-9297-cef6d9301761","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6803","nonce":3871839705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6807","nonce":3871839705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6815","nonce":3871839705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3871839705},{"type":"v1","addr":"172.21.15.130:6811","nonce":3871839705}]},"public_addr":"172.21.15.130:6803/3871839705","cluster_addr":"172.21.15.130:6807/3871839705","heartbeat_back_addr":"172.21.15.130:6815/3871839705","heartbeat_front_addr":"172.21.15.130:6811/3871839705","state":["exists","up"]},{"osd":6,"uuid":"3e59f2d4-3bdf-4442-afad-dbd7fef9cd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6802","nonce":973414917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6806","nonce":973414917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6814","nonce":973414917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":973414917},{"type":"v1","addr":"172.21.15.130:6810","nonce":973414917}]},"public_addr":"172.21.15.130:6802/973414917","cluster_addr":"172.21.15.130:6806/973414917","heartbeat_back_addr":"172.21.15.130:6814/973414917","heartbeat_front_addr":"172.21.15.130:6810/973414917","state":["exists","up"]},{"osd":7,"uuid":"24742a3c-8f31-41d9-b0a8-a5e0365b88f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6817","nonce":3792799510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6819","nonce":3792799510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6823","nonce":3792799510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3792799510},{"type":"v1","addr":"172.21.15.130:6821","nonce":3792799510}]},"public_addr":"172.21.15.130:6817/3792799510","cluster_addr":"172.21.15.130:6819/3792799510","heartbeat_back_addr":"172.21.15.130:6823/3792799510","heartbeat_front_addr":"172.21.15.130:6821/3792799510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.554526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.842107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.874405+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.633851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.986861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.659147+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.589016+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T08:51:03.960606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T08:53:13.619 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f92e806ae70 msgr2=0x7f92e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f92e806ae70 0x7f92e806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92f0006fd0 tx=0x7f92f0008040 comp rx=0 tx=0).stop 2023-10-16T08:53:13.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 msgr2=0x7f92fc0adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0adc20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f92ec02b940 tx=0x7f92ec0046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 shutdown_connections 2023-10-16T08:53:13.620 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f92fc0cf8a0 0x7f92fc15e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f92e806ae70 0x7f92e806d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92fc0affa0 0x7f92fc14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 --2- 172.21.15.94:0/454849689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0af8f0 0x7f92fc0adc20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 >> 172.21.15.94:0/454849689 conn(0x7f92fc0d0640 msgr2=0x7f92fc15eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:13.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 shutdown_connections 2023-10-16T08:53:13.621 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.617+0000 7f9303106640 1 -- 172.21.15.94:0/454849689 wait complete. 2023-10-16T08:53:13.639 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T08:53:13.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T08:53:13.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.850+0000 7fe10a664640 1 Processor -- start 2023-10-16T08:53:13.852 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.850+0000 7fe10a664640 1 -- start start 2023-10-16T08:53:13.853 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.851+0000 7fe10a664640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1040b0010 0x7fe1040701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.851+0000 7fe10a664640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe10415ad00 0x7fe10415f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.851+0000 7fe10a664640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10415f580 con 0x7fe1040b03f0 2023-10-16T08:53:13.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.851+0000 7fe10a664640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1040707f0 con 0x7fe1040b0010 2023-10-16T08:53:13.854 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.851+0000 7fe10a664640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe104070ad0 con 0x7fe10415ad00 2023-10-16T08:53:13.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe103fff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe1040b0010 0x7fe1040701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe108c01640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe1040b03f0 0x7fe10415b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56554/0 (socket says 172.21.15.94:56554) 2023-10-16T08:53:13.855 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe108c01640 1 -- 172.21.15.94:0/2742535209 learned_addr learned my addr 172.21.15.94:0/2742535209 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe1037fe640 1 --2- 172.21.15.94:0/2742535209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe10415ad00 0x7fe10415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe103fff640 1 -- 172.21.15.94:0/2742535209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe10415ad00 msgr2=0x7fe10415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe103fff640 1 --2- 172.21.15.94:0/2742535209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe10415ad00 0x7fe10415f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe103fff640 1 -- 172.21.15.94:0/2742535209 >> v1:172.21.15.94:6789/0 conn(0x7fe1040b03f0 legacy=0x7fe10415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe103fff640 1 -- 172.21.15.94:0/2742535209 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10415b1d0 con 0x7fe1040b0010 2023-10-16T08:53:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.852+0000 7fe102ffd640 1 -- 172.21.15.94:0/2742535209 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339940283 0 0) 0x7fe0fc001110 con 0x7fe1040b03f0 2023-10-16T08:53:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.853+0000 7fe103fff640 1 --2- 172.21.15.94:0/2742535209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe1040701a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009d90 tx=0x7fe0f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e760442f24d4e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe102ffd640 1 -- 172.21.15.94:0/2742535209 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f402cc50 con 0x7fe1040b0010 2023-10-16T08:53:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe102ffd640 1 -- 172.21.15.94:0/2742535209 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f402cdb0 con 0x7fe1040b0010 2023-10-16T08:53:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe102ffd640 1 -- 172.21.15.94:0/2742535209 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4034660 con 0x7fe1040b0010 2023-10-16T08:53:13.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe10a664640 1 -- 172.21.15.94:0/2742535209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 msgr2=0x7fe1040701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe10a664640 1 --2- 172.21.15.94:0/2742535209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe1040701a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009d90 tx=0x7fe0f402bea0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe10a664640 1 -- 172.21.15.94:0/2742535209 shutdown_connections 2023-10-16T08:53:13.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe10a664640 1 --2- 172.21.15.94:0/2742535209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe10415ad00 0x7fe10415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.859 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe10a664640 1 --2- 172.21.15.94:0/2742535209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe1040701a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.854+0000 7fe10a664640 1 -- 172.21.15.94:0/2742535209 >> 172.21.15.94:0/2742535209 conn(0x7fe10406c1c0 msgr2=0x7fe10406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.855+0000 7fe10a664640 1 -- 172.21.15.94:0/2742535209 shutdown_connections 2023-10-16T08:53:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.855+0000 7fe10a664640 1 -- 172.21.15.94:0/2742535209 wait complete. 2023-10-16T08:53:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.856+0000 7fe10a664640 1 Processor -- start 2023-10-16T08:53:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.856+0000 7fe10a664640 1 -- start start 2023-10-16T08:53:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.857+0000 7fe10a664640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe104154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.857+0000 7fe10a664640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1040b03f0 0x7fe104155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.857+0000 7fe10a664640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe10415ad00 0x7fe104155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.857+0000 7fe10a664640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c5660 con 0x7fe1040b0010 2023-10-16T08:53:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.857+0000 7fe10a664640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041548b0 con 0x7fe10415ad00 2023-10-16T08:53:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.857+0000 7fe10a664640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c4cc0 con 0x7fe1040b03f0 2023-10-16T08:53:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe104154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe104154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33432/0 (socket says 172.21.15.94:33432) 2023-10-16T08:53:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 -- 172.21.15.94:0/2491948462 learned_addr learned my addr 172.21.15.94:0/2491948462 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 -- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1040b03f0 msgr2=0x7fe104155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe1037fe640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1040b03f0 0x7fe104155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1040b03f0 0x7fe104155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 -- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe10415ad00 msgr2=0x7fe104155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:13.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe10415ad00 0x7fe104155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:13.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 -- 172.21.15.94:0/2491948462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4009a70 con 0x7fe1040b0010 2023-10-16T08:53:13.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.858+0000 7fe103fff640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe104154370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009eb0 tx=0x7fe0f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:13.865 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.859+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f403e610 con 0x7fe1040b0010 2023-10-16T08:53:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.859+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f403e790 con 0x7fe1040b0010 2023-10-16T08:53:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.859+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1041f6650 con 0x7fe1040b0010 2023-10-16T08:53:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.859+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f403eb40 con 0x7fe1040b0010 2023-10-16T08:53:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.859+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1040c5a80 con 0x7fe1040b0010 2023-10-16T08:53:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.860+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1040c4e80 con 0x7fe1040b0010 2023-10-16T08:53:13.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.861+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0f403b050 con 0x7fe1040b0010 2023-10-16T08:53:13.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.862+0000 7fe100ff9640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe0e406ae70 0x7fe0e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.862+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe0f40abb00 con 0x7fe1040b0010 2023-10-16T08:53:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.862+0000 7fe1037fe640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe0e406ae70 0x7fe0e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.863+0000 7fe1037fe640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe0e406ae70 0x7fe0e406d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec006fd0 tx=0x7fe0ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:13.866+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0f40ade60 con 0x7fe1040b0010 2023-10-16T08:53:14.055 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.053+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 --> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe104070db0 con 0x7fe0e406ae70 2023-10-16T08:53:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.064+0000 7fe100ff9640 1 -- 172.21.15.94:0/2491948462 <== mgr.4107 v2:172.21.15.94:6832/2208206022 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286851 (secure 0 0 0) 0x7fe0ec00e4c0 con 0x7fe0e406ae70 2023-10-16T08:53:14.070 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:14.072 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2023-10-16T08:53:14.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe0e406ae70 msgr2=0x7fe0e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.073 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe0e406ae70 0x7fe0e406d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec006fd0 tx=0x7fe0ec008040 comp rx=0 tx=0).stop 2023-10-16T08:53:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 msgr2=0x7fe104154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe104154370 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009eb0 tx=0x7fe0f4004a40 comp rx=0 tx=0).stop 2023-10-16T08:53:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 shutdown_connections 2023-10-16T08:53:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe0e406ae70 0x7fe0e406d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe10415ad00 0x7fe104155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1040b03f0 0x7fe104155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 --2- 172.21.15.94:0/2491948462 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe1040b0010 0x7fe104154370 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 >> 172.21.15.94:0/2491948462 conn(0x7fe10406c1c0 msgr2=0x7fe10415e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 shutdown_connections 2023-10-16T08:53:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.070+0000 7fe10a664640 1 -- 172.21.15.94:0/2491948462 wait complete. 2023-10-16T08:53:14.092 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-10-16T08:53:13.851909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237712,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737008,"statfs":{"total":773094113280,"available":772850696192,"internally_reserved":0,"allocated":4988928,"data_stored":2802092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001647"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296119+0000","last_change":"2023-10-16T08:53:09.314145+0000","last_active":"2023-10-16T08:53:10.296119+0000","last_peered":"2023-10-16T08:53:10.296119+0000","last_clean":"2023-10-16T08:53:10.296119+0000","last_became_active":"2023-10-16T08:53:09.313854+0000","last_became_peered":"2023-10-16T08:53:09.313854+0000","last_unstale":"2023-10-16T08:53:10.296119+0000","last_undegraded":"2023-10-16T08:53:10.296119+0000","last_fullsized":"2023-10-16T08:53:10.296119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:08:23.476327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295726+0000","last_change":"2023-10-16T08:53:09.340988+0000","last_active":"2023-10-16T08:53:10.295726+0000","last_peered":"2023-10-16T08:53:10.295726+0000","last_clean":"2023-10-16T08:53:10.295726+0000","last_became_active":"2023-10-16T08:53:09.340731+0000","last_became_peered":"2023-10-16T08:53:09.340731+0000","last_unstale":"2023-10-16T08:53:10.295726+0000","last_undegraded":"2023-10-16T08:53:10.295726+0000","last_fullsized":"2023-10-16T08:53:10.295726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:01:38.680311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649652+0000","last_change":"2023-10-16T08:53:09.337644+0000","last_active":"2023-10-16T08:53:10.649652+0000","last_peered":"2023-10-16T08:53:10.649652+0000","last_clean":"2023-10-16T08:53:10.649652+0000","last_became_active":"2023-10-16T08:53:09.337271+0000","last_became_peered":"2023-10-16T08:53:09.337271+0000","last_unstale":"2023-10-16T08:53:10.649652+0000","last_undegraded":"2023-10-16T08:53:10.649652+0000","last_fullsized":"2023-10-16T08:53:10.649652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:40:51.504982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450668+0000","last_change":"2023-10-16T08:53:09.339105+0000","last_active":"2023-10-16T08:53:10.450668+0000","last_peered":"2023-10-16T08:53:10.450668+0000","last_clean":"2023-10-16T08:53:10.450668+0000","last_became_active":"2023-10-16T08:53:09.338775+0000","last_became_peered":"2023-10-16T08:53:09.338775+0000","last_unstale":"2023-10-16T08:53:10.450668+0000","last_undegraded":"2023-10-16T08:53:10.450668+0000","last_fullsized":"2023-10-16T08:53:10.450668+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:36.922136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450487+0000","last_change":"2023-10-16T08:53:09.338724+0000","last_active":"2023-10-16T08:53:10.450487+0000","last_peered":"2023-10-16T08:53:10.450487+0000","last_clean":"2023-10-16T08:53:10.450487+0000","last_became_active":"2023-10-16T08:53:09.338420+0000","last_became_peered":"2023-10-16T08:53:09.338420+0000","last_unstale":"2023-10-16T08:53:10.450487+0000","last_undegraded":"2023-10-16T08:53:10.450487+0000","last_fullsized":"2023-10-16T08:53:10.450487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:28.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293921+0000","last_change":"2023-10-16T08:53:09.307932+0000","last_active":"2023-10-16T08:53:10.293921+0000","last_peered":"2023-10-16T08:53:10.293921+0000","last_clean":"2023-10-16T08:53:10.293921+0000","last_became_active":"2023-10-16T08:53:09.307592+0000","last_became_peered":"2023-10-16T08:53:09.307592+0000","last_unstale":"2023-10-16T08:53:10.293921+0000","last_undegraded":"2023-10-16T08:53:10.293921+0000","last_fullsized":"2023-10-16T08:53:10.293921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:23.754818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300462+0000","last_change":"2023-10-16T08:53:09.315759+0000","last_active":"2023-10-16T08:53:10.300462+0000","last_peered":"2023-10-16T08:53:10.300462+0000","last_clean":"2023-10-16T08:53:10.300462+0000","last_became_active":"2023-10-16T08:53:09.315362+0000","last_became_peered":"2023-10-16T08:53:09.315362+0000","last_unstale":"2023-10-16T08:53:10.300462+0000","last_undegraded":"2023-10-16T08:53:10.300462+0000","last_fullsized":"2023-10-16T08:53:10.300462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:18:50.161673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295461+0000","last_change":"2023-10-16T08:53:09.327510+0000","last_active":"2023-10-16T08:53:10.295461+0000","last_peered":"2023-10-16T08:53:10.295461+0000","last_clean":"2023-10-16T08:53:10.295461+0000","last_became_active":"2023-10-16T08:53:09.327199+0000","last_became_peered":"2023-10-16T08:53:09.327199+0000","last_unstale":"2023-10-16T08:53:10.295461+0000","last_undegraded":"2023-10-16T08:53:10.295461+0000","last_fullsized":"2023-10-16T08:53:10.295461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:41.150478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650049+0000","last_change":"2023-10-16T08:53:09.330416+0000","last_active":"2023-10-16T08:53:10.650049+0000","last_peered":"2023-10-16T08:53:10.650049+0000","last_clean":"2023-10-16T08:53:10.650049+0000","last_became_active":"2023-10-16T08:53:09.330124+0000","last_became_peered":"2023-10-16T08:53:09.330124+0000","last_unstale":"2023-10-16T08:53:10.650049+0000","last_undegraded":"2023-10-16T08:53:10.650049+0000","last_fullsized":"2023-10-16T08:53:10.650049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:08.961007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301286+0000","last_change":"2023-10-16T08:53:09.329091+0000","last_active":"2023-10-16T08:53:10.301286+0000","last_peered":"2023-10-16T08:53:10.301286+0000","last_clean":"2023-10-16T08:53:10.301286+0000","last_became_active":"2023-10-16T08:53:09.328773+0000","last_became_peered":"2023-10-16T08:53:09.328773+0000","last_unstale":"2023-10-16T08:53:10.301286+0000","last_undegraded":"2023-10-16T08:53:10.301286+0000","last_fullsized":"2023-10-16T08:53:10.301286+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:01:38.680311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301684+0000","last_change":"2023-10-16T08:53:09.334158+0000","last_active":"2023-10-16T08:53:10.301684+0000","last_peered":"2023-10-16T08:53:10.301684+0000","last_clean":"2023-10-16T08:53:10.301684+0000","last_became_active":"2023-10-16T08:53:09.332690+0000","last_became_peered":"2023-10-16T08:53:09.332690+0000","last_unstale":"2023-10-16T08:53:10.301684+0000","last_undegraded":"2023-10-16T08:53:10.301684+0000","last_fullsized":"2023-10-16T08:53:10.301684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:15.896046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649772+0000","last_change":"2023-10-16T08:53:09.337984+0000","last_active":"2023-10-16T08:53:10.649772+0000","last_peered":"2023-10-16T08:53:10.649772+0000","last_clean":"2023-10-16T08:53:10.649772+0000","last_became_active":"2023-10-16T08:53:09.337679+0000","last_became_peered":"2023-10-16T08:53:09.337679+0000","last_unstale":"2023-10-16T08:53:10.649772+0000","last_undegraded":"2023-10-16T08:53:10.649772+0000","last_fullsized":"2023-10-16T08:53:10.649772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:26.917681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300734+0000","last_change":"2023-10-16T08:53:09.329647+0000","last_active":"2023-10-16T08:53:10.300734+0000","last_peered":"2023-10-16T08:53:10.300734+0000","last_clean":"2023-10-16T08:53:10.300734+0000","last_became_active":"2023-10-16T08:53:09.329322+0000","last_became_peered":"2023-10-16T08:53:09.329322+0000","last_unstale":"2023-10-16T08:53:10.300734+0000","last_undegraded":"2023-10-16T08:53:10.300734+0000","last_fullsized":"2023-10-16T08:53:10.300734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:41.150478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652332+0000","last_change":"2023-10-16T08:53:09.330922+0000","last_active":"2023-10-16T08:53:10.652332+0000","last_peered":"2023-10-16T08:53:10.652332+0000","last_clean":"2023-10-16T08:53:10.652332+0000","last_became_active":"2023-10-16T08:53:09.330606+0000","last_became_peered":"2023-10-16T08:53:09.330606+0000","last_unstale":"2023-10-16T08:53:10.652332+0000","last_undegraded":"2023-10-16T08:53:10.652332+0000","last_fullsized":"2023-10-16T08:53:10.652332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:03:03.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300594+0000","last_change":"2023-10-16T08:53:09.334429+0000","last_active":"2023-10-16T08:53:10.300594+0000","last_peered":"2023-10-16T08:53:10.300594+0000","last_clean":"2023-10-16T08:53:10.300594+0000","last_became_active":"2023-10-16T08:53:09.332656+0000","last_became_peered":"2023-10-16T08:53:09.332656+0000","last_unstale":"2023-10-16T08:53:10.300594+0000","last_undegraded":"2023-10-16T08:53:10.300594+0000","last_fullsized":"2023-10-16T08:53:10.300594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:50.792920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650920+0000","last_change":"2023-10-16T08:53:09.338858+0000","last_active":"2023-10-16T08:53:10.650920+0000","last_peered":"2023-10-16T08:53:10.650920+0000","last_clean":"2023-10-16T08:53:10.650920+0000","last_became_active":"2023-10-16T08:53:09.338511+0000","last_became_peered":"2023-10-16T08:53:09.338511+0000","last_unstale":"2023-10-16T08:53:10.650920+0000","last_undegraded":"2023-10-16T08:53:10.650920+0000","last_fullsized":"2023-10-16T08:53:10.650920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:46:48.396710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652772+0000","last_change":"2023-10-16T08:53:09.340239+0000","last_active":"2023-10-16T08:53:10.652772+0000","last_peered":"2023-10-16T08:53:10.652772+0000","last_clean":"2023-10-16T08:53:10.652772+0000","last_became_active":"2023-10-16T08:53:09.339908+0000","last_became_peered":"2023-10-16T08:53:09.339908+0000","last_unstale":"2023-10-16T08:53:10.652772+0000","last_undegraded":"2023-10-16T08:53:10.652772+0000","last_fullsized":"2023-10-16T08:53:10.652772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:14.330291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654327+0000","last_change":"2023-10-16T08:53:09.330054+0000","last_active":"2023-10-16T08:53:10.654327+0000","last_peered":"2023-10-16T08:53:10.654327+0000","last_clean":"2023-10-16T08:53:10.654327+0000","last_became_active":"2023-10-16T08:53:09.329783+0000","last_became_peered":"2023-10-16T08:53:09.329783+0000","last_unstale":"2023-10-16T08:53:10.654327+0000","last_undegraded":"2023-10-16T08:53:10.654327+0000","last_fullsized":"2023-10-16T08:53:10.654327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:51:24.104413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450792+0000","last_change":"2023-10-16T08:53:09.342823+0000","last_active":"2023-10-16T08:53:10.450792+0000","last_peered":"2023-10-16T08:53:10.450792+0000","last_clean":"2023-10-16T08:53:10.450792+0000","last_became_active":"2023-10-16T08:53:09.342442+0000","last_became_peered":"2023-10-16T08:53:09.342442+0000","last_unstale":"2023-10-16T08:53:10.450792+0000","last_undegraded":"2023-10-16T08:53:10.450792+0000","last_fullsized":"2023-10-16T08:53:10.450792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:46.384011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653782+0000","last_change":"2023-10-16T08:53:09.331842+0000","last_active":"2023-10-16T08:53:10.653782+0000","last_peered":"2023-10-16T08:53:10.653782+0000","last_clean":"2023-10-16T08:53:10.653782+0000","last_became_active":"2023-10-16T08:53:09.331537+0000","last_became_peered":"2023-10-16T08:53:09.331537+0000","last_unstale":"2023-10-16T08:53:10.653782+0000","last_undegraded":"2023-10-16T08:53:10.653782+0000","last_fullsized":"2023-10-16T08:53:10.653782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:10:22.348283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300886+0000","last_change":"2023-10-16T08:53:09.312591+0000","last_active":"2023-10-16T08:53:10.300886+0000","last_peered":"2023-10-16T08:53:10.300886+0000","last_clean":"2023-10-16T08:53:10.300886+0000","last_became_active":"2023-10-16T08:53:09.311955+0000","last_became_peered":"2023-10-16T08:53:09.311955+0000","last_unstale":"2023-10-16T08:53:10.300886+0000","last_undegraded":"2023-10-16T08:53:10.300886+0000","last_fullsized":"2023-10-16T08:53:10.300886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:26:13.525343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653211+0000","last_change":"2023-10-16T08:53:09.336730+0000","last_active":"2023-10-16T08:53:10.653211+0000","last_peered":"2023-10-16T08:53:10.653211+0000","last_clean":"2023-10-16T08:53:10.653211+0000","last_became_active":"2023-10-16T08:53:09.336031+0000","last_became_peered":"2023-10-16T08:53:09.336031+0000","last_unstale":"2023-10-16T08:53:10.653211+0000","last_undegraded":"2023-10-16T08:53:10.653211+0000","last_fullsized":"2023-10-16T08:53:10.653211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:50.600974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652682+0000","last_change":"2023-10-16T08:53:09.330353+0000","last_active":"2023-10-16T08:53:10.652682+0000","last_peered":"2023-10-16T08:53:10.652682+0000","last_clean":"2023-10-16T08:53:10.652682+0000","last_became_active":"2023-10-16T08:53:09.330038+0000","last_became_peered":"2023-10-16T08:53:09.330038+0000","last_unstale":"2023-10-16T08:53:10.652682+0000","last_undegraded":"2023-10-16T08:53:10.652682+0000","last_fullsized":"2023-10-16T08:53:10.652682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:26:02.481433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450307+0000","last_change":"2023-10-16T08:53:09.329214+0000","last_active":"2023-10-16T08:53:10.450307+0000","last_peered":"2023-10-16T08:53:10.450307+0000","last_clean":"2023-10-16T08:53:10.450307+0000","last_became_active":"2023-10-16T08:53:09.328967+0000","last_became_peered":"2023-10-16T08:53:09.328967+0000","last_unstale":"2023-10-16T08:53:10.450307+0000","last_undegraded":"2023-10-16T08:53:10.450307+0000","last_fullsized":"2023-10-16T08:53:10.450307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:33:08.959927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654485+0000","last_change":"2023-10-16T08:53:09.320084+0000","last_active":"2023-10-16T08:53:10.654485+0000","last_peered":"2023-10-16T08:53:10.654485+0000","last_clean":"2023-10-16T08:53:10.654485+0000","last_became_active":"2023-10-16T08:53:09.319796+0000","last_became_peered":"2023-10-16T08:53:09.319796+0000","last_unstale":"2023-10-16T08:53:10.654485+0000","last_undegraded":"2023-10-16T08:53:10.654485+0000","last_fullsized":"2023-10-16T08:53:10.654485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:18:16.816775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294736+0000","last_change":"2023-10-16T08:53:09.312693+0000","last_active":"2023-10-16T08:53:10.294736+0000","last_peered":"2023-10-16T08:53:10.294736+0000","last_clean":"2023-10-16T08:53:10.294736+0000","last_became_active":"2023-10-16T08:53:09.312397+0000","last_became_peered":"2023-10-16T08:53:09.312397+0000","last_unstale":"2023-10-16T08:53:10.294736+0000","last_undegraded":"2023-10-16T08:53:10.294736+0000","last_fullsized":"2023-10-16T08:53:10.294736+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:19.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654075+0000","last_change":"2023-10-16T08:53:09.334745+0000","last_active":"2023-10-16T08:53:10.654075+0000","last_peered":"2023-10-16T08:53:10.654075+0000","last_clean":"2023-10-16T08:53:10.654075+0000","last_became_active":"2023-10-16T08:53:09.333418+0000","last_became_peered":"2023-10-16T08:53:09.333418+0000","last_unstale":"2023-10-16T08:53:10.654075+0000","last_undegraded":"2023-10-16T08:53:10.654075+0000","last_fullsized":"2023-10-16T08:53:10.654075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:35:04.593776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301245+0000","last_change":"2023-10-16T08:53:09.325132+0000","last_active":"2023-10-16T08:53:10.301245+0000","last_peered":"2023-10-16T08:53:10.301245+0000","last_clean":"2023-10-16T08:53:10.301245+0000","last_became_active":"2023-10-16T08:53:09.324800+0000","last_became_peered":"2023-10-16T08:53:09.324800+0000","last_unstale":"2023-10-16T08:53:10.301245+0000","last_undegraded":"2023-10-16T08:53:10.301245+0000","last_fullsized":"2023-10-16T08:53:10.301245+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:13:14.292389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653622+0000","last_change":"2023-10-16T08:53:09.322492+0000","last_active":"2023-10-16T08:53:10.653622+0000","last_peered":"2023-10-16T08:53:10.653622+0000","last_clean":"2023-10-16T08:53:10.653622+0000","last_became_active":"2023-10-16T08:53:09.322091+0000","last_became_peered":"2023-10-16T08:53:09.322091+0000","last_unstale":"2023-10-16T08:53:10.653622+0000","last_undegraded":"2023-10-16T08:53:10.653622+0000","last_fullsized":"2023-10-16T08:53:10.653622+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:50:03.058127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650848+0000","last_change":"2023-10-16T08:53:09.318256+0000","last_active":"2023-10-16T08:53:10.650848+0000","last_peered":"2023-10-16T08:53:10.650848+0000","last_clean":"2023-10-16T08:53:10.650848+0000","last_became_active":"2023-10-16T08:53:09.317978+0000","last_became_peered":"2023-10-16T08:53:09.317978+0000","last_unstale":"2023-10-16T08:53:10.650848+0000","last_undegraded":"2023-10-16T08:53:10.650848+0000","last_fullsized":"2023-10-16T08:53:10.650848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:37:27.782772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652976+0000","last_change":"2023-10-16T08:53:09.343566+0000","last_active":"2023-10-16T08:53:10.652976+0000","last_peered":"2023-10-16T08:53:10.652976+0000","last_clean":"2023-10-16T08:53:10.652976+0000","last_became_active":"2023-10-16T08:53:09.343269+0000","last_became_peered":"2023-10-16T08:53:09.343269+0000","last_unstale":"2023-10-16T08:53:10.652976+0000","last_undegraded":"2023-10-16T08:53:10.652976+0000","last_fullsized":"2023-10-16T08:53:10.652976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:21:23.786535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293987+0000","last_change":"2023-10-16T08:53:09.335382+0000","last_active":"2023-10-16T08:53:10.293987+0000","last_peered":"2023-10-16T08:53:10.293987+0000","last_clean":"2023-10-16T08:53:10.293987+0000","last_became_active":"2023-10-16T08:53:09.335094+0000","last_became_peered":"2023-10-16T08:53:09.335094+0000","last_unstale":"2023-10-16T08:53:10.293987+0000","last_undegraded":"2023-10-16T08:53:10.293987+0000","last_fullsized":"2023-10-16T08:53:10.293987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:50.600974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652176+0000","last_change":"2023-10-16T08:53:09.340507+0000","last_active":"2023-10-16T08:53:10.652176+0000","last_peered":"2023-10-16T08:53:10.652176+0000","last_clean":"2023-10-16T08:53:10.652176+0000","last_became_active":"2023-10-16T08:53:09.338563+0000","last_became_peered":"2023-10-16T08:53:09.338563+0000","last_unstale":"2023-10-16T08:53:10.652176+0000","last_undegraded":"2023-10-16T08:53:10.652176+0000","last_fullsized":"2023-10-16T08:53:10.652176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:58:25.526336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654488+0000","last_change":"2023-10-16T08:53:08.300319+0000","last_active":"2023-10-16T08:53:10.654488+0000","last_peered":"2023-10-16T08:53:10.654488+0000","last_clean":"2023-10-16T08:53:10.654488+0000","last_became_active":"2023-10-16T08:53:08.299704+0000","last_became_peered":"2023-10-16T08:53:08.299704+0000","last_unstale":"2023-10-16T08:53:10.654488+0000","last_undegraded":"2023-10-16T08:53:10.654488+0000","last_fullsized":"2023-10-16T08:53:10.654488+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:13:58.329186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294695+0000","last_change":"2023-10-16T08:53:09.324960+0000","last_active":"2023-10-16T08:53:10.294695+0000","last_peered":"2023-10-16T08:53:10.294695+0000","last_clean":"2023-10-16T08:53:10.294695+0000","last_became_active":"2023-10-16T08:53:09.324522+0000","last_became_peered":"2023-10-16T08:53:09.324522+0000","last_unstale":"2023-10-16T08:53:10.294695+0000","last_undegraded":"2023-10-16T08:53:10.294695+0000","last_fullsized":"2023-10-16T08:53:10.294695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:14:30.075628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649909+0000","last_change":"2023-10-16T08:53:08.291770+0000","last_active":"2023-10-16T08:53:10.649909+0000","last_peered":"2023-10-16T08:53:10.649909+0000","last_clean":"2023-10-16T08:53:10.649909+0000","last_became_active":"2023-10-16T08:53:08.291498+0000","last_became_peered":"2023-10-16T08:53:08.291498+0000","last_unstale":"2023-10-16T08:53:10.649909+0000","last_undegraded":"2023-10-16T08:53:10.649909+0000","last_fullsized":"2023-10-16T08:53:10.649909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:51:23.090483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653586+0000","last_change":"2023-10-16T08:53:09.331474+0000","last_active":"2023-10-16T08:53:10.653586+0000","last_peered":"2023-10-16T08:53:10.653586+0000","last_clean":"2023-10-16T08:53:10.653586+0000","last_became_active":"2023-10-16T08:53:09.331214+0000","last_became_peered":"2023-10-16T08:53:09.331214+0000","last_unstale":"2023-10-16T08:53:10.653586+0000","last_undegraded":"2023-10-16T08:53:10.653586+0000","last_fullsized":"2023-10-16T08:53:10.653586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:14:30.075628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294744+0000","last_change":"2023-10-16T08:53:08.299751+0000","last_active":"2023-10-16T08:53:10.294744+0000","last_peered":"2023-10-16T08:53:10.294744+0000","last_clean":"2023-10-16T08:53:10.294744+0000","last_became_active":"2023-10-16T08:53:08.299499+0000","last_became_peered":"2023-10-16T08:53:08.299499+0000","last_unstale":"2023-10-16T08:53:10.294744+0000","last_undegraded":"2023-10-16T08:53:10.294744+0000","last_fullsized":"2023-10-16T08:53:10.294744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:46:14.319338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296058+0000","last_change":"2023-10-16T08:53:09.316135+0000","last_active":"2023-10-16T08:53:10.296058+0000","last_peered":"2023-10-16T08:53:10.296058+0000","last_clean":"2023-10-16T08:53:10.296058+0000","last_became_active":"2023-10-16T08:53:09.315875+0000","last_became_peered":"2023-10-16T08:53:09.315875+0000","last_unstale":"2023-10-16T08:53:10.296058+0000","last_undegraded":"2023-10-16T08:53:10.296058+0000","last_fullsized":"2023-10-16T08:53:10.296058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:15.896046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.345233+0000","last_change":"2023-10-16T08:53:08.303934+0000","last_active":"2023-10-16T08:53:09.345233+0000","last_peered":"2023-10-16T08:53:09.345233+0000","last_clean":"2023-10-16T08:53:09.345233+0000","last_became_active":"2023-10-16T08:53:08.303396+0000","last_became_peered":"2023-10-16T08:53:08.303396+0000","last_unstale":"2023-10-16T08:53:09.345233+0000","last_undegraded":"2023-10-16T08:53:09.345233+0000","last_fullsized":"2023-10-16T08:53:09.345233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:54.355800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649333+0000","last_change":"2023-10-16T08:53:09.320728+0000","last_active":"2023-10-16T08:53:10.649333+0000","last_peered":"2023-10-16T08:53:10.649333+0000","last_clean":"2023-10-16T08:53:10.649333+0000","last_became_active":"2023-10-16T08:53:09.320114+0000","last_became_peered":"2023-10-16T08:53:09.320114+0000","last_unstale":"2023-10-16T08:53:10.649333+0000","last_undegraded":"2023-10-16T08:53:10.649333+0000","last_fullsized":"2023-10-16T08:53:10.649333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:18.078703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301019+0000","last_change":"2023-10-16T08:53:08.295280+0000","last_active":"2023-10-16T08:53:10.301019+0000","last_peered":"2023-10-16T08:53:10.301019+0000","last_clean":"2023-10-16T08:53:10.301019+0000","last_became_active":"2023-10-16T08:53:08.294976+0000","last_became_peered":"2023-10-16T08:53:08.294976+0000","last_unstale":"2023-10-16T08:53:10.301019+0000","last_undegraded":"2023-10-16T08:53:10.301019+0000","last_fullsized":"2023-10-16T08:53:10.301019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:10:36.682117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301063+0000","last_change":"2023-10-16T08:53:09.312943+0000","last_active":"2023-10-16T08:53:10.301063+0000","last_peered":"2023-10-16T08:53:10.301063+0000","last_clean":"2023-10-16T08:53:10.301063+0000","last_became_active":"2023-10-16T08:53:09.312023+0000","last_became_peered":"2023-10-16T08:53:09.312023+0000","last_unstale":"2023-10-16T08:53:10.301063+0000","last_undegraded":"2023-10-16T08:53:10.301063+0000","last_fullsized":"2023-10-16T08:53:10.301063+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:01:01.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.348020+0000","last_change":"2023-10-16T08:53:08.300967+0000","last_active":"2023-10-16T08:53:09.348020+0000","last_peered":"2023-10-16T08:53:09.348020+0000","last_clean":"2023-10-16T08:53:09.348020+0000","last_became_active":"2023-10-16T08:53:08.300649+0000","last_became_peered":"2023-10-16T08:53:08.300649+0000","last_unstale":"2023-10-16T08:53:09.348020+0000","last_undegraded":"2023-10-16T08:53:09.348020+0000","last_fullsized":"2023-10-16T08:53:09.348020+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:21:13.892542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653351+0000","last_change":"2023-10-16T08:53:09.336747+0000","last_active":"2023-10-16T08:53:10.653351+0000","last_peered":"2023-10-16T08:53:10.653351+0000","last_clean":"2023-10-16T08:53:10.653351+0000","last_became_active":"2023-10-16T08:53:09.336391+0000","last_became_peered":"2023-10-16T08:53:09.336391+0000","last_unstale":"2023-10-16T08:53:10.653351+0000","last_undegraded":"2023-10-16T08:53:10.653351+0000","last_fullsized":"2023-10-16T08:53:10.653351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:07:09.293910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293923+0000","last_change":"2023-10-16T08:53:08.299546+0000","last_active":"2023-10-16T08:53:10.293923+0000","last_peered":"2023-10-16T08:53:10.293923+0000","last_clean":"2023-10-16T08:53:10.293923+0000","last_became_active":"2023-10-16T08:53:08.299085+0000","last_became_peered":"2023-10-16T08:53:08.299085+0000","last_unstale":"2023-10-16T08:53:10.293923+0000","last_undegraded":"2023-10-16T08:53:10.293923+0000","last_fullsized":"2023-10-16T08:53:10.293923+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:08:23.627969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295653+0000","last_change":"2023-10-16T08:53:09.330265+0000","last_active":"2023-10-16T08:53:10.295653+0000","last_peered":"2023-10-16T08:53:10.295653+0000","last_clean":"2023-10-16T08:53:10.295653+0000","last_became_active":"2023-10-16T08:53:09.329810+0000","last_became_peered":"2023-10-16T08:53:09.329810+0000","last_unstale":"2023-10-16T08:53:10.295653+0000","last_undegraded":"2023-10-16T08:53:10.295653+0000","last_fullsized":"2023-10-16T08:53:10.295653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:01:01.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.322252+0000","last_change":"2023-10-16T08:53:08.299481+0000","last_active":"2023-10-16T08:53:09.322252+0000","last_peered":"2023-10-16T08:53:09.322252+0000","last_clean":"2023-10-16T08:53:09.322252+0000","last_became_active":"2023-10-16T08:53:08.299179+0000","last_became_peered":"2023-10-16T08:53:08.299179+0000","last_unstale":"2023-10-16T08:53:09.322252+0000","last_undegraded":"2023-10-16T08:53:09.322252+0000","last_fullsized":"2023-10-16T08:53:09.322252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:21:13.892542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450698+0000","last_change":"2023-10-16T08:53:09.330900+0000","last_active":"2023-10-16T08:53:10.450698+0000","last_peered":"2023-10-16T08:53:10.450698+0000","last_clean":"2023-10-16T08:53:10.450698+0000","last_became_active":"2023-10-16T08:53:09.330601+0000","last_became_peered":"2023-10-16T08:53:09.330601+0000","last_unstale":"2023-10-16T08:53:10.450698+0000","last_undegraded":"2023-10-16T08:53:10.450698+0000","last_fullsized":"2023-10-16T08:53:10.450698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:25.275828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296110+0000","last_change":"2023-10-16T08:53:08.300180+0000","last_active":"2023-10-16T08:53:10.296110+0000","last_peered":"2023-10-16T08:53:10.296110+0000","last_clean":"2023-10-16T08:53:10.296110+0000","last_became_active":"2023-10-16T08:53:08.299093+0000","last_became_peered":"2023-10-16T08:53:08.299093+0000","last_unstale":"2023-10-16T08:53:10.296110+0000","last_undegraded":"2023-10-16T08:53:10.296110+0000","last_fullsized":"2023-10-16T08:53:10.296110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:34.184414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651048+0000","last_change":"2023-10-16T08:53:09.328008+0000","last_active":"2023-10-16T08:53:10.651048+0000","last_peered":"2023-10-16T08:53:10.651048+0000","last_clean":"2023-10-16T08:53:10.651048+0000","last_became_active":"2023-10-16T08:53:09.327705+0000","last_became_peered":"2023-10-16T08:53:09.327705+0000","last_unstale":"2023-10-16T08:53:10.651048+0000","last_undegraded":"2023-10-16T08:53:10.651048+0000","last_fullsized":"2023-10-16T08:53:10.651048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:50:51.754324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301810+0000","last_change":"2023-10-16T08:53:08.297598+0000","last_active":"2023-10-16T08:53:10.301810+0000","last_peered":"2023-10-16T08:53:10.301810+0000","last_clean":"2023-10-16T08:53:10.301810+0000","last_became_active":"2023-10-16T08:53:08.297340+0000","last_became_peered":"2023-10-16T08:53:08.297340+0000","last_unstale":"2023-10-16T08:53:10.301810+0000","last_undegraded":"2023-10-16T08:53:10.301810+0000","last_fullsized":"2023-10-16T08:53:10.301810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:19.331517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649811+0000","last_change":"2023-10-16T08:53:09.328508+0000","last_active":"2023-10-16T08:53:10.649811+0000","last_peered":"2023-10-16T08:53:10.649811+0000","last_clean":"2023-10-16T08:53:10.649811+0000","last_became_active":"2023-10-16T08:53:09.328246+0000","last_became_peered":"2023-10-16T08:53:09.328246+0000","last_unstale":"2023-10-16T08:53:10.649811+0000","last_undegraded":"2023-10-16T08:53:10.649811+0000","last_fullsized":"2023-10-16T08:53:10.649811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:35.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301769+0000","last_change":"2023-10-16T08:53:08.304785+0000","last_active":"2023-10-16T08:53:10.301769+0000","last_peered":"2023-10-16T08:53:10.301769+0000","last_clean":"2023-10-16T08:53:10.301769+0000","last_became_active":"2023-10-16T08:53:08.304494+0000","last_became_peered":"2023-10-16T08:53:08.304494+0000","last_unstale":"2023-10-16T08:53:10.301769+0000","last_undegraded":"2023-10-16T08:53:10.301769+0000","last_fullsized":"2023-10-16T08:53:10.301769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:34.184414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654228+0000","last_change":"2023-10-16T08:53:09.340996+0000","last_active":"2023-10-16T08:53:10.654228+0000","last_peered":"2023-10-16T08:53:10.654228+0000","last_clean":"2023-10-16T08:53:10.654228+0000","last_became_active":"2023-10-16T08:53:09.339854+0000","last_became_peered":"2023-10-16T08:53:09.339854+0000","last_unstale":"2023-10-16T08:53:10.654228+0000","last_undegraded":"2023-10-16T08:53:10.654228+0000","last_fullsized":"2023-10-16T08:53:10.654228+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:19.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295966+0000","last_change":"2023-10-16T08:53:08.298375+0000","last_active":"2023-10-16T08:53:10.295966+0000","last_peered":"2023-10-16T08:53:10.295966+0000","last_clean":"2023-10-16T08:53:10.295966+0000","last_became_active":"2023-10-16T08:53:08.297922+0000","last_became_peered":"2023-10-16T08:53:08.297922+0000","last_unstale":"2023-10-16T08:53:10.295966+0000","last_undegraded":"2023-10-16T08:53:10.295966+0000","last_fullsized":"2023-10-16T08:53:10.295966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:49.778990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649355+0000","last_change":"2023-10-16T08:53:09.330643+0000","last_active":"2023-10-16T08:53:10.649355+0000","last_peered":"2023-10-16T08:53:10.649355+0000","last_clean":"2023-10-16T08:53:10.649355+0000","last_became_active":"2023-10-16T08:53:09.330318+0000","last_became_peered":"2023-10-16T08:53:09.330318+0000","last_unstale":"2023-10-16T08:53:10.649355+0000","last_undegraded":"2023-10-16T08:53:10.649355+0000","last_fullsized":"2023-10-16T08:53:10.649355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:00:17.459331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295812+0000","last_change":"2023-10-16T08:53:08.301924+0000","last_active":"2023-10-16T08:53:10.295812+0000","last_peered":"2023-10-16T08:53:10.295812+0000","last_clean":"2023-10-16T08:53:10.295812+0000","last_became_active":"2023-10-16T08:53:08.301652+0000","last_became_peered":"2023-10-16T08:53:08.301652+0000","last_unstale":"2023-10-16T08:53:10.295812+0000","last_undegraded":"2023-10-16T08:53:10.295812+0000","last_fullsized":"2023-10-16T08:53:10.295812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:18:49.147742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295614+0000","last_change":"2023-10-16T08:53:09.317978+0000","last_active":"2023-10-16T08:53:10.295614+0000","last_peered":"2023-10-16T08:53:10.295614+0000","last_clean":"2023-10-16T08:53:10.295614+0000","last_became_active":"2023-10-16T08:53:09.317603+0000","last_became_peered":"2023-10-16T08:53:09.317603+0000","last_unstale":"2023-10-16T08:53:10.295614+0000","last_undegraded":"2023-10-16T08:53:10.295614+0000","last_fullsized":"2023-10-16T08:53:10.295614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:26:13.525343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293923+0000","last_change":"2023-10-16T08:53:08.300298+0000","last_active":"2023-10-16T08:53:10.293923+0000","last_peered":"2023-10-16T08:53:10.293923+0000","last_clean":"2023-10-16T08:53:10.293923+0000","last_became_active":"2023-10-16T08:53:08.299367+0000","last_became_peered":"2023-10-16T08:53:08.299367+0000","last_unstale":"2023-10-16T08:53:10.293923+0000","last_undegraded":"2023-10-16T08:53:10.293923+0000","last_fullsized":"2023-10-16T08:53:10.293923+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:54.355800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650793+0000","last_change":"2023-10-16T08:53:09.343870+0000","last_active":"2023-10-16T08:53:10.650793+0000","last_peered":"2023-10-16T08:53:10.650793+0000","last_clean":"2023-10-16T08:53:10.650793+0000","last_became_active":"2023-10-16T08:53:09.340331+0000","last_became_peered":"2023-10-16T08:53:09.340331+0000","last_unstale":"2023-10-16T08:53:10.650793+0000","last_undegraded":"2023-10-16T08:53:10.650793+0000","last_fullsized":"2023-10-16T08:53:10.650793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:19.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651930+0000","last_change":"2023-10-16T08:53:08.294226+0000","last_active":"2023-10-16T08:53:10.651930+0000","last_peered":"2023-10-16T08:53:10.651930+0000","last_clean":"2023-10-16T08:53:10.651930+0000","last_became_active":"2023-10-16T08:53:08.293946+0000","last_became_peered":"2023-10-16T08:53:08.293946+0000","last_unstale":"2023-10-16T08:53:10.651930+0000","last_undegraded":"2023-10-16T08:53:10.651930+0000","last_fullsized":"2023-10-16T08:53:10.651930+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:39.172760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295703+0000","last_change":"2023-10-16T08:53:09.320332+0000","last_active":"2023-10-16T08:53:10.295703+0000","last_peered":"2023-10-16T08:53:10.295703+0000","last_clean":"2023-10-16T08:53:10.295703+0000","last_became_active":"2023-10-16T08:53:09.320084+0000","last_became_peered":"2023-10-16T08:53:09.320084+0000","last_unstale":"2023-10-16T08:53:10.295703+0000","last_undegraded":"2023-10-16T08:53:10.295703+0000","last_fullsized":"2023-10-16T08:53:10.295703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:13:14.292389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.348022+0000","last_change":"2023-10-16T08:53:08.301084+0000","last_active":"2023-10-16T08:53:09.348022+0000","last_peered":"2023-10-16T08:53:09.348022+0000","last_clean":"2023-10-16T08:53:09.348022+0000","last_became_active":"2023-10-16T08:53:08.300761+0000","last_became_peered":"2023-10-16T08:53:08.300761+0000","last_unstale":"2023-10-16T08:53:09.348022+0000","last_undegraded":"2023-10-16T08:53:09.348022+0000","last_fullsized":"2023-10-16T08:53:09.348022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:30.692446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295888+0000","last_change":"2023-10-16T08:53:09.319158+0000","last_active":"2023-10-16T08:53:10.295888+0000","last_peered":"2023-10-16T08:53:10.295888+0000","last_clean":"2023-10-16T08:53:10.295888+0000","last_became_active":"2023-10-16T08:53:09.318891+0000","last_became_peered":"2023-10-16T08:53:09.318891+0000","last_unstale":"2023-10-16T08:53:10.295888+0000","last_undegraded":"2023-10-16T08:53:10.295888+0000","last_fullsized":"2023-10-16T08:53:10.295888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:07.180429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301742+0000","last_change":"2023-10-16T08:53:08.305658+0000","last_active":"2023-10-16T08:53:10.301742+0000","last_peered":"2023-10-16T08:53:10.301742+0000","last_clean":"2023-10-16T08:53:10.301742+0000","last_became_active":"2023-10-16T08:53:08.305386+0000","last_became_peered":"2023-10-16T08:53:08.305386+0000","last_unstale":"2023-10-16T08:53:10.301742+0000","last_undegraded":"2023-10-16T08:53:10.301742+0000","last_fullsized":"2023-10-16T08:53:10.301742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:25.903751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301543+0000","last_change":"2023-10-16T08:53:09.322850+0000","last_active":"2023-10-16T08:53:10.301543+0000","last_peered":"2023-10-16T08:53:10.301543+0000","last_clean":"2023-10-16T08:53:10.301543+0000","last_became_active":"2023-10-16T08:53:09.322576+0000","last_became_peered":"2023-10-16T08:53:09.322576+0000","last_unstale":"2023-10-16T08:53:10.301543+0000","last_undegraded":"2023-10-16T08:53:10.301543+0000","last_fullsized":"2023-10-16T08:53:10.301543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:09.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.346712+0000","last_change":"2023-10-16T08:53:08.305279+0000","last_active":"2023-10-16T08:53:09.346712+0000","last_peered":"2023-10-16T08:53:09.346712+0000","last_clean":"2023-10-16T08:53:09.346712+0000","last_became_active":"2023-10-16T08:53:08.305021+0000","last_became_peered":"2023-10-16T08:53:08.305021+0000","last_unstale":"2023-10-16T08:53:09.346712+0000","last_undegraded":"2023-10-16T08:53:09.346712+0000","last_fullsized":"2023-10-16T08:53:09.346712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:04:36.531485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653223+0000","last_change":"2023-10-16T08:53:09.330680+0000","last_active":"2023-10-16T08:53:10.653223+0000","last_peered":"2023-10-16T08:53:10.653223+0000","last_clean":"2023-10-16T08:53:10.653223+0000","last_became_active":"2023-10-16T08:53:09.330407+0000","last_became_peered":"2023-10-16T08:53:09.330407+0000","last_unstale":"2023-10-16T08:53:10.653223+0000","last_undegraded":"2023-10-16T08:53:10.653223+0000","last_fullsized":"2023-10-16T08:53:10.653223+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:31.706376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450750+0000","last_change":"2023-10-16T08:53:08.289358+0000","last_active":"2023-10-16T08:53:10.450750+0000","last_peered":"2023-10-16T08:53:10.450750+0000","last_clean":"2023-10-16T08:53:10.450750+0000","last_became_active":"2023-10-16T08:53:08.289137+0000","last_became_peered":"2023-10-16T08:53:08.289137+0000","last_unstale":"2023-10-16T08:53:10.450750+0000","last_undegraded":"2023-10-16T08:53:10.450750+0000","last_fullsized":"2023-10-16T08:53:10.450750+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:20:51.686646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450905+0000","last_change":"2023-10-16T08:53:09.338060+0000","last_active":"2023-10-16T08:53:10.450905+0000","last_peered":"2023-10-16T08:53:10.450905+0000","last_clean":"2023-10-16T08:53:10.450905+0000","last_became_active":"2023-10-16T08:53:09.337643+0000","last_became_peered":"2023-10-16T08:53:09.337643+0000","last_unstale":"2023-10-16T08:53:10.450905+0000","last_undegraded":"2023-10-16T08:53:10.450905+0000","last_fullsized":"2023-10-16T08:53:10.450905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:39:37.446080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294330+0000","last_change":"2023-10-16T08:53:08.301869+0000","last_active":"2023-10-16T08:53:10.294330+0000","last_peered":"2023-10-16T08:53:10.294330+0000","last_clean":"2023-10-16T08:53:10.294330+0000","last_became_active":"2023-10-16T08:53:08.301487+0000","last_became_peered":"2023-10-16T08:53:08.301487+0000","last_unstale":"2023-10-16T08:53:10.294330+0000","last_undegraded":"2023-10-16T08:53:10.294330+0000","last_fullsized":"2023-10-16T08:53:10.294330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:04:36.531485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651553+0000","last_change":"2023-10-16T08:53:09.345511+0000","last_active":"2023-10-16T08:53:10.651553+0000","last_peered":"2023-10-16T08:53:10.651553+0000","last_clean":"2023-10-16T08:53:10.651553+0000","last_became_active":"2023-10-16T08:53:09.344930+0000","last_became_peered":"2023-10-16T08:53:09.344930+0000","last_unstale":"2023-10-16T08:53:10.651553+0000","last_undegraded":"2023-10-16T08:53:10.651553+0000","last_fullsized":"2023-10-16T08:53:10.651553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:18.037791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450519+0000","last_change":"2023-10-16T08:53:08.290009+0000","last_active":"2023-10-16T08:53:10.450519+0000","last_peered":"2023-10-16T08:53:10.450519+0000","last_clean":"2023-10-16T08:53:10.450519+0000","last_became_active":"2023-10-16T08:53:08.289713+0000","last_became_peered":"2023-10-16T08:53:08.289713+0000","last_unstale":"2023-10-16T08:53:10.450519+0000","last_undegraded":"2023-10-16T08:53:10.450519+0000","last_fullsized":"2023-10-16T08:53:10.450519+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:34:56.046939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649487+0000","last_change":"2023-10-16T08:53:09.326420+0000","last_active":"2023-10-16T08:53:10.649487+0000","last_peered":"2023-10-16T08:53:10.649487+0000","last_clean":"2023-10-16T08:53:10.649487+0000","last_became_active":"2023-10-16T08:53:09.326138+0000","last_became_peered":"2023-10-16T08:53:09.326138+0000","last_unstale":"2023-10-16T08:53:10.649487+0000","last_undegraded":"2023-10-16T08:53:10.649487+0000","last_fullsized":"2023-10-16T08:53:10.649487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:01.184040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450395+0000","last_change":"2023-10-16T08:53:08.303738+0000","last_active":"2023-10-16T08:53:10.450395+0000","last_peered":"2023-10-16T08:53:10.450395+0000","last_clean":"2023-10-16T08:53:10.450395+0000","last_became_active":"2023-10-16T08:53:08.303229+0000","last_became_peered":"2023-10-16T08:53:08.303229+0000","last_unstale":"2023-10-16T08:53:10.450395+0000","last_undegraded":"2023-10-16T08:53:10.450395+0000","last_fullsized":"2023-10-16T08:53:10.450395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:41.014976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301379+0000","last_change":"2023-10-16T08:53:09.319128+0000","last_active":"2023-10-16T08:53:10.301379+0000","last_peered":"2023-10-16T08:53:10.301379+0000","last_clean":"2023-10-16T08:53:10.301379+0000","last_became_active":"2023-10-16T08:53:09.318825+0000","last_became_peered":"2023-10-16T08:53:09.318825+0000","last_unstale":"2023-10-16T08:53:10.301379+0000","last_undegraded":"2023-10-16T08:53:10.301379+0000","last_fullsized":"2023-10-16T08:53:10.301379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:53:45.827836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.318044+0000","last_change":"2023-10-16T08:53:08.297519+0000","last_active":"2023-10-16T08:53:09.318044+0000","last_peered":"2023-10-16T08:53:09.318044+0000","last_clean":"2023-10-16T08:53:09.318044+0000","last_became_active":"2023-10-16T08:53:08.297202+0000","last_became_peered":"2023-10-16T08:53:08.297202+0000","last_unstale":"2023-10-16T08:53:09.318044+0000","last_undegraded":"2023-10-16T08:53:09.318044+0000","last_fullsized":"2023-10-16T08:53:09.318044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:04:36.531485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295818+0000","last_change":"2023-10-16T08:53:09.330070+0000","last_active":"2023-10-16T08:53:10.295818+0000","last_peered":"2023-10-16T08:53:10.295818+0000","last_clean":"2023-10-16T08:53:10.295818+0000","last_became_active":"2023-10-16T08:53:09.329416+0000","last_became_peered":"2023-10-16T08:53:09.329416+0000","last_unstale":"2023-10-16T08:53:10.295818+0000","last_undegraded":"2023-10-16T08:53:10.295818+0000","last_fullsized":"2023-10-16T08:53:10.295818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:53:45.827836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450303+0000","last_change":"2023-10-16T08:53:08.290196+0000","last_active":"2023-10-16T08:53:10.450303+0000","last_peered":"2023-10-16T08:53:10.450303+0000","last_clean":"2023-10-16T08:53:10.450303+0000","last_became_active":"2023-10-16T08:53:08.289796+0000","last_became_peered":"2023-10-16T08:53:08.289796+0000","last_unstale":"2023-10-16T08:53:10.450303+0000","last_undegraded":"2023-10-16T08:53:10.450303+0000","last_fullsized":"2023-10-16T08:53:10.450303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:27.967107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294391+0000","last_change":"2023-10-16T08:53:09.323850+0000","last_active":"2023-10-16T08:53:10.294391+0000","last_peered":"2023-10-16T08:53:10.294391+0000","last_clean":"2023-10-16T08:53:10.294391+0000","last_became_active":"2023-10-16T08:53:09.323572+0000","last_became_peered":"2023-10-16T08:53:09.323572+0000","last_unstale":"2023-10-16T08:53:10.294391+0000","last_undegraded":"2023-10-16T08:53:10.294391+0000","last_fullsized":"2023-10-16T08:53:10.294391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:07:09.293910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301982+0000","last_change":"2023-10-16T08:53:08.302582+0000","last_active":"2023-10-16T08:53:10.301982+0000","last_peered":"2023-10-16T08:53:10.301982+0000","last_clean":"2023-10-16T08:53:10.301982+0000","last_became_active":"2023-10-16T08:53:08.302314+0000","last_became_peered":"2023-10-16T08:53:08.302314+0000","last_unstale":"2023-10-16T08:53:10.301982+0000","last_undegraded":"2023-10-16T08:53:10.301982+0000","last_fullsized":"2023-10-16T08:53:10.301982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:07.947077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651392+0000","last_change":"2023-10-16T08:53:09.330679+0000","last_active":"2023-10-16T08:53:10.651392+0000","last_peered":"2023-10-16T08:53:10.651392+0000","last_clean":"2023-10-16T08:53:10.651392+0000","last_became_active":"2023-10-16T08:53:09.330121+0000","last_became_peered":"2023-10-16T08:53:09.330121+0000","last_unstale":"2023-10-16T08:53:10.651392+0000","last_undegraded":"2023-10-16T08:53:10.651392+0000","last_fullsized":"2023-10-16T08:53:10.651392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:34:16.419576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.453463+0000","last_change":"2023-10-16T08:53:08.298406+0000","last_active":"2023-10-16T08:53:10.453463+0000","last_peered":"2023-10-16T08:53:10.453463+0000","last_clean":"2023-10-16T08:53:10.453463+0000","last_became_active":"2023-10-16T08:53:08.298056+0000","last_became_peered":"2023-10-16T08:53:08.298056+0000","last_unstale":"2023-10-16T08:53:10.453463+0000","last_undegraded":"2023-10-16T08:53:10.453463+0000","last_fullsized":"2023-10-16T08:53:10.453463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:53.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296020+0000","last_change":"2023-10-16T08:53:09.332339+0000","last_active":"2023-10-16T08:53:10.296020+0000","last_peered":"2023-10-16T08:53:10.296020+0000","last_clean":"2023-10-16T08:53:10.296020+0000","last_became_active":"2023-10-16T08:53:09.332053+0000","last_became_peered":"2023-10-16T08:53:09.332053+0000","last_unstale":"2023-10-16T08:53:10.296020+0000","last_undegraded":"2023-10-16T08:53:10.296020+0000","last_fullsized":"2023-10-16T08:53:10.296020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:09.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649725+0000","last_change":"2023-10-16T08:53:08.285854+0000","last_active":"2023-10-16T08:53:10.649725+0000","last_peered":"2023-10-16T08:53:10.649725+0000","last_clean":"2023-10-16T08:53:10.649725+0000","last_became_active":"2023-10-16T08:53:08.285626+0000","last_became_peered":"2023-10-16T08:53:08.285626+0000","last_unstale":"2023-10-16T08:53:10.649725+0000","last_undegraded":"2023-10-16T08:53:10.649725+0000","last_fullsized":"2023-10-16T08:53:10.649725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:18:15.802845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649733+0000","last_change":"2023-10-16T08:53:09.318762+0000","last_active":"2023-10-16T08:53:10.649733+0000","last_peered":"2023-10-16T08:53:10.649733+0000","last_clean":"2023-10-16T08:53:10.649733+0000","last_became_active":"2023-10-16T08:53:09.318460+0000","last_became_peered":"2023-10-16T08:53:09.318460+0000","last_unstale":"2023-10-16T08:53:10.649733+0000","last_undegraded":"2023-10-16T08:53:10.649733+0000","last_fullsized":"2023-10-16T08:53:10.649733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:20.345447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649490+0000","last_change":"2023-10-16T08:53:08.300334+0000","last_active":"2023-10-16T08:53:10.649490+0000","last_peered":"2023-10-16T08:53:10.649490+0000","last_clean":"2023-10-16T08:53:10.649490+0000","last_became_active":"2023-10-16T08:53:08.300047+0000","last_became_peered":"2023-10-16T08:53:08.300047+0000","last_unstale":"2023-10-16T08:53:10.649490+0000","last_undegraded":"2023-10-16T08:53:10.649490+0000","last_fullsized":"2023-10-16T08:53:10.649490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:37:26.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294066+0000","last_change":"2023-10-16T08:53:09.322367+0000","last_active":"2023-10-16T08:53:10.294066+0000","last_peered":"2023-10-16T08:53:10.294066+0000","last_clean":"2023-10-16T08:53:10.294066+0000","last_became_active":"2023-10-16T08:53:09.322017+0000","last_became_peered":"2023-10-16T08:53:09.322017+0000","last_unstale":"2023-10-16T08:53:10.294066+0000","last_undegraded":"2023-10-16T08:53:10.294066+0000","last_fullsized":"2023-10-16T08:53:10.294066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:31.706376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653357+0000","last_change":"2023-10-16T08:53:08.292553+0000","last_active":"2023-10-16T08:53:10.653357+0000","last_peered":"2023-10-16T08:53:10.653357+0000","last_clean":"2023-10-16T08:53:10.653357+0000","last_became_active":"2023-10-16T08:53:08.292215+0000","last_became_peered":"2023-10-16T08:53:08.292215+0000","last_unstale":"2023-10-16T08:53:10.653357+0000","last_undegraded":"2023-10-16T08:53:10.653357+0000","last_fullsized":"2023-10-16T08:53:10.653357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:48.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652667+0000","last_change":"2023-10-16T08:53:09.332585+0000","last_active":"2023-10-16T08:53:10.652667+0000","last_peered":"2023-10-16T08:53:10.652667+0000","last_clean":"2023-10-16T08:53:10.652667+0000","last_became_active":"2023-10-16T08:53:09.332324+0000","last_became_peered":"2023-10-16T08:53:09.332324+0000","last_unstale":"2023-10-16T08:53:10.652667+0000","last_undegraded":"2023-10-16T08:53:10.652667+0000","last_fullsized":"2023-10-16T08:53:10.652667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:23.754818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.324086+0000","last_change":"2023-10-16T08:53:08.302122+0000","last_active":"2023-10-16T08:53:09.324086+0000","last_peered":"2023-10-16T08:53:09.324086+0000","last_clean":"2023-10-16T08:53:09.324086+0000","last_became_active":"2023-10-16T08:53:08.301809+0000","last_became_peered":"2023-10-16T08:53:08.301809+0000","last_unstale":"2023-10-16T08:53:09.324086+0000","last_undegraded":"2023-10-16T08:53:09.324086+0000","last_fullsized":"2023-10-16T08:53:09.324086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:15:41.651549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652572+0000","last_change":"2023-10-16T08:53:09.332049+0000","last_active":"2023-10-16T08:53:10.652572+0000","last_peered":"2023-10-16T08:53:10.652572+0000","last_clean":"2023-10-16T08:53:10.652572+0000","last_became_active":"2023-10-16T08:53:09.331634+0000","last_became_peered":"2023-10-16T08:53:09.331634+0000","last_unstale":"2023-10-16T08:53:10.652572+0000","last_undegraded":"2023-10-16T08:53:10.652572+0000","last_fullsized":"2023-10-16T08:53:10.652572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:55:03.062412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295530+0000","last_change":"2023-10-16T08:53:08.295439+0000","last_active":"2023-10-16T08:53:10.295530+0000","last_peered":"2023-10-16T08:53:10.295530+0000","last_clean":"2023-10-16T08:53:10.295530+0000","last_became_active":"2023-10-16T08:53:08.295098+0000","last_became_peered":"2023-10-16T08:53:08.295098+0000","last_unstale":"2023-10-16T08:53:10.295530+0000","last_undegraded":"2023-10-16T08:53:10.295530+0000","last_fullsized":"2023-10-16T08:53:10.295530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:07.947077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301437+0000","last_change":"2023-10-16T08:53:09.319684+0000","last_active":"2023-10-16T08:53:10.301437+0000","last_peered":"2023-10-16T08:53:10.301437+0000","last_clean":"2023-10-16T08:53:10.301437+0000","last_became_active":"2023-10-16T08:53:09.319407+0000","last_became_peered":"2023-10-16T08:53:09.319407+0000","last_unstale":"2023-10-16T08:53:10.301437+0000","last_undegraded":"2023-10-16T08:53:10.301437+0000","last_fullsized":"2023-10-16T08:53:10.301437+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:07.180429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.319478+0000","last_change":"2023-10-16T08:53:08.294613+0000","last_active":"2023-10-16T08:53:09.319478+0000","last_peered":"2023-10-16T08:53:09.319478+0000","last_clean":"2023-10-16T08:53:09.319478+0000","last_became_active":"2023-10-16T08:53:08.294277+0000","last_became_peered":"2023-10-16T08:53:08.294277+0000","last_unstale":"2023-10-16T08:53:09.319478+0000","last_undegraded":"2023-10-16T08:53:09.319478+0000","last_fullsized":"2023-10-16T08:53:09.319478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:03:02.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651806+0000","last_change":"2023-10-16T08:51:09.503647+0000","last_active":"2023-10-16T08:53:10.651806+0000","last_peered":"2023-10-16T08:53:10.651806+0000","last_clean":"2023-10-16T08:53:10.651806+0000","last_became_active":"2023-10-16T08:51:09.501573+0000","last_became_peered":"2023-10-16T08:51:09.501573+0000","last_unstale":"2023-10-16T08:53:10.651806+0000","last_undegraded":"2023-10-16T08:53:10.651806+0000","last_fullsized":"2023-10-16T08:53:10.651806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_clean_scrub_stamp":"2023-10-16T08:51:08.277379+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:32.541738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":794117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.75},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.69099999999999995}]},{"osd":1,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.93500000000000005}]},{"osd":3,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.96999999999999997}]},{"osd":4,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.506}]},{"osd":5,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.0660000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.252}]}]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":202671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.018,"15min":1.014},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.339},{"interface":"front","average":{"1min":1.093,"5min":1.052,"15min":1.0449999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.419}]},{"osd":1,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.234,"15min":1.24},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.72099999999999997}]},{"osd":2,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.5369999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.089},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3460000000000001,"15min":1.3560000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.85299999999999998}]},{"osd":3,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.226,"15min":1.212},"min":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.208}]},{"osd":5,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.494,"15min":1.5029999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.476,"15min":1.492},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0249999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.5600000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.466,"15min":1.448},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.0369999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.631,"5min":1.6619999999999999,"15min":1.667},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.663}]},{"osd":7,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.5649999999999999,"15min":1.579},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.502,"15min":1.496},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.911,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.512}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":202649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0609999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.137},{"interface":"front","average":{"1min":1.179,"5min":1.2150000000000001,"15min":1.2210000000000001},"min":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.768,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1060000000000001,"15min":1.097},"min":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1140000000000001,"15min":1.129},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.345,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.2969999999999999}]},{"osd":2,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.099,"15min":1.097},"min":{"1min":0.78900000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.55,"5min":1.706,"15min":1.706},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.76500000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.5149999999999999}]},{"osd":3,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":1.008,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.365},{"interface":"front","average":{"1min":1.266,"5min":1.292,"15min":1.296},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.411}]},{"osd":4,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.153,"15min":1.141},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.675,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4950000000000001,"15min":1.5},"min":{"1min":0.92500000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0630000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.589}]},{"osd":5,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2509999999999999,"15min":1.2470000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5569999999999999,"5min":2.528,"15min":2.528},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4039999999999999,"15min":1.3979999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.718,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.4710000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.5780000000000001,"15min":1.5840000000000001},"min":{"1min":1.0089999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7789999999999999,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4430000000000001,"15min":1.45},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.9970000000000001,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.1910000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":202179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":5.835,"5min":5.835,"15min":5.835},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":4.1539999999999999,"5min":4.1539999999999999,"15min":4.1539999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.044,"5min":3.044,"15min":3.044},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":14.76,"5min":14.76,"15min":14.76},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":11.981,"5min":11.981,"15min":11.981},"last":0.58899999999999997}]},{"osd":4,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":13.914999999999999,"5min":13.914999999999999,"15min":13.914999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.028,"5min":2.028,"15min":2.028},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":15.811999999999999,"5min":15.811999999999999,"15min":15.811999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":6.5679999999999996,"5min":6.5679999999999996,"15min":6.5679999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":6.6299999999999999,"5min":6.6299999999999999,"15min":6.6299999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":6.6029999999999998,"5min":6.6029999999999998,"15min":6.6029999999999998},"last":0.68300000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":203713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.876,"15min":0.89900000000000002},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1619999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.409,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.874}]},{"osd":1,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91400000000000003,"15min":0.92600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.619,"5min":1.76,"15min":1.76},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.64700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.46,"5min":3.242,"15min":3.242},"last":0.92200000000000004}]},{"osd":2,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.456,"5min":1.615,"15min":1.615},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2210000000000001,"15min":1.25},"min":{"1min":0.69199999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4810000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3400000000000001,"15min":1.3620000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.738,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.02},{"interface":"front","average":{"1min":1.242,"5min":1.385,"15min":1.409},"min":{"1min":0.90000000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.591,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.268}]},{"osd":5,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.343,"15min":1.359},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.615,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.431,"15min":1.4510000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.841,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.2030000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.5069999999999999,"15min":1.5309999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.792,"5min":3.1320000000000001,"15min":3.1320000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.534,"15min":1.5629999999999999},"min":{"1min":0.92600000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9550000000000001,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.448}]},{"osd":7,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.46,"15min":1.498},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5640000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.099},{"interface":"front","average":{"1min":1.448,"5min":1.601,"15min":1.627},"min":{"1min":0.97599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.907,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3069999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":202137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.224,"5min":1.306,"15min":1.306},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.98199999999999998,"15min":0.999},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.5349999999999999,"5min":2.052,"15min":2.052},"last":1.5349999999999999}]},{"osd":1,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.036,"15min":1.0640000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5469999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.995,"15min":1.022},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4610000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1459999999999999,"15min":1.1739999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4179999999999999,"5min":1.948,"15min":1.948},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1060000000000001,"15min":1.127},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6220000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.98599999999999999}]},{"osd":4,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2789999999999999,"15min":1.274},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.605},{"interface":"front","average":{"1min":1.151,"5min":1.3540000000000001,"15min":1.3879999999999999},"min":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4670000000000001,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.379}]},{"osd":5,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.4299999999999999,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9410000000000001,"5min":2.27,"15min":2.27},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3819999999999999,"15min":1.4059999999999999},"min":{"1min":0.93000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7130000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.4750000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.53,"15min":1.5600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.476,"15min":1.4970000000000001},"min":{"1min":0.91600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.859,"5min":2.665,"15min":2.665},"last":1.1120000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.92800000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9330000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.5069999999999999,"15min":1.5249999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.9430000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.325}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":202157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.92600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.873,"15min":0.89100000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.98099999999999998}]},{"osd":2,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.98299999999999998,"15min":0.997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2589999999999999,"5min":1.7,"15min":1.7},"last":1.036},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.0669999999999999,"15min":1.107},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5529999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.155,"15min":1.1930000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7789999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.494,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.073}]},{"osd":4,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3120000000000001,"15min":1.325},"min":{"1min":0.85799999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.677,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.371},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1020000000000001,"15min":1.099},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.216}]},{"osd":5,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1890000000000001,"15min":1.2030000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6120000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.391,"15min":1.419},"min":{"1min":0.83199999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8100000000000001,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.123}]},{"osd":6,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3859999999999999,"15min":1.4059999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8899999999999999,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.2},{"interface":"front","average":{"1min":1.206,"5min":1.4350000000000001,"15min":1.4730000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.75,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4850000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.456,"15min":1.4750000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9379999999999999,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.4390000000000001,"15min":1.466},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6919999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":792469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2649999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.5109999999999999,"5min":1.609,"15min":1.609},"last":0.92200000000000004}]},{"osd":2,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4199999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.292,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.0049999999999999}]},{"osd":3,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4370000000000001,"5min":2.391,"15min":2.391},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5549999999999999,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.474}]},{"osd":4,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.573,"15min":1.653},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4730000000000001,"5min":13.706,"15min":13.706},"last":1.153},{"interface":"front","average":{"1min":1.331,"5min":1.2849999999999999,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.8600000000000001,"5min":2.472,"15min":2.472},"last":1.8600000000000001}]},{"osd":5,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.617,"5min":4.819,"15min":4.819},"last":1.617},{"interface":"front","average":{"1min":1.359,"5min":1.647,"15min":1.6950000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8160000000000001,"5min":10.791,"15min":10.791},"last":1.7669999999999999}]},{"osd":6,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.8560000000000001,"15min":1.948},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.986,"5min":15.968999999999999,"15min":15.968999999999999},"last":1.986},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.825,"15min":1.9119999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9370000000000001,"5min":15.346,"15min":15.346},"last":1.887}]},{"osd":7,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.52,"15min":1.534},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.9219999999999999,"5min":3.8170000000000002,"15min":3.8170000000000002},"last":1.9219999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.405,"15min":1.4259999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8169999999999999,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.8169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T08:53:14.099 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T08:53:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.346+0000 7fc4dffff640 1 Processor -- start 2023-10-16T08:53:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.346+0000 7fc4dffff640 1 -- start start 2023-10-16T08:53:14.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4dffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e015a8d0 0x7fc4e00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4dffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4e006ff40 0x7fc4e00cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4dffff640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e015acb0 con 0x7fc4e00ca660 2023-10-16T08:53:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4dffff640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00c1c60 con 0x7fc4e006ff40 2023-10-16T08:53:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4dffff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015e350 con 0x7fc4e015a8d0 2023-10-16T08:53:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4df7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4e006ff40 0x7fc4e00cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4df7fe640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4e006ff40 0x7fc4e00cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33444/0 (socket says 172.21.15.94:33444) 2023-10-16T08:53:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4df7fe640 1 -- 172.21.15.94:0/2999528898 learned_addr learned my addr 172.21.15.94:0/2999528898 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:14.352 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.348+0000 7fc4deffd640 1 --2- 172.21.15.94:0/2999528898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e015a8d0 0x7fc4e00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.349+0000 7fc4df7fe640 1 -- 172.21.15.94:0/2999528898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e015a8d0 msgr2=0x7fc4e00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.349+0000 7fc4df7fe640 1 --2- 172.21.15.94:0/2999528898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e015a8d0 0x7fc4e00cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.349+0000 7fc4df7fe640 1 -- 172.21.15.94:0/2999528898 >> v1:172.21.15.130:6789/0 conn(0x7fc4e00ca660 legacy=0x7fc4e006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.349+0000 7fc4df7fe640 1 -- 172.21.15.94:0/2999528898 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e015e630 con 0x7fc4e006ff40 2023-10-16T08:53:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.350+0000 7fc4df7fe640 1 --2- 172.21.15.94:0/2999528898 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e006ff40 0x7fc4e00cb080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009e50 tx=0x7fc4d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f81d7c58d29b26 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.350+0000 7fc4de7fc640 1 -- 172.21.15.94:0/2999528898 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d802ca70 con 0x7fc4e006ff40 2023-10-16T08:53:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.350+0000 7fc4de7fc640 1 -- 172.21.15.94:0/2999528898 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d802cbd0 con 0x7fc4e006ff40 2023-10-16T08:53:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.350+0000 7fc4de7fc640 1 -- 172.21.15.94:0/2999528898 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80343f0 con 0x7fc4e006ff40 2023-10-16T08:53:14.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 -- 172.21.15.94:0/2999528898 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e006ff40 msgr2=0x7fc4e00cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 --2- 172.21.15.94:0/2999528898 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e006ff40 0x7fc4e00cb080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009e50 tx=0x7fc4d802bed0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 -- 172.21.15.94:0/2999528898 shutdown_connections 2023-10-16T08:53:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 --2- 172.21.15.94:0/2999528898 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e006ff40 0x7fc4e00cb080 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 --2- 172.21.15.94:0/2999528898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e015a8d0 0x7fc4e00cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 -- 172.21.15.94:0/2999528898 >> 172.21.15.94:0/2999528898 conn(0x7fc4e006a470 msgr2=0x7fc4e00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:14.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 -- 172.21.15.94:0/2999528898 shutdown_connections 2023-10-16T08:53:14.358 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.351+0000 7fc4dffff640 1 -- 172.21.15.94:0/2999528898 wait complete. 2023-10-16T08:53:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.352+0000 7fc4dffff640 1 Processor -- start 2023-10-16T08:53:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.353+0000 7fc4dffff640 1 -- start start 2023-10-16T08:53:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.353+0000 7fc4dffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e006ff40 0x7fc4e014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.353+0000 7fc4dffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e00ca660 0x7fc4e015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.353+0000 7fc4dffff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 0x7fc4e015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4dffff640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00c7020 con 0x7fc4e015a8d0 2023-10-16T08:53:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4dffff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e014b6a0 con 0x7fc4e00ca660 2023-10-16T08:53:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4dffff640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00c63a0 con 0x7fc4e006ff40 2023-10-16T08:53:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 0x7fc4e015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 0x7fc4e015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33448/0 (socket says 172.21.15.94:33448) 2023-10-16T08:53:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 -- 172.21.15.94:0/4070324003 learned_addr learned my addr 172.21.15.94:0/4070324003 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4deffd640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e006ff40 0x7fc4e014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 -- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e006ff40 msgr2=0x7fc4e014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e006ff40 0x7fc4e014b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 -- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e00ca660 msgr2=0x7fc4e015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e00ca660 0x7fc4e015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.354+0000 7fc4df7fe640 1 -- 172.21.15.94:0/4070324003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8009b30 con 0x7fc4e015a8d0 2023-10-16T08:53:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.355+0000 7fc4df7fe640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 0x7fc4e015d2e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009e50 tx=0x7fc4d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.355+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8009510 con 0x7fc4e015a8d0 2023-10-16T08:53:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.355+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d803e450 con 0x7fc4e015a8d0 2023-10-16T08:53:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.355+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d803e800 con 0x7fc4e015a8d0 2023-10-16T08:53:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.355+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e00c6680 con 0x7fc4e015a8d0 2023-10-16T08:53:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.355+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e00c6c40 con 0x7fc4e015a8d0 2023-10-16T08:53:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.356+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00c7160 con 0x7fc4e015a8d0 2023-10-16T08:53:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.357+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4d803e960 con 0x7fc4e015a8d0 2023-10-16T08:53:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.358+0000 7fc4d77fe640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc4c006ae70 0x7fc4c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.358+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc4d80ac3b0 con 0x7fc4e015a8d0 2023-10-16T08:53:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.358+0000 7fc4deffd640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc4c006ae70 0x7fc4c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.359+0000 7fc4deffd640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc4c006ae70 0x7fc4c006d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00096d0 tx=0x7fc4d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.362+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4e00c7160 con 0x7fc4e015a8d0 2023-10-16T08:53:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.547+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 --> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4e015ebf0 con 0x7fc4c006ae70 2023-10-16T08:53:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.570+0000 7fc4d77fe640 1 -- 172.21.15.94:0/4070324003 <== mgr.4107 v2:172.21.15.94:6832/2208206022 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286851 (secure 0 0 0) 0x7fc4d000e4c0 con 0x7fc4c006ae70 2023-10-16T08:53:14.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2023-10-16T08:53:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.576+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc4c006ae70 msgr2=0x7fc4c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.576+0000 7fc4dffff640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc4c006ae70 0x7fc4c006d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00096d0 tx=0x7fc4d0008040 comp rx=0 tx=0).stop 2023-10-16T08:53:14.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.576+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 msgr2=0x7fc4e015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.576+0000 7fc4dffff640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 0x7fc4e015d2e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009e50 tx=0x7fc4d8004a40 comp rx=0 tx=0).stop 2023-10-16T08:53:14.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 shutdown_connections 2023-10-16T08:53:14.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4e015a8d0 0x7fc4e015d2e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fc4c006ae70 0x7fc4c006d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e00ca660 0x7fc4e015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 --2- 172.21.15.94:0/4070324003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e006ff40 0x7fc4e014b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 >> 172.21.15.94:0/4070324003 conn(0x7fc4e006a470 msgr2=0x7fc4e00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:14.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 shutdown_connections 2023-10-16T08:53:14.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.577+0000 7fc4dffff640 1 -- 172.21.15.94:0/4070324003 wait complete. 2023-10-16T08:53:14.597 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-10-16T08:53:13.851909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237712,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737008,"statfs":{"total":773094113280,"available":772850696192,"internally_reserved":0,"allocated":4988928,"data_stored":2802092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001647"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296119+0000","last_change":"2023-10-16T08:53:09.314145+0000","last_active":"2023-10-16T08:53:10.296119+0000","last_peered":"2023-10-16T08:53:10.296119+0000","last_clean":"2023-10-16T08:53:10.296119+0000","last_became_active":"2023-10-16T08:53:09.313854+0000","last_became_peered":"2023-10-16T08:53:09.313854+0000","last_unstale":"2023-10-16T08:53:10.296119+0000","last_undegraded":"2023-10-16T08:53:10.296119+0000","last_fullsized":"2023-10-16T08:53:10.296119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:08:23.476327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295726+0000","last_change":"2023-10-16T08:53:09.340988+0000","last_active":"2023-10-16T08:53:10.295726+0000","last_peered":"2023-10-16T08:53:10.295726+0000","last_clean":"2023-10-16T08:53:10.295726+0000","last_became_active":"2023-10-16T08:53:09.340731+0000","last_became_peered":"2023-10-16T08:53:09.340731+0000","last_unstale":"2023-10-16T08:53:10.295726+0000","last_undegraded":"2023-10-16T08:53:10.295726+0000","last_fullsized":"2023-10-16T08:53:10.295726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:01:38.680311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649652+0000","last_change":"2023-10-16T08:53:09.337644+0000","last_active":"2023-10-16T08:53:10.649652+0000","last_peered":"2023-10-16T08:53:10.649652+0000","last_clean":"2023-10-16T08:53:10.649652+0000","last_became_active":"2023-10-16T08:53:09.337271+0000","last_became_peered":"2023-10-16T08:53:09.337271+0000","last_unstale":"2023-10-16T08:53:10.649652+0000","last_undegraded":"2023-10-16T08:53:10.649652+0000","last_fullsized":"2023-10-16T08:53:10.649652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:40:51.504982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450668+0000","last_change":"2023-10-16T08:53:09.339105+0000","last_active":"2023-10-16T08:53:10.450668+0000","last_peered":"2023-10-16T08:53:10.450668+0000","last_clean":"2023-10-16T08:53:10.450668+0000","last_became_active":"2023-10-16T08:53:09.338775+0000","last_became_peered":"2023-10-16T08:53:09.338775+0000","last_unstale":"2023-10-16T08:53:10.450668+0000","last_undegraded":"2023-10-16T08:53:10.450668+0000","last_fullsized":"2023-10-16T08:53:10.450668+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:36.922136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450487+0000","last_change":"2023-10-16T08:53:09.338724+0000","last_active":"2023-10-16T08:53:10.450487+0000","last_peered":"2023-10-16T08:53:10.450487+0000","last_clean":"2023-10-16T08:53:10.450487+0000","last_became_active":"2023-10-16T08:53:09.338420+0000","last_became_peered":"2023-10-16T08:53:09.338420+0000","last_unstale":"2023-10-16T08:53:10.450487+0000","last_undegraded":"2023-10-16T08:53:10.450487+0000","last_fullsized":"2023-10-16T08:53:10.450487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:28.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293921+0000","last_change":"2023-10-16T08:53:09.307932+0000","last_active":"2023-10-16T08:53:10.293921+0000","last_peered":"2023-10-16T08:53:10.293921+0000","last_clean":"2023-10-16T08:53:10.293921+0000","last_became_active":"2023-10-16T08:53:09.307592+0000","last_became_peered":"2023-10-16T08:53:09.307592+0000","last_unstale":"2023-10-16T08:53:10.293921+0000","last_undegraded":"2023-10-16T08:53:10.293921+0000","last_fullsized":"2023-10-16T08:53:10.293921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:23.754818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300462+0000","last_change":"2023-10-16T08:53:09.315759+0000","last_active":"2023-10-16T08:53:10.300462+0000","last_peered":"2023-10-16T08:53:10.300462+0000","last_clean":"2023-10-16T08:53:10.300462+0000","last_became_active":"2023-10-16T08:53:09.315362+0000","last_became_peered":"2023-10-16T08:53:09.315362+0000","last_unstale":"2023-10-16T08:53:10.300462+0000","last_undegraded":"2023-10-16T08:53:10.300462+0000","last_fullsized":"2023-10-16T08:53:10.300462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:18:50.161673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295461+0000","last_change":"2023-10-16T08:53:09.327510+0000","last_active":"2023-10-16T08:53:10.295461+0000","last_peered":"2023-10-16T08:53:10.295461+0000","last_clean":"2023-10-16T08:53:10.295461+0000","last_became_active":"2023-10-16T08:53:09.327199+0000","last_became_peered":"2023-10-16T08:53:09.327199+0000","last_unstale":"2023-10-16T08:53:10.295461+0000","last_undegraded":"2023-10-16T08:53:10.295461+0000","last_fullsized":"2023-10-16T08:53:10.295461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:41.150478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650049+0000","last_change":"2023-10-16T08:53:09.330416+0000","last_active":"2023-10-16T08:53:10.650049+0000","last_peered":"2023-10-16T08:53:10.650049+0000","last_clean":"2023-10-16T08:53:10.650049+0000","last_became_active":"2023-10-16T08:53:09.330124+0000","last_became_peered":"2023-10-16T08:53:09.330124+0000","last_unstale":"2023-10-16T08:53:10.650049+0000","last_undegraded":"2023-10-16T08:53:10.650049+0000","last_fullsized":"2023-10-16T08:53:10.650049+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:08.961007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301286+0000","last_change":"2023-10-16T08:53:09.329091+0000","last_active":"2023-10-16T08:53:10.301286+0000","last_peered":"2023-10-16T08:53:10.301286+0000","last_clean":"2023-10-16T08:53:10.301286+0000","last_became_active":"2023-10-16T08:53:09.328773+0000","last_became_peered":"2023-10-16T08:53:09.328773+0000","last_unstale":"2023-10-16T08:53:10.301286+0000","last_undegraded":"2023-10-16T08:53:10.301286+0000","last_fullsized":"2023-10-16T08:53:10.301286+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:01:38.680311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301684+0000","last_change":"2023-10-16T08:53:09.334158+0000","last_active":"2023-10-16T08:53:10.301684+0000","last_peered":"2023-10-16T08:53:10.301684+0000","last_clean":"2023-10-16T08:53:10.301684+0000","last_became_active":"2023-10-16T08:53:09.332690+0000","last_became_peered":"2023-10-16T08:53:09.332690+0000","last_unstale":"2023-10-16T08:53:10.301684+0000","last_undegraded":"2023-10-16T08:53:10.301684+0000","last_fullsized":"2023-10-16T08:53:10.301684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:15.896046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649772+0000","last_change":"2023-10-16T08:53:09.337984+0000","last_active":"2023-10-16T08:53:10.649772+0000","last_peered":"2023-10-16T08:53:10.649772+0000","last_clean":"2023-10-16T08:53:10.649772+0000","last_became_active":"2023-10-16T08:53:09.337679+0000","last_became_peered":"2023-10-16T08:53:09.337679+0000","last_unstale":"2023-10-16T08:53:10.649772+0000","last_undegraded":"2023-10-16T08:53:10.649772+0000","last_fullsized":"2023-10-16T08:53:10.649772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:26.917681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300734+0000","last_change":"2023-10-16T08:53:09.329647+0000","last_active":"2023-10-16T08:53:10.300734+0000","last_peered":"2023-10-16T08:53:10.300734+0000","last_clean":"2023-10-16T08:53:10.300734+0000","last_became_active":"2023-10-16T08:53:09.329322+0000","last_became_peered":"2023-10-16T08:53:09.329322+0000","last_unstale":"2023-10-16T08:53:10.300734+0000","last_undegraded":"2023-10-16T08:53:10.300734+0000","last_fullsized":"2023-10-16T08:53:10.300734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:28:41.150478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652332+0000","last_change":"2023-10-16T08:53:09.330922+0000","last_active":"2023-10-16T08:53:10.652332+0000","last_peered":"2023-10-16T08:53:10.652332+0000","last_clean":"2023-10-16T08:53:10.652332+0000","last_became_active":"2023-10-16T08:53:09.330606+0000","last_became_peered":"2023-10-16T08:53:09.330606+0000","last_unstale":"2023-10-16T08:53:10.652332+0000","last_undegraded":"2023-10-16T08:53:10.652332+0000","last_fullsized":"2023-10-16T08:53:10.652332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:03:03.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300594+0000","last_change":"2023-10-16T08:53:09.334429+0000","last_active":"2023-10-16T08:53:10.300594+0000","last_peered":"2023-10-16T08:53:10.300594+0000","last_clean":"2023-10-16T08:53:10.300594+0000","last_became_active":"2023-10-16T08:53:09.332656+0000","last_became_peered":"2023-10-16T08:53:09.332656+0000","last_unstale":"2023-10-16T08:53:10.300594+0000","last_undegraded":"2023-10-16T08:53:10.300594+0000","last_fullsized":"2023-10-16T08:53:10.300594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:50.792920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650920+0000","last_change":"2023-10-16T08:53:09.338858+0000","last_active":"2023-10-16T08:53:10.650920+0000","last_peered":"2023-10-16T08:53:10.650920+0000","last_clean":"2023-10-16T08:53:10.650920+0000","last_became_active":"2023-10-16T08:53:09.338511+0000","last_became_peered":"2023-10-16T08:53:09.338511+0000","last_unstale":"2023-10-16T08:53:10.650920+0000","last_undegraded":"2023-10-16T08:53:10.650920+0000","last_fullsized":"2023-10-16T08:53:10.650920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:46:48.396710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652772+0000","last_change":"2023-10-16T08:53:09.340239+0000","last_active":"2023-10-16T08:53:10.652772+0000","last_peered":"2023-10-16T08:53:10.652772+0000","last_clean":"2023-10-16T08:53:10.652772+0000","last_became_active":"2023-10-16T08:53:09.339908+0000","last_became_peered":"2023-10-16T08:53:09.339908+0000","last_unstale":"2023-10-16T08:53:10.652772+0000","last_undegraded":"2023-10-16T08:53:10.652772+0000","last_fullsized":"2023-10-16T08:53:10.652772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:14.330291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654327+0000","last_change":"2023-10-16T08:53:09.330054+0000","last_active":"2023-10-16T08:53:10.654327+0000","last_peered":"2023-10-16T08:53:10.654327+0000","last_clean":"2023-10-16T08:53:10.654327+0000","last_became_active":"2023-10-16T08:53:09.329783+0000","last_became_peered":"2023-10-16T08:53:09.329783+0000","last_unstale":"2023-10-16T08:53:10.654327+0000","last_undegraded":"2023-10-16T08:53:10.654327+0000","last_fullsized":"2023-10-16T08:53:10.654327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:51:24.104413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450792+0000","last_change":"2023-10-16T08:53:09.342823+0000","last_active":"2023-10-16T08:53:10.450792+0000","last_peered":"2023-10-16T08:53:10.450792+0000","last_clean":"2023-10-16T08:53:10.450792+0000","last_became_active":"2023-10-16T08:53:09.342442+0000","last_became_peered":"2023-10-16T08:53:09.342442+0000","last_unstale":"2023-10-16T08:53:10.450792+0000","last_undegraded":"2023-10-16T08:53:10.450792+0000","last_fullsized":"2023-10-16T08:53:10.450792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:08:46.384011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653782+0000","last_change":"2023-10-16T08:53:09.331842+0000","last_active":"2023-10-16T08:53:10.653782+0000","last_peered":"2023-10-16T08:53:10.653782+0000","last_clean":"2023-10-16T08:53:10.653782+0000","last_became_active":"2023-10-16T08:53:09.331537+0000","last_became_peered":"2023-10-16T08:53:09.331537+0000","last_unstale":"2023-10-16T08:53:10.653782+0000","last_undegraded":"2023-10-16T08:53:10.653782+0000","last_fullsized":"2023-10-16T08:53:10.653782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:10:22.348283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.300886+0000","last_change":"2023-10-16T08:53:09.312591+0000","last_active":"2023-10-16T08:53:10.300886+0000","last_peered":"2023-10-16T08:53:10.300886+0000","last_clean":"2023-10-16T08:53:10.300886+0000","last_became_active":"2023-10-16T08:53:09.311955+0000","last_became_peered":"2023-10-16T08:53:09.311955+0000","last_unstale":"2023-10-16T08:53:10.300886+0000","last_undegraded":"2023-10-16T08:53:10.300886+0000","last_fullsized":"2023-10-16T08:53:10.300886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:26:13.525343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653211+0000","last_change":"2023-10-16T08:53:09.336730+0000","last_active":"2023-10-16T08:53:10.653211+0000","last_peered":"2023-10-16T08:53:10.653211+0000","last_clean":"2023-10-16T08:53:10.653211+0000","last_became_active":"2023-10-16T08:53:09.336031+0000","last_became_peered":"2023-10-16T08:53:09.336031+0000","last_unstale":"2023-10-16T08:53:10.653211+0000","last_undegraded":"2023-10-16T08:53:10.653211+0000","last_fullsized":"2023-10-16T08:53:10.653211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:50.600974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652682+0000","last_change":"2023-10-16T08:53:09.330353+0000","last_active":"2023-10-16T08:53:10.652682+0000","last_peered":"2023-10-16T08:53:10.652682+0000","last_clean":"2023-10-16T08:53:10.652682+0000","last_became_active":"2023-10-16T08:53:09.330038+0000","last_became_peered":"2023-10-16T08:53:09.330038+0000","last_unstale":"2023-10-16T08:53:10.652682+0000","last_undegraded":"2023-10-16T08:53:10.652682+0000","last_fullsized":"2023-10-16T08:53:10.652682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:26:02.481433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450307+0000","last_change":"2023-10-16T08:53:09.329214+0000","last_active":"2023-10-16T08:53:10.450307+0000","last_peered":"2023-10-16T08:53:10.450307+0000","last_clean":"2023-10-16T08:53:10.450307+0000","last_became_active":"2023-10-16T08:53:09.328967+0000","last_became_peered":"2023-10-16T08:53:09.328967+0000","last_unstale":"2023-10-16T08:53:10.450307+0000","last_undegraded":"2023-10-16T08:53:10.450307+0000","last_fullsized":"2023-10-16T08:53:10.450307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:33:08.959927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654485+0000","last_change":"2023-10-16T08:53:09.320084+0000","last_active":"2023-10-16T08:53:10.654485+0000","last_peered":"2023-10-16T08:53:10.654485+0000","last_clean":"2023-10-16T08:53:10.654485+0000","last_became_active":"2023-10-16T08:53:09.319796+0000","last_became_peered":"2023-10-16T08:53:09.319796+0000","last_unstale":"2023-10-16T08:53:10.654485+0000","last_undegraded":"2023-10-16T08:53:10.654485+0000","last_fullsized":"2023-10-16T08:53:10.654485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:18:16.816775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294736+0000","last_change":"2023-10-16T08:53:09.312693+0000","last_active":"2023-10-16T08:53:10.294736+0000","last_peered":"2023-10-16T08:53:10.294736+0000","last_clean":"2023-10-16T08:53:10.294736+0000","last_became_active":"2023-10-16T08:53:09.312397+0000","last_became_peered":"2023-10-16T08:53:09.312397+0000","last_unstale":"2023-10-16T08:53:10.294736+0000","last_undegraded":"2023-10-16T08:53:10.294736+0000","last_fullsized":"2023-10-16T08:53:10.294736+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:19.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654075+0000","last_change":"2023-10-16T08:53:09.334745+0000","last_active":"2023-10-16T08:53:10.654075+0000","last_peered":"2023-10-16T08:53:10.654075+0000","last_clean":"2023-10-16T08:53:10.654075+0000","last_became_active":"2023-10-16T08:53:09.333418+0000","last_became_peered":"2023-10-16T08:53:09.333418+0000","last_unstale":"2023-10-16T08:53:10.654075+0000","last_undegraded":"2023-10-16T08:53:10.654075+0000","last_fullsized":"2023-10-16T08:53:10.654075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:35:04.593776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301245+0000","last_change":"2023-10-16T08:53:09.325132+0000","last_active":"2023-10-16T08:53:10.301245+0000","last_peered":"2023-10-16T08:53:10.301245+0000","last_clean":"2023-10-16T08:53:10.301245+0000","last_became_active":"2023-10-16T08:53:09.324800+0000","last_became_peered":"2023-10-16T08:53:09.324800+0000","last_unstale":"2023-10-16T08:53:10.301245+0000","last_undegraded":"2023-10-16T08:53:10.301245+0000","last_fullsized":"2023-10-16T08:53:10.301245+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:13:14.292389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653622+0000","last_change":"2023-10-16T08:53:09.322492+0000","last_active":"2023-10-16T08:53:10.653622+0000","last_peered":"2023-10-16T08:53:10.653622+0000","last_clean":"2023-10-16T08:53:10.653622+0000","last_became_active":"2023-10-16T08:53:09.322091+0000","last_became_peered":"2023-10-16T08:53:09.322091+0000","last_unstale":"2023-10-16T08:53:10.653622+0000","last_undegraded":"2023-10-16T08:53:10.653622+0000","last_fullsized":"2023-10-16T08:53:10.653622+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:50:03.058127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650848+0000","last_change":"2023-10-16T08:53:09.318256+0000","last_active":"2023-10-16T08:53:10.650848+0000","last_peered":"2023-10-16T08:53:10.650848+0000","last_clean":"2023-10-16T08:53:10.650848+0000","last_became_active":"2023-10-16T08:53:09.317978+0000","last_became_peered":"2023-10-16T08:53:09.317978+0000","last_unstale":"2023-10-16T08:53:10.650848+0000","last_undegraded":"2023-10-16T08:53:10.650848+0000","last_fullsized":"2023-10-16T08:53:10.650848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:37:27.782772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652976+0000","last_change":"2023-10-16T08:53:09.343566+0000","last_active":"2023-10-16T08:53:10.652976+0000","last_peered":"2023-10-16T08:53:10.652976+0000","last_clean":"2023-10-16T08:53:10.652976+0000","last_became_active":"2023-10-16T08:53:09.343269+0000","last_became_peered":"2023-10-16T08:53:09.343269+0000","last_unstale":"2023-10-16T08:53:10.652976+0000","last_undegraded":"2023-10-16T08:53:10.652976+0000","last_fullsized":"2023-10-16T08:53:10.652976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:21:23.786535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293987+0000","last_change":"2023-10-16T08:53:09.335382+0000","last_active":"2023-10-16T08:53:10.293987+0000","last_peered":"2023-10-16T08:53:10.293987+0000","last_clean":"2023-10-16T08:53:10.293987+0000","last_became_active":"2023-10-16T08:53:09.335094+0000","last_became_peered":"2023-10-16T08:53:09.335094+0000","last_unstale":"2023-10-16T08:53:10.293987+0000","last_undegraded":"2023-10-16T08:53:10.293987+0000","last_fullsized":"2023-10-16T08:53:10.293987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:03:50.600974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652176+0000","last_change":"2023-10-16T08:53:09.340507+0000","last_active":"2023-10-16T08:53:10.652176+0000","last_peered":"2023-10-16T08:53:10.652176+0000","last_clean":"2023-10-16T08:53:10.652176+0000","last_became_active":"2023-10-16T08:53:09.338563+0000","last_became_peered":"2023-10-16T08:53:09.338563+0000","last_unstale":"2023-10-16T08:53:10.652176+0000","last_undegraded":"2023-10-16T08:53:10.652176+0000","last_fullsized":"2023-10-16T08:53:10.652176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:58:25.526336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654488+0000","last_change":"2023-10-16T08:53:08.300319+0000","last_active":"2023-10-16T08:53:10.654488+0000","last_peered":"2023-10-16T08:53:10.654488+0000","last_clean":"2023-10-16T08:53:10.654488+0000","last_became_active":"2023-10-16T08:53:08.299704+0000","last_became_peered":"2023-10-16T08:53:08.299704+0000","last_unstale":"2023-10-16T08:53:10.654488+0000","last_undegraded":"2023-10-16T08:53:10.654488+0000","last_fullsized":"2023-10-16T08:53:10.654488+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:13:58.329186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294695+0000","last_change":"2023-10-16T08:53:09.324960+0000","last_active":"2023-10-16T08:53:10.294695+0000","last_peered":"2023-10-16T08:53:10.294695+0000","last_clean":"2023-10-16T08:53:10.294695+0000","last_became_active":"2023-10-16T08:53:09.324522+0000","last_became_peered":"2023-10-16T08:53:09.324522+0000","last_unstale":"2023-10-16T08:53:10.294695+0000","last_undegraded":"2023-10-16T08:53:10.294695+0000","last_fullsized":"2023-10-16T08:53:10.294695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:14:30.075628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649909+0000","last_change":"2023-10-16T08:53:08.291770+0000","last_active":"2023-10-16T08:53:10.649909+0000","last_peered":"2023-10-16T08:53:10.649909+0000","last_clean":"2023-10-16T08:53:10.649909+0000","last_became_active":"2023-10-16T08:53:08.291498+0000","last_became_peered":"2023-10-16T08:53:08.291498+0000","last_unstale":"2023-10-16T08:53:10.649909+0000","last_undegraded":"2023-10-16T08:53:10.649909+0000","last_fullsized":"2023-10-16T08:53:10.649909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:51:23.090483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653586+0000","last_change":"2023-10-16T08:53:09.331474+0000","last_active":"2023-10-16T08:53:10.653586+0000","last_peered":"2023-10-16T08:53:10.653586+0000","last_clean":"2023-10-16T08:53:10.653586+0000","last_became_active":"2023-10-16T08:53:09.331214+0000","last_became_peered":"2023-10-16T08:53:09.331214+0000","last_unstale":"2023-10-16T08:53:10.653586+0000","last_undegraded":"2023-10-16T08:53:10.653586+0000","last_fullsized":"2023-10-16T08:53:10.653586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:14:30.075628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294744+0000","last_change":"2023-10-16T08:53:08.299751+0000","last_active":"2023-10-16T08:53:10.294744+0000","last_peered":"2023-10-16T08:53:10.294744+0000","last_clean":"2023-10-16T08:53:10.294744+0000","last_became_active":"2023-10-16T08:53:08.299499+0000","last_became_peered":"2023-10-16T08:53:08.299499+0000","last_unstale":"2023-10-16T08:53:10.294744+0000","last_undegraded":"2023-10-16T08:53:10.294744+0000","last_fullsized":"2023-10-16T08:53:10.294744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:46:14.319338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296058+0000","last_change":"2023-10-16T08:53:09.316135+0000","last_active":"2023-10-16T08:53:10.296058+0000","last_peered":"2023-10-16T08:53:10.296058+0000","last_clean":"2023-10-16T08:53:10.296058+0000","last_became_active":"2023-10-16T08:53:09.315875+0000","last_became_peered":"2023-10-16T08:53:09.315875+0000","last_unstale":"2023-10-16T08:53:10.296058+0000","last_undegraded":"2023-10-16T08:53:10.296058+0000","last_fullsized":"2023-10-16T08:53:10.296058+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:12:15.896046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.345233+0000","last_change":"2023-10-16T08:53:08.303934+0000","last_active":"2023-10-16T08:53:09.345233+0000","last_peered":"2023-10-16T08:53:09.345233+0000","last_clean":"2023-10-16T08:53:09.345233+0000","last_became_active":"2023-10-16T08:53:08.303396+0000","last_became_peered":"2023-10-16T08:53:08.303396+0000","last_unstale":"2023-10-16T08:53:09.345233+0000","last_undegraded":"2023-10-16T08:53:09.345233+0000","last_fullsized":"2023-10-16T08:53:09.345233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:54.355800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649333+0000","last_change":"2023-10-16T08:53:09.320728+0000","last_active":"2023-10-16T08:53:10.649333+0000","last_peered":"2023-10-16T08:53:10.649333+0000","last_clean":"2023-10-16T08:53:10.649333+0000","last_became_active":"2023-10-16T08:53:09.320114+0000","last_became_peered":"2023-10-16T08:53:09.320114+0000","last_unstale":"2023-10-16T08:53:10.649333+0000","last_undegraded":"2023-10-16T08:53:10.649333+0000","last_fullsized":"2023-10-16T08:53:10.649333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:18:18.078703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301019+0000","last_change":"2023-10-16T08:53:08.295280+0000","last_active":"2023-10-16T08:53:10.301019+0000","last_peered":"2023-10-16T08:53:10.301019+0000","last_clean":"2023-10-16T08:53:10.301019+0000","last_became_active":"2023-10-16T08:53:08.294976+0000","last_became_peered":"2023-10-16T08:53:08.294976+0000","last_unstale":"2023-10-16T08:53:10.301019+0000","last_undegraded":"2023-10-16T08:53:10.301019+0000","last_fullsized":"2023-10-16T08:53:10.301019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:10:36.682117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301063+0000","last_change":"2023-10-16T08:53:09.312943+0000","last_active":"2023-10-16T08:53:10.301063+0000","last_peered":"2023-10-16T08:53:10.301063+0000","last_clean":"2023-10-16T08:53:10.301063+0000","last_became_active":"2023-10-16T08:53:09.312023+0000","last_became_peered":"2023-10-16T08:53:09.312023+0000","last_unstale":"2023-10-16T08:53:10.301063+0000","last_undegraded":"2023-10-16T08:53:10.301063+0000","last_fullsized":"2023-10-16T08:53:10.301063+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:01:01.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.348020+0000","last_change":"2023-10-16T08:53:08.300967+0000","last_active":"2023-10-16T08:53:09.348020+0000","last_peered":"2023-10-16T08:53:09.348020+0000","last_clean":"2023-10-16T08:53:09.348020+0000","last_became_active":"2023-10-16T08:53:08.300649+0000","last_became_peered":"2023-10-16T08:53:08.300649+0000","last_unstale":"2023-10-16T08:53:09.348020+0000","last_undegraded":"2023-10-16T08:53:09.348020+0000","last_fullsized":"2023-10-16T08:53:09.348020+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:21:13.892542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653351+0000","last_change":"2023-10-16T08:53:09.336747+0000","last_active":"2023-10-16T08:53:10.653351+0000","last_peered":"2023-10-16T08:53:10.653351+0000","last_clean":"2023-10-16T08:53:10.653351+0000","last_became_active":"2023-10-16T08:53:09.336391+0000","last_became_peered":"2023-10-16T08:53:09.336391+0000","last_unstale":"2023-10-16T08:53:10.653351+0000","last_undegraded":"2023-10-16T08:53:10.653351+0000","last_fullsized":"2023-10-16T08:53:10.653351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:07:09.293910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293923+0000","last_change":"2023-10-16T08:53:08.299546+0000","last_active":"2023-10-16T08:53:10.293923+0000","last_peered":"2023-10-16T08:53:10.293923+0000","last_clean":"2023-10-16T08:53:10.293923+0000","last_became_active":"2023-10-16T08:53:08.299085+0000","last_became_peered":"2023-10-16T08:53:08.299085+0000","last_unstale":"2023-10-16T08:53:10.293923+0000","last_undegraded":"2023-10-16T08:53:10.293923+0000","last_fullsized":"2023-10-16T08:53:10.293923+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T13:08:23.627969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295653+0000","last_change":"2023-10-16T08:53:09.330265+0000","last_active":"2023-10-16T08:53:10.295653+0000","last_peered":"2023-10-16T08:53:10.295653+0000","last_clean":"2023-10-16T08:53:10.295653+0000","last_became_active":"2023-10-16T08:53:09.329810+0000","last_became_peered":"2023-10-16T08:53:09.329810+0000","last_unstale":"2023-10-16T08:53:10.295653+0000","last_undegraded":"2023-10-16T08:53:10.295653+0000","last_fullsized":"2023-10-16T08:53:10.295653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:01:01.626504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.322252+0000","last_change":"2023-10-16T08:53:08.299481+0000","last_active":"2023-10-16T08:53:09.322252+0000","last_peered":"2023-10-16T08:53:09.322252+0000","last_clean":"2023-10-16T08:53:09.322252+0000","last_became_active":"2023-10-16T08:53:08.299179+0000","last_became_peered":"2023-10-16T08:53:08.299179+0000","last_unstale":"2023-10-16T08:53:09.322252+0000","last_undegraded":"2023-10-16T08:53:09.322252+0000","last_fullsized":"2023-10-16T08:53:09.322252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:21:13.892542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450698+0000","last_change":"2023-10-16T08:53:09.330900+0000","last_active":"2023-10-16T08:53:10.450698+0000","last_peered":"2023-10-16T08:53:10.450698+0000","last_clean":"2023-10-16T08:53:10.450698+0000","last_became_active":"2023-10-16T08:53:09.330601+0000","last_became_peered":"2023-10-16T08:53:09.330601+0000","last_unstale":"2023-10-16T08:53:10.450698+0000","last_undegraded":"2023-10-16T08:53:10.450698+0000","last_fullsized":"2023-10-16T08:53:10.450698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:25.275828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296110+0000","last_change":"2023-10-16T08:53:08.300180+0000","last_active":"2023-10-16T08:53:10.296110+0000","last_peered":"2023-10-16T08:53:10.296110+0000","last_clean":"2023-10-16T08:53:10.296110+0000","last_became_active":"2023-10-16T08:53:08.299093+0000","last_became_peered":"2023-10-16T08:53:08.299093+0000","last_unstale":"2023-10-16T08:53:10.296110+0000","last_undegraded":"2023-10-16T08:53:10.296110+0000","last_fullsized":"2023-10-16T08:53:10.296110+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:34.184414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651048+0000","last_change":"2023-10-16T08:53:09.328008+0000","last_active":"2023-10-16T08:53:10.651048+0000","last_peered":"2023-10-16T08:53:10.651048+0000","last_clean":"2023-10-16T08:53:10.651048+0000","last_became_active":"2023-10-16T08:53:09.327705+0000","last_became_peered":"2023-10-16T08:53:09.327705+0000","last_unstale":"2023-10-16T08:53:10.651048+0000","last_undegraded":"2023-10-16T08:53:10.651048+0000","last_fullsized":"2023-10-16T08:53:10.651048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:50:51.754324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301810+0000","last_change":"2023-10-16T08:53:08.297598+0000","last_active":"2023-10-16T08:53:10.301810+0000","last_peered":"2023-10-16T08:53:10.301810+0000","last_clean":"2023-10-16T08:53:10.301810+0000","last_became_active":"2023-10-16T08:53:08.297340+0000","last_became_peered":"2023-10-16T08:53:08.297340+0000","last_unstale":"2023-10-16T08:53:10.301810+0000","last_undegraded":"2023-10-16T08:53:10.301810+0000","last_fullsized":"2023-10-16T08:53:10.301810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:19.331517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649811+0000","last_change":"2023-10-16T08:53:09.328508+0000","last_active":"2023-10-16T08:53:10.649811+0000","last_peered":"2023-10-16T08:53:10.649811+0000","last_clean":"2023-10-16T08:53:10.649811+0000","last_became_active":"2023-10-16T08:53:09.328246+0000","last_became_peered":"2023-10-16T08:53:09.328246+0000","last_unstale":"2023-10-16T08:53:10.649811+0000","last_undegraded":"2023-10-16T08:53:10.649811+0000","last_fullsized":"2023-10-16T08:53:10.649811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:35.198345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301769+0000","last_change":"2023-10-16T08:53:08.304785+0000","last_active":"2023-10-16T08:53:10.301769+0000","last_peered":"2023-10-16T08:53:10.301769+0000","last_clean":"2023-10-16T08:53:10.301769+0000","last_became_active":"2023-10-16T08:53:08.304494+0000","last_became_peered":"2023-10-16T08:53:08.304494+0000","last_unstale":"2023-10-16T08:53:10.301769+0000","last_undegraded":"2023-10-16T08:53:10.301769+0000","last_fullsized":"2023-10-16T08:53:10.301769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:34.184414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.654228+0000","last_change":"2023-10-16T08:53:09.340996+0000","last_active":"2023-10-16T08:53:10.654228+0000","last_peered":"2023-10-16T08:53:10.654228+0000","last_clean":"2023-10-16T08:53:10.654228+0000","last_became_active":"2023-10-16T08:53:09.339854+0000","last_became_peered":"2023-10-16T08:53:09.339854+0000","last_unstale":"2023-10-16T08:53:10.654228+0000","last_undegraded":"2023-10-16T08:53:10.654228+0000","last_fullsized":"2023-10-16T08:53:10.654228+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:19.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295966+0000","last_change":"2023-10-16T08:53:08.298375+0000","last_active":"2023-10-16T08:53:10.295966+0000","last_peered":"2023-10-16T08:53:10.295966+0000","last_clean":"2023-10-16T08:53:10.295966+0000","last_became_active":"2023-10-16T08:53:08.297922+0000","last_became_peered":"2023-10-16T08:53:08.297922+0000","last_unstale":"2023-10-16T08:53:10.295966+0000","last_undegraded":"2023-10-16T08:53:10.295966+0000","last_fullsized":"2023-10-16T08:53:10.295966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:49.778990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649355+0000","last_change":"2023-10-16T08:53:09.330643+0000","last_active":"2023-10-16T08:53:10.649355+0000","last_peered":"2023-10-16T08:53:10.649355+0000","last_clean":"2023-10-16T08:53:10.649355+0000","last_became_active":"2023-10-16T08:53:09.330318+0000","last_became_peered":"2023-10-16T08:53:09.330318+0000","last_unstale":"2023-10-16T08:53:10.649355+0000","last_undegraded":"2023-10-16T08:53:10.649355+0000","last_fullsized":"2023-10-16T08:53:10.649355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:00:17.459331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295812+0000","last_change":"2023-10-16T08:53:08.301924+0000","last_active":"2023-10-16T08:53:10.295812+0000","last_peered":"2023-10-16T08:53:10.295812+0000","last_clean":"2023-10-16T08:53:10.295812+0000","last_became_active":"2023-10-16T08:53:08.301652+0000","last_became_peered":"2023-10-16T08:53:08.301652+0000","last_unstale":"2023-10-16T08:53:10.295812+0000","last_undegraded":"2023-10-16T08:53:10.295812+0000","last_fullsized":"2023-10-16T08:53:10.295812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:18:49.147742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295614+0000","last_change":"2023-10-16T08:53:09.317978+0000","last_active":"2023-10-16T08:53:10.295614+0000","last_peered":"2023-10-16T08:53:10.295614+0000","last_clean":"2023-10-16T08:53:10.295614+0000","last_became_active":"2023-10-16T08:53:09.317603+0000","last_became_peered":"2023-10-16T08:53:09.317603+0000","last_unstale":"2023-10-16T08:53:10.295614+0000","last_undegraded":"2023-10-16T08:53:10.295614+0000","last_fullsized":"2023-10-16T08:53:10.295614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:26:13.525343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.293923+0000","last_change":"2023-10-16T08:53:08.300298+0000","last_active":"2023-10-16T08:53:10.293923+0000","last_peered":"2023-10-16T08:53:10.293923+0000","last_clean":"2023-10-16T08:53:10.293923+0000","last_became_active":"2023-10-16T08:53:08.299367+0000","last_became_peered":"2023-10-16T08:53:08.299367+0000","last_unstale":"2023-10-16T08:53:10.293923+0000","last_undegraded":"2023-10-16T08:53:10.293923+0000","last_fullsized":"2023-10-16T08:53:10.293923+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:40:54.355800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.650793+0000","last_change":"2023-10-16T08:53:09.343870+0000","last_active":"2023-10-16T08:53:10.650793+0000","last_peered":"2023-10-16T08:53:10.650793+0000","last_clean":"2023-10-16T08:53:10.650793+0000","last_became_active":"2023-10-16T08:53:09.340331+0000","last_became_peered":"2023-10-16T08:53:09.340331+0000","last_unstale":"2023-10-16T08:53:10.650793+0000","last_undegraded":"2023-10-16T08:53:10.650793+0000","last_fullsized":"2023-10-16T08:53:10.650793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:19.653714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651930+0000","last_change":"2023-10-16T08:53:08.294226+0000","last_active":"2023-10-16T08:53:10.651930+0000","last_peered":"2023-10-16T08:53:10.651930+0000","last_clean":"2023-10-16T08:53:10.651930+0000","last_became_active":"2023-10-16T08:53:08.293946+0000","last_became_peered":"2023-10-16T08:53:08.293946+0000","last_unstale":"2023-10-16T08:53:10.651930+0000","last_undegraded":"2023-10-16T08:53:10.651930+0000","last_fullsized":"2023-10-16T08:53:10.651930+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:42:39.172760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295703+0000","last_change":"2023-10-16T08:53:09.320332+0000","last_active":"2023-10-16T08:53:10.295703+0000","last_peered":"2023-10-16T08:53:10.295703+0000","last_clean":"2023-10-16T08:53:10.295703+0000","last_became_active":"2023-10-16T08:53:09.320084+0000","last_became_peered":"2023-10-16T08:53:09.320084+0000","last_unstale":"2023-10-16T08:53:10.295703+0000","last_undegraded":"2023-10-16T08:53:10.295703+0000","last_fullsized":"2023-10-16T08:53:10.295703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:13:14.292389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.348022+0000","last_change":"2023-10-16T08:53:08.301084+0000","last_active":"2023-10-16T08:53:09.348022+0000","last_peered":"2023-10-16T08:53:09.348022+0000","last_clean":"2023-10-16T08:53:09.348022+0000","last_became_active":"2023-10-16T08:53:08.300761+0000","last_became_peered":"2023-10-16T08:53:08.300761+0000","last_unstale":"2023-10-16T08:53:09.348022+0000","last_undegraded":"2023-10-16T08:53:09.348022+0000","last_fullsized":"2023-10-16T08:53:09.348022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:30.692446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295888+0000","last_change":"2023-10-16T08:53:09.319158+0000","last_active":"2023-10-16T08:53:10.295888+0000","last_peered":"2023-10-16T08:53:10.295888+0000","last_clean":"2023-10-16T08:53:10.295888+0000","last_became_active":"2023-10-16T08:53:09.318891+0000","last_became_peered":"2023-10-16T08:53:09.318891+0000","last_unstale":"2023-10-16T08:53:10.295888+0000","last_undegraded":"2023-10-16T08:53:10.295888+0000","last_fullsized":"2023-10-16T08:53:10.295888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:07.180429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301742+0000","last_change":"2023-10-16T08:53:08.305658+0000","last_active":"2023-10-16T08:53:10.301742+0000","last_peered":"2023-10-16T08:53:10.301742+0000","last_clean":"2023-10-16T08:53:10.301742+0000","last_became_active":"2023-10-16T08:53:08.305386+0000","last_became_peered":"2023-10-16T08:53:08.305386+0000","last_unstale":"2023-10-16T08:53:10.301742+0000","last_undegraded":"2023-10-16T08:53:10.301742+0000","last_fullsized":"2023-10-16T08:53:10.301742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:43:25.903751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301543+0000","last_change":"2023-10-16T08:53:09.322850+0000","last_active":"2023-10-16T08:53:10.301543+0000","last_peered":"2023-10-16T08:53:10.301543+0000","last_clean":"2023-10-16T08:53:10.301543+0000","last_became_active":"2023-10-16T08:53:09.322576+0000","last_became_peered":"2023-10-16T08:53:09.322576+0000","last_unstale":"2023-10-16T08:53:10.301543+0000","last_undegraded":"2023-10-16T08:53:10.301543+0000","last_fullsized":"2023-10-16T08:53:10.301543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:09.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.346712+0000","last_change":"2023-10-16T08:53:08.305279+0000","last_active":"2023-10-16T08:53:09.346712+0000","last_peered":"2023-10-16T08:53:09.346712+0000","last_clean":"2023-10-16T08:53:09.346712+0000","last_became_active":"2023-10-16T08:53:08.305021+0000","last_became_peered":"2023-10-16T08:53:08.305021+0000","last_unstale":"2023-10-16T08:53:09.346712+0000","last_undegraded":"2023-10-16T08:53:09.346712+0000","last_fullsized":"2023-10-16T08:53:09.346712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:04:36.531485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653223+0000","last_change":"2023-10-16T08:53:09.330680+0000","last_active":"2023-10-16T08:53:10.653223+0000","last_peered":"2023-10-16T08:53:10.653223+0000","last_clean":"2023-10-16T08:53:10.653223+0000","last_became_active":"2023-10-16T08:53:09.330407+0000","last_became_peered":"2023-10-16T08:53:09.330407+0000","last_unstale":"2023-10-16T08:53:10.653223+0000","last_undegraded":"2023-10-16T08:53:10.653223+0000","last_fullsized":"2023-10-16T08:53:10.653223+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:31.706376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450750+0000","last_change":"2023-10-16T08:53:08.289358+0000","last_active":"2023-10-16T08:53:10.450750+0000","last_peered":"2023-10-16T08:53:10.450750+0000","last_clean":"2023-10-16T08:53:10.450750+0000","last_became_active":"2023-10-16T08:53:08.289137+0000","last_became_peered":"2023-10-16T08:53:08.289137+0000","last_unstale":"2023-10-16T08:53:10.450750+0000","last_undegraded":"2023-10-16T08:53:10.450750+0000","last_fullsized":"2023-10-16T08:53:10.450750+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:20:51.686646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450905+0000","last_change":"2023-10-16T08:53:09.338060+0000","last_active":"2023-10-16T08:53:10.450905+0000","last_peered":"2023-10-16T08:53:10.450905+0000","last_clean":"2023-10-16T08:53:10.450905+0000","last_became_active":"2023-10-16T08:53:09.337643+0000","last_became_peered":"2023-10-16T08:53:09.337643+0000","last_unstale":"2023-10-16T08:53:10.450905+0000","last_undegraded":"2023-10-16T08:53:10.450905+0000","last_fullsized":"2023-10-16T08:53:10.450905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:39:37.446080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294330+0000","last_change":"2023-10-16T08:53:08.301869+0000","last_active":"2023-10-16T08:53:10.294330+0000","last_peered":"2023-10-16T08:53:10.294330+0000","last_clean":"2023-10-16T08:53:10.294330+0000","last_became_active":"2023-10-16T08:53:08.301487+0000","last_became_peered":"2023-10-16T08:53:08.301487+0000","last_unstale":"2023-10-16T08:53:10.294330+0000","last_undegraded":"2023-10-16T08:53:10.294330+0000","last_fullsized":"2023-10-16T08:53:10.294330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:04:36.531485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651553+0000","last_change":"2023-10-16T08:53:09.345511+0000","last_active":"2023-10-16T08:53:10.651553+0000","last_peered":"2023-10-16T08:53:10.651553+0000","last_clean":"2023-10-16T08:53:10.651553+0000","last_became_active":"2023-10-16T08:53:09.344930+0000","last_became_peered":"2023-10-16T08:53:09.344930+0000","last_unstale":"2023-10-16T08:53:10.651553+0000","last_undegraded":"2023-10-16T08:53:10.651553+0000","last_fullsized":"2023-10-16T08:53:10.651553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:58:18.037791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450519+0000","last_change":"2023-10-16T08:53:08.290009+0000","last_active":"2023-10-16T08:53:10.450519+0000","last_peered":"2023-10-16T08:53:10.450519+0000","last_clean":"2023-10-16T08:53:10.450519+0000","last_became_active":"2023-10-16T08:53:08.289713+0000","last_became_peered":"2023-10-16T08:53:08.289713+0000","last_unstale":"2023-10-16T08:53:10.450519+0000","last_undegraded":"2023-10-16T08:53:10.450519+0000","last_fullsized":"2023-10-16T08:53:10.450519+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T09:34:56.046939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649487+0000","last_change":"2023-10-16T08:53:09.326420+0000","last_active":"2023-10-16T08:53:10.649487+0000","last_peered":"2023-10-16T08:53:10.649487+0000","last_clean":"2023-10-16T08:53:10.649487+0000","last_became_active":"2023-10-16T08:53:09.326138+0000","last_became_peered":"2023-10-16T08:53:09.326138+0000","last_unstale":"2023-10-16T08:53:10.649487+0000","last_undegraded":"2023-10-16T08:53:10.649487+0000","last_fullsized":"2023-10-16T08:53:10.649487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:36:01.184040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450395+0000","last_change":"2023-10-16T08:53:08.303738+0000","last_active":"2023-10-16T08:53:10.450395+0000","last_peered":"2023-10-16T08:53:10.450395+0000","last_clean":"2023-10-16T08:53:10.450395+0000","last_became_active":"2023-10-16T08:53:08.303229+0000","last_became_peered":"2023-10-16T08:53:08.303229+0000","last_unstale":"2023-10-16T08:53:10.450395+0000","last_undegraded":"2023-10-16T08:53:10.450395+0000","last_fullsized":"2023-10-16T08:53:10.450395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:00:41.014976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301379+0000","last_change":"2023-10-16T08:53:09.319128+0000","last_active":"2023-10-16T08:53:10.301379+0000","last_peered":"2023-10-16T08:53:10.301379+0000","last_clean":"2023-10-16T08:53:10.301379+0000","last_became_active":"2023-10-16T08:53:09.318825+0000","last_became_peered":"2023-10-16T08:53:09.318825+0000","last_unstale":"2023-10-16T08:53:10.301379+0000","last_undegraded":"2023-10-16T08:53:10.301379+0000","last_fullsized":"2023-10-16T08:53:10.301379+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:53:45.827836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.318044+0000","last_change":"2023-10-16T08:53:08.297519+0000","last_active":"2023-10-16T08:53:09.318044+0000","last_peered":"2023-10-16T08:53:09.318044+0000","last_clean":"2023-10-16T08:53:09.318044+0000","last_became_active":"2023-10-16T08:53:08.297202+0000","last_became_peered":"2023-10-16T08:53:08.297202+0000","last_unstale":"2023-10-16T08:53:09.318044+0000","last_undegraded":"2023-10-16T08:53:09.318044+0000","last_fullsized":"2023-10-16T08:53:09.318044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:04:36.531485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295818+0000","last_change":"2023-10-16T08:53:09.330070+0000","last_active":"2023-10-16T08:53:10.295818+0000","last_peered":"2023-10-16T08:53:10.295818+0000","last_clean":"2023-10-16T08:53:10.295818+0000","last_became_active":"2023-10-16T08:53:09.329416+0000","last_became_peered":"2023-10-16T08:53:09.329416+0000","last_unstale":"2023-10-16T08:53:10.295818+0000","last_undegraded":"2023-10-16T08:53:10.295818+0000","last_fullsized":"2023-10-16T08:53:10.295818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T12:53:45.827836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.450303+0000","last_change":"2023-10-16T08:53:08.290196+0000","last_active":"2023-10-16T08:53:10.450303+0000","last_peered":"2023-10-16T08:53:10.450303+0000","last_clean":"2023-10-16T08:53:10.450303+0000","last_became_active":"2023-10-16T08:53:08.289796+0000","last_became_peered":"2023-10-16T08:53:08.289796+0000","last_unstale":"2023-10-16T08:53:10.450303+0000","last_undegraded":"2023-10-16T08:53:10.450303+0000","last_fullsized":"2023-10-16T08:53:10.450303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:19:27.967107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294391+0000","last_change":"2023-10-16T08:53:09.323850+0000","last_active":"2023-10-16T08:53:10.294391+0000","last_peered":"2023-10-16T08:53:10.294391+0000","last_clean":"2023-10-16T08:53:10.294391+0000","last_became_active":"2023-10-16T08:53:09.323572+0000","last_became_peered":"2023-10-16T08:53:09.323572+0000","last_unstale":"2023-10-16T08:53:10.294391+0000","last_undegraded":"2023-10-16T08:53:10.294391+0000","last_fullsized":"2023-10-16T08:53:10.294391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:07:09.293910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301982+0000","last_change":"2023-10-16T08:53:08.302582+0000","last_active":"2023-10-16T08:53:10.301982+0000","last_peered":"2023-10-16T08:53:10.301982+0000","last_clean":"2023-10-16T08:53:10.301982+0000","last_became_active":"2023-10-16T08:53:08.302314+0000","last_became_peered":"2023-10-16T08:53:08.302314+0000","last_unstale":"2023-10-16T08:53:10.301982+0000","last_undegraded":"2023-10-16T08:53:10.301982+0000","last_fullsized":"2023-10-16T08:53:10.301982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:07.947077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651392+0000","last_change":"2023-10-16T08:53:09.330679+0000","last_active":"2023-10-16T08:53:10.651392+0000","last_peered":"2023-10-16T08:53:10.651392+0000","last_clean":"2023-10-16T08:53:10.651392+0000","last_became_active":"2023-10-16T08:53:09.330121+0000","last_became_peered":"2023-10-16T08:53:09.330121+0000","last_unstale":"2023-10-16T08:53:10.651392+0000","last_undegraded":"2023-10-16T08:53:10.651392+0000","last_fullsized":"2023-10-16T08:53:10.651392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:34:16.419576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.453463+0000","last_change":"2023-10-16T08:53:08.298406+0000","last_active":"2023-10-16T08:53:10.453463+0000","last_peered":"2023-10-16T08:53:10.453463+0000","last_clean":"2023-10-16T08:53:10.453463+0000","last_became_active":"2023-10-16T08:53:08.298056+0000","last_became_peered":"2023-10-16T08:53:08.298056+0000","last_unstale":"2023-10-16T08:53:10.453463+0000","last_undegraded":"2023-10-16T08:53:10.453463+0000","last_fullsized":"2023-10-16T08:53:10.453463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:13:53.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.296020+0000","last_change":"2023-10-16T08:53:09.332339+0000","last_active":"2023-10-16T08:53:10.296020+0000","last_peered":"2023-10-16T08:53:10.296020+0000","last_clean":"2023-10-16T08:53:10.296020+0000","last_became_active":"2023-10-16T08:53:09.332053+0000","last_became_peered":"2023-10-16T08:53:09.332053+0000","last_unstale":"2023-10-16T08:53:10.296020+0000","last_undegraded":"2023-10-16T08:53:10.296020+0000","last_fullsized":"2023-10-16T08:53:10.296020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:09.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649725+0000","last_change":"2023-10-16T08:53:08.285854+0000","last_active":"2023-10-16T08:53:10.649725+0000","last_peered":"2023-10-16T08:53:10.649725+0000","last_clean":"2023-10-16T08:53:10.649725+0000","last_became_active":"2023-10-16T08:53:08.285626+0000","last_became_peered":"2023-10-16T08:53:08.285626+0000","last_unstale":"2023-10-16T08:53:10.649725+0000","last_undegraded":"2023-10-16T08:53:10.649725+0000","last_fullsized":"2023-10-16T08:53:10.649725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:18:15.802845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649733+0000","last_change":"2023-10-16T08:53:09.318762+0000","last_active":"2023-10-16T08:53:10.649733+0000","last_peered":"2023-10-16T08:53:10.649733+0000","last_clean":"2023-10-16T08:53:10.649733+0000","last_became_active":"2023-10-16T08:53:09.318460+0000","last_became_peered":"2023-10-16T08:53:09.318460+0000","last_unstale":"2023-10-16T08:53:10.649733+0000","last_undegraded":"2023-10-16T08:53:10.649733+0000","last_fullsized":"2023-10-16T08:53:10.649733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:20.345447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.649490+0000","last_change":"2023-10-16T08:53:08.300334+0000","last_active":"2023-10-16T08:53:10.649490+0000","last_peered":"2023-10-16T08:53:10.649490+0000","last_clean":"2023-10-16T08:53:10.649490+0000","last_became_active":"2023-10-16T08:53:08.300047+0000","last_became_peered":"2023-10-16T08:53:08.300047+0000","last_unstale":"2023-10-16T08:53:10.649490+0000","last_undegraded":"2023-10-16T08:53:10.649490+0000","last_fullsized":"2023-10-16T08:53:10.649490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T10:37:26.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.294066+0000","last_change":"2023-10-16T08:53:09.322367+0000","last_active":"2023-10-16T08:53:10.294066+0000","last_peered":"2023-10-16T08:53:10.294066+0000","last_clean":"2023-10-16T08:53:10.294066+0000","last_became_active":"2023-10-16T08:53:09.322017+0000","last_became_peered":"2023-10-16T08:53:09.322017+0000","last_unstale":"2023-10-16T08:53:10.294066+0000","last_undegraded":"2023-10-16T08:53:10.294066+0000","last_fullsized":"2023-10-16T08:53:10.294066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:03:31.706376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.653357+0000","last_change":"2023-10-16T08:53:08.292553+0000","last_active":"2023-10-16T08:53:10.653357+0000","last_peered":"2023-10-16T08:53:10.653357+0000","last_clean":"2023-10-16T08:53:10.653357+0000","last_became_active":"2023-10-16T08:53:08.292215+0000","last_became_peered":"2023-10-16T08:53:08.292215+0000","last_unstale":"2023-10-16T08:53:10.653357+0000","last_undegraded":"2023-10-16T08:53:10.653357+0000","last_fullsized":"2023-10-16T08:53:10.653357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:03:48.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652667+0000","last_change":"2023-10-16T08:53:09.332585+0000","last_active":"2023-10-16T08:53:10.652667+0000","last_peered":"2023-10-16T08:53:10.652667+0000","last_clean":"2023-10-16T08:53:10.652667+0000","last_became_active":"2023-10-16T08:53:09.332324+0000","last_became_peered":"2023-10-16T08:53:09.332324+0000","last_unstale":"2023-10-16T08:53:10.652667+0000","last_undegraded":"2023-10-16T08:53:10.652667+0000","last_fullsized":"2023-10-16T08:53:10.652667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:23.754818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.324086+0000","last_change":"2023-10-16T08:53:08.302122+0000","last_active":"2023-10-16T08:53:09.324086+0000","last_peered":"2023-10-16T08:53:09.324086+0000","last_clean":"2023-10-16T08:53:09.324086+0000","last_became_active":"2023-10-16T08:53:08.301809+0000","last_became_peered":"2023-10-16T08:53:08.301809+0000","last_unstale":"2023-10-16T08:53:09.324086+0000","last_undegraded":"2023-10-16T08:53:09.324086+0000","last_fullsized":"2023-10-16T08:53:09.324086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:15:41.651549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.652572+0000","last_change":"2023-10-16T08:53:09.332049+0000","last_active":"2023-10-16T08:53:10.652572+0000","last_peered":"2023-10-16T08:53:10.652572+0000","last_clean":"2023-10-16T08:53:10.652572+0000","last_became_active":"2023-10-16T08:53:09.331634+0000","last_became_peered":"2023-10-16T08:53:09.331634+0000","last_unstale":"2023-10-16T08:53:10.652572+0000","last_undegraded":"2023-10-16T08:53:10.652572+0000","last_fullsized":"2023-10-16T08:53:10.652572+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T11:55:03.062412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.295530+0000","last_change":"2023-10-16T08:53:08.295439+0000","last_active":"2023-10-16T08:53:10.295530+0000","last_peered":"2023-10-16T08:53:10.295530+0000","last_clean":"2023-10-16T08:53:10.295530+0000","last_became_active":"2023-10-16T08:53:08.295098+0000","last_became_peered":"2023-10-16T08:53:08.295098+0000","last_unstale":"2023-10-16T08:53:10.295530+0000","last_undegraded":"2023-10-16T08:53:10.295530+0000","last_fullsized":"2023-10-16T08:53:10.295530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:05:07.947077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.301437+0000","last_change":"2023-10-16T08:53:09.319684+0000","last_active":"2023-10-16T08:53:10.301437+0000","last_peered":"2023-10-16T08:53:10.301437+0000","last_clean":"2023-10-16T08:53:10.301437+0000","last_became_active":"2023-10-16T08:53:09.319407+0000","last_became_peered":"2023-10-16T08:53:09.319407+0000","last_unstale":"2023-10-16T08:53:10.301437+0000","last_undegraded":"2023-10-16T08:53:10.301437+0000","last_fullsized":"2023-10-16T08:53:10.301437+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:08.256914+0000","last_clean_scrub_stamp":"2023-10-16T08:53:08.256914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:24:07.180429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T08:53:09.319478+0000","last_change":"2023-10-16T08:53:08.294613+0000","last_active":"2023-10-16T08:53:09.319478+0000","last_peered":"2023-10-16T08:53:09.319478+0000","last_clean":"2023-10-16T08:53:09.319478+0000","last_became_active":"2023-10-16T08:53:08.294277+0000","last_became_peered":"2023-10-16T08:53:08.294277+0000","last_unstale":"2023-10-16T08:53:09.319478+0000","last_undegraded":"2023-10-16T08:53:09.319478+0000","last_fullsized":"2023-10-16T08:53:09.319478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:53:07.242984+0000","last_clean_scrub_stamp":"2023-10-16T08:53:07.242984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:03:02.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T08:53:10.651806+0000","last_change":"2023-10-16T08:51:09.503647+0000","last_active":"2023-10-16T08:53:10.651806+0000","last_peered":"2023-10-16T08:53:10.651806+0000","last_clean":"2023-10-16T08:53:10.651806+0000","last_became_active":"2023-10-16T08:51:09.501573+0000","last_became_peered":"2023-10-16T08:51:09.501573+0000","last_unstale":"2023-10-16T08:53:10.651806+0000","last_undegraded":"2023-10-16T08:53:10.651806+0000","last_fullsized":"2023-10-16T08:53:10.651806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T08:51:08.277379+0000","last_clean_scrub_stamp":"2023-10-16T08:51:08.277379+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:35:32.541738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":794117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.75},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.69099999999999995}]},{"osd":1,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.93500000000000005}]},{"osd":3,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.96999999999999997}]},{"osd":4,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.506}]},{"osd":5,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.0660000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.252}]}]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":202671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.018,"15min":1.014},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.339},{"interface":"front","average":{"1min":1.093,"5min":1.052,"15min":1.0449999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.419}]},{"osd":1,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.234,"15min":1.24},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.72099999999999997}]},{"osd":2,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2030000000000001,"15min":1.204},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.5369999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.089},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3460000000000001,"15min":1.3560000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.85299999999999998}]},{"osd":3,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.226,"15min":1.212},"min":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3109999999999999,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.208}]},{"osd":5,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.494,"15min":1.5029999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.476,"15min":1.492},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0249999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.5600000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.466,"15min":1.448},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.0369999999999999,"5min":5.0369999999999999,"15min":5.0369999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.631,"5min":1.6619999999999999,"15min":1.667},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":1.663}]},{"osd":7,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.5649999999999999,"15min":1.579},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.502,"15min":1.496},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.911,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.512}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":202649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0609999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.137},{"interface":"front","average":{"1min":1.179,"5min":1.2150000000000001,"15min":1.2210000000000001},"min":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.768,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":1.0760000000000001}]},{"osd":1,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1060000000000001,"15min":1.097},"min":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1140000000000001,"15min":1.129},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.345,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.2969999999999999}]},{"osd":2,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.099,"15min":1.097},"min":{"1min":0.78900000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.55,"5min":1.706,"15min":1.706},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.76500000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.5149999999999999}]},{"osd":3,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":1.008,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6579999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.365},{"interface":"front","average":{"1min":1.266,"5min":1.292,"15min":1.296},"min":{"1min":0.76900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.411}]},{"osd":4,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.153,"15min":1.141},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.675,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4950000000000001,"15min":1.5},"min":{"1min":0.92500000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0630000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.589}]},{"osd":5,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2509999999999999,"15min":1.2470000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5569999999999999,"5min":2.528,"15min":2.528},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4039999999999999,"15min":1.3979999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.718,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.4710000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.5780000000000001,"15min":1.5840000000000001},"min":{"1min":1.0089999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7789999999999999,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4430000000000001,"15min":1.45},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.9970000000000001,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.1910000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":202179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":5.835,"5min":5.835,"15min":5.835},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":4.1539999999999999,"5min":4.1539999999999999,"15min":4.1539999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.044,"5min":3.044,"15min":3.044},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.913,"15min":1.913},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":14.76,"5min":14.76,"15min":14.76},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":11.981,"5min":11.981,"15min":11.981},"last":0.58899999999999997}]},{"osd":4,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":13.914999999999999,"5min":13.914999999999999,"15min":13.914999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.028,"5min":2.028,"15min":2.028},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":15.811999999999999,"5min":15.811999999999999,"15min":15.811999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":4.7380000000000004,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":6.5679999999999996,"5min":6.5679999999999996,"15min":6.5679999999999996},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":6.6299999999999999,"5min":6.6299999999999999,"15min":6.6299999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":6.6029999999999998,"5min":6.6029999999999998,"15min":6.6029999999999998},"last":0.68300000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":203713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.876,"15min":0.89900000000000002},"min":{"1min":0.45000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1619999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.409,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.874}]},{"osd":1,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91400000000000003,"15min":0.92600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.619,"5min":1.76,"15min":1.76},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.64700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.46,"5min":3.242,"15min":3.242},"last":0.92200000000000004}]},{"osd":2,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.1060000000000001,"15min":1.1359999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.456,"5min":1.615,"15min":1.615},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2210000000000001,"15min":1.25},"min":{"1min":0.69199999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4810000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.3400000000000001,"15min":1.3620000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.738,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.02},{"interface":"front","average":{"1min":1.242,"5min":1.385,"15min":1.409},"min":{"1min":0.90000000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.591,"5min":3.3340000000000001,"15min":3.3340000000000001},"last":1.268}]},{"osd":5,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.343,"15min":1.359},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.615,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.431,"15min":1.4510000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.841,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.2030000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.5069999999999999,"15min":1.5309999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.792,"5min":3.1320000000000001,"15min":3.1320000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.534,"15min":1.5629999999999999},"min":{"1min":0.92600000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9550000000000001,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.448}]},{"osd":7,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.46,"15min":1.498},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5640000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.099},{"interface":"front","average":{"1min":1.448,"5min":1.601,"15min":1.627},"min":{"1min":0.97599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.907,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.3069999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":202137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.224,"5min":1.306,"15min":1.306},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.98199999999999998,"15min":0.999},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.5349999999999999,"5min":2.052,"15min":2.052},"last":1.5349999999999999}]},{"osd":1,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.036,"15min":1.0640000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5469999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.995,"15min":1.022},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4610000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.1459999999999999,"15min":1.1739999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4179999999999999,"5min":1.948,"15min":1.948},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.1060000000000001,"15min":1.127},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6220000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.98599999999999999}]},{"osd":4,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2789999999999999,"15min":1.274},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.605},{"interface":"front","average":{"1min":1.151,"5min":1.3540000000000001,"15min":1.3879999999999999},"min":{"1min":0.85999999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.4670000000000001,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.379}]},{"osd":5,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.4299999999999999,"15min":1.4530000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9410000000000001,"5min":2.27,"15min":2.27},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3819999999999999,"15min":1.4059999999999999},"min":{"1min":0.93000000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7130000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.4750000000000001}]},{"osd":6,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.53,"15min":1.5600000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.476,"15min":1.4970000000000001},"min":{"1min":0.91600000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.859,"5min":2.665,"15min":2.665},"last":1.1120000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:53:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.4590000000000001,"15min":1.484},"min":{"1min":0.92800000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9330000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.5069999999999999,"15min":1.5249999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.9430000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.325}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":202157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.92600000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.873,"15min":0.89100000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.98099999999999998}]},{"osd":2,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.98299999999999998,"15min":0.997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2589999999999999,"5min":1.7,"15min":1.7},"last":1.036},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.0669999999999999,"15min":1.107},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5529999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.79700000000000004}]},{"osd":3,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.155,"15min":1.1930000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7789999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.494,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":1.073}]},{"osd":4,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3120000000000001,"15min":1.325},"min":{"1min":0.85799999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.677,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.371},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1020000000000001,"15min":1.099},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.216}]},{"osd":5,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1890000000000001,"15min":1.2030000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6120000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.391,"15min":1.419},"min":{"1min":0.83199999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.8100000000000001,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.123}]},{"osd":6,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3859999999999999,"15min":1.4059999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8899999999999999,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.2},{"interface":"front","average":{"1min":1.206,"5min":1.4350000000000001,"15min":1.4730000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.75,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4850000000000001}]},{"osd":7,"last update":"Mon Oct 16 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.456,"15min":1.4750000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9379999999999999,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.4390000000000001,"15min":1.466},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6919999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":792469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2649999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.5109999999999999,"5min":1.609,"15min":1.609},"last":0.92200000000000004}]},{"osd":2,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94799999999999995,"15min":0.94999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4199999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.292,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.0049999999999999}]},{"osd":3,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4370000000000001,"5min":2.391,"15min":2.391},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.21,"15min":1.228},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5549999999999999,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":1.474}]},{"osd":4,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.573,"15min":1.653},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4730000000000001,"5min":13.706,"15min":13.706},"last":1.153},{"interface":"front","average":{"1min":1.331,"5min":1.2849999999999999,"15min":1.2769999999999999},"min":{"1min":0.69799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.8600000000000001,"5min":2.472,"15min":2.472},"last":1.8600000000000001}]},{"osd":5,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.617,"5min":4.819,"15min":4.819},"last":1.617},{"interface":"front","average":{"1min":1.359,"5min":1.647,"15min":1.6950000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8160000000000001,"5min":10.791,"15min":10.791},"last":1.7669999999999999}]},{"osd":6,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.8560000000000001,"15min":1.948},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.986,"5min":15.968999999999999,"15min":15.968999999999999},"last":1.986},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.825,"15min":1.9119999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9370000000000001,"5min":15.346,"15min":15.346},"last":1.887}]},{"osd":7,"last update":"Mon Oct 16 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.52,"15min":1.534},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.9219999999999999,"5min":3.8170000000000002,"15min":3.8170000000000002},"last":1.9219999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.405,"15min":1.4259999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.8169999999999999,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.8169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T08:53:14.603 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T08:53:14.604 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-16T08:53:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.865+0000 7f71f73f4640 1 Processor -- start 2023-10-16T08:53:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.865+0000 7f71f73f4640 1 -- start start 2023-10-16T08:53:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.866+0000 7f71f73f4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f015ca60 0x7f71f00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.866+0000 7f71f73f4640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71f00b30a0 0x7f71f00c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.866+0000 7f71f73f4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00c8a90 con 0x7f71f00ce680 2023-10-16T08:53:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.866+0000 7f71f73f4640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00c8d70 con 0x7f71f00b30a0 2023-10-16T08:53:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.866+0000 7f71f73f4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00c9050 con 0x7f71f015ca60 2023-10-16T08:53:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71f00b30a0 0x7f71f00c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71f00b30a0 0x7f71f00c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39536/0 (socket says 172.21.15.94:39536) 2023-10-16T08:53:14.870 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 -- 172.21.15.94:0/3757852843 learned_addr learned my addr 172.21.15.94:0/3757852843 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:14.871 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f63f2640 1 --2- 172.21.15.94:0/3757852843 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f015ca60 0x7f71f00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 -- 172.21.15.94:0/3757852843 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f015ca60 msgr2=0x7f71f00cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:14.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 --2- 172.21.15.94:0/3757852843 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f015ca60 0x7f71f00cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 -- 172.21.15.94:0/3757852843 >> v1:172.21.15.130:6789/0 conn(0x7f71f00ce680 legacy=0x7f71f006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.872 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.867+0000 7f71f5bf1640 1 -- 172.21.15.94:0/3757852843 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00c9330 con 0x7f71f00b30a0 2023-10-16T08:53:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.869+0000 7f71f5bf1640 1 --2- 172.21.15.94:0/3757852843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00b30a0 0x7f71f00c9b30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009870 tx=0x7f71e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5555b79607ba317d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.869+0000 7f71f53f0640 1 -- 172.21.15.94:0/3757852843 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4031640 con 0x7f71f00b30a0 2023-10-16T08:53:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.869+0000 7f71f53f0640 1 -- 172.21.15.94:0/3757852843 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40317a0 con 0x7f71f00b30a0 2023-10-16T08:53:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.869+0000 7f71f53f0640 1 -- 172.21.15.94:0/3757852843 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4031b30 con 0x7f71f00b30a0 2023-10-16T08:53:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 -- 172.21.15.94:0/3757852843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00b30a0 msgr2=0x7f71f00c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 --2- 172.21.15.94:0/3757852843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00b30a0 0x7f71f00c9b30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009870 tx=0x7f71e402b8f0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 -- 172.21.15.94:0/3757852843 shutdown_connections 2023-10-16T08:53:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 --2- 172.21.15.94:0/3757852843 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00b30a0 0x7f71f00c9b30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 --2- 172.21.15.94:0/3757852843 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f015ca60 0x7f71f00cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 -- 172.21.15.94:0/3757852843 >> 172.21.15.94:0/3757852843 conn(0x7f71f0069fc0 msgr2=0x7f71f006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:14.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 -- 172.21.15.94:0/3757852843 shutdown_connections 2023-10-16T08:53:14.875 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.870+0000 7f71f73f4640 1 -- 172.21.15.94:0/3757852843 wait complete. 2023-10-16T08:53:14.876 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.872+0000 7f71f73f4640 1 Processor -- start 2023-10-16T08:53:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.872+0000 7f71f73f4640 1 -- start start 2023-10-16T08:53:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f73f4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f00b30a0 0x7f71f01593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f73f4640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 0x7f71f00ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f73f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71f015ca60 0x7f71f00af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f73f4640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f01f3090 con 0x7f71f00ce680 2023-10-16T08:53:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f73f4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00c5840 con 0x7f71f015ca60 2023-10-16T08:53:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f73f4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f01f2070 con 0x7f71f00b30a0 2023-10-16T08:53:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 0x7f71f00ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 0x7f71f00ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39552/0 (socket says 172.21.15.94:39552) 2023-10-16T08:53:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 -- 172.21.15.94:0/78891530 learned_addr learned my addr 172.21.15.94:0/78891530 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 -- 172.21.15.94:0/78891530 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f00b30a0 msgr2=0x7f71f01593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f00b30a0 0x7f71f01593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 -- 172.21.15.94:0/78891530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71f015ca60 msgr2=0x7f71f00af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71f015ca60 0x7f71f00af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.873+0000 7f71f5bf1640 1 -- 172.21.15.94:0/78891530 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40094d0 con 0x7f71f00ce680 2023-10-16T08:53:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.874+0000 7f71f5bf1640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 0x7f71f00ac790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f71e402b930 tx=0x7f71e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.874+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e403ac60 con 0x7f71f00ce680 2023-10-16T08:53:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.874+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e403adc0 con 0x7f71f00ce680 2023-10-16T08:53:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.874+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4042630 con 0x7f71f00ce680 2023-10-16T08:53:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.874+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f01598e0 con 0x7f71f00ce680 2023-10-16T08:53:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.874+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f01f22d0 con 0x7f71f00ce680 2023-10-16T08:53:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.876+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f0066880 con 0x7f71f00ce680 2023-10-16T08:53:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.876+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71e402f050 con 0x7f71f00ce680 2023-10-16T08:53:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.877+0000 7f71eeffd640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f71dc06ae70 0x7f71dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.877+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f71e40ab450 con 0x7f71f00ce680 2023-10-16T08:53:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.878+0000 7f71f63f2640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f71dc06ae70 0x7f71dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.878+0000 7f71f63f2640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f71dc06ae70 0x7f71dc06d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71e00070b0 tx=0x7f71e0007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:14.882+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71e4076280 con 0x7f71f00ce680 2023-10-16T08:53:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.145+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f71f00ad4d0 con 0x7f71f00ce680 2023-10-16T08:53:15.151 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.149+0000 7f71eeffd640 1 -- 172.21.15.94:0/78891530 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 195+0+152 (secure 0 0 0) 0x7f71e4031e60 con 0x7f71f00ce680 2023-10-16T08:53:15.151 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2023-10-16T08:53:15.151 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA++SxlUlLsJRAAUJkmJH2I1H5D3uqFOH2BXQ== 2023-10-16T08:53:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow" 2023-10-16T08:53:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow r" 2023-10-16T08:53:15.152 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-16T08:53:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:updated caps for client.0 2023-10-16T08:53:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.151+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f71dc06ae70 msgr2=0x7f71dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.151+0000 7f71f73f4640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f71dc06ae70 0x7f71dc06d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71e00070b0 tx=0x7f71e0007040 comp rx=0 tx=0).stop 2023-10-16T08:53:15.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.151+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 msgr2=0x7f71f00ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.154 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.151+0000 7f71f73f4640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 0x7f71f00ac790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f71e402b930 tx=0x7f71e40046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 shutdown_connections 2023-10-16T08:53:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f71dc06ae70 0x7f71dc06d330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71f015ca60 0x7f71f00af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71f00ce680 0x7f71f00ac790 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 --2- 172.21.15.94:0/78891530 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71f00b30a0 0x7f71f01593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 >> 172.21.15.94:0/78891530 conn(0x7f71f0069fc0 msgr2=0x7f71f00b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 shutdown_connections 2023-10-16T08:53:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.152+0000 7f71f73f4640 1 -- 172.21.15.94:0/78891530 wait complete. 2023-10-16T08:53:15.173 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T08:53:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.383+0000 7fe424810640 1 Processor -- start 2023-10-16T08:53:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.383+0000 7fe424810640 1 -- start start 2023-10-16T08:53:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe424810640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe4200b0010 0x7fe4200701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe424810640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe42015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe424810640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4200707f0 con 0x7fe42015ad00 2023-10-16T08:53:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe424810640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe420070ad0 con 0x7fe4200b0010 2023-10-16T08:53:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe424810640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42015b1d0 con 0x7fe42015f040 2023-10-16T08:53:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe417fff640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fe42015ad00 0x7fe4200b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:35844/0 (socket says 172.21.15.94:35844) 2023-10-16T08:53:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe41e59c640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe4200b0010 0x7fe4200701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.385+0000 7fe417fff640 1 -- 172.21.15.94:0/2005913570 learned_addr learned my addr 172.21.15.94:0/2005913570 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41ed9d640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe42015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41e59c640 1 -- 172.21.15.94:0/2005913570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 msgr2=0x7fe42015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41e59c640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe42015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41e59c640 1 -- 172.21.15.94:0/2005913570 >> v1:172.21.15.94:6789/0 conn(0x7fe42015ad00 legacy=0x7fe4200b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41e59c640 1 -- 172.21.15.94:0/2005913570 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42015b4b0 con 0x7fe4200b0010 2023-10-16T08:53:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41dd9b640 1 -- 172.21.15.94:0/2005913570 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484520434 0 0) 0x7fe4200707f0 con 0x7fe42015ad00 2023-10-16T08:53:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.386+0000 7fe41ed9d640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe42015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.387+0000 7fe41e59c640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4200b0010 0x7fe4200701a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4100097a0 tx=0x7fe41002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e3014c3b4a9bec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.387+0000 7fe41dd9b640 1 -- 172.21.15.94:0/2005913570 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41002d040 con 0x7fe4200b0010 2023-10-16T08:53:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.387+0000 7fe41dd9b640 1 -- 172.21.15.94:0/2005913570 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410031810 con 0x7fe4200b0010 2023-10-16T08:53:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.387+0000 7fe41dd9b640 1 -- 172.21.15.94:0/2005913570 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410031ba0 con 0x7fe4200b0010 2023-10-16T08:53:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 -- 172.21.15.94:0/2005913570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4200b0010 msgr2=0x7fe4200701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4200b0010 0x7fe4200701a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4100097a0 tx=0x7fe41002b8b0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 -- 172.21.15.94:0/2005913570 shutdown_connections 2023-10-16T08:53:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe42015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 --2- 172.21.15.94:0/2005913570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4200b0010 0x7fe4200701a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 -- 172.21.15.94:0/2005913570 >> 172.21.15.94:0/2005913570 conn(0x7fe42006c1c0 msgr2=0x7fe42006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 -- 172.21.15.94:0/2005913570 shutdown_connections 2023-10-16T08:53:15.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.388+0000 7fe424810640 1 -- 172.21.15.94:0/2005913570 wait complete. 2023-10-16T08:53:15.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.389+0000 7fe424810640 1 Processor -- start 2023-10-16T08:53:15.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.390+0000 7fe424810640 1 -- start start 2023-10-16T08:53:15.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.390+0000 7fe424810640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4200b0010 0x7fe420150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:15.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.390+0000 7fe424810640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 0x7fe4200c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:15.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.390+0000 7fe424810640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe4200c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:15.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe424810640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42015e220 con 0x7fe42015ad00 2023-10-16T08:53:15.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe424810640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c4e00 con 0x7fe4200b0010 2023-10-16T08:53:15.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe424810640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c6950 con 0x7fe42015f040 2023-10-16T08:53:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 0x7fe4200c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 0x7fe4200c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39568/0 (socket says 172.21.15.94:39568) 2023-10-16T08:53:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 -- 172.21.15.94:0/141738393 learned_addr learned my addr 172.21.15.94:0/141738393 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 -- 172.21.15.94:0/141738393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 msgr2=0x7fe4200c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe4200c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 -- 172.21.15.94:0/141738393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4200b0010 msgr2=0x7fe420150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4200b0010 0x7fe420150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 -- 172.21.15.94:0/141738393 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410009400 con 0x7fe42015ad00 2023-10-16T08:53:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.391+0000 7fe417fff640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 0x7fe4200c7430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe40800c4b0 tx=0x7fe40800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.392+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080074e0 con 0x7fe42015ad00 2023-10-16T08:53:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.392+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408007660 con 0x7fe42015ad00 2023-10-16T08:53:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.392+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408004a20 con 0x7fe42015ad00 2023-10-16T08:53:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.392+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4200c6c30 con 0x7fe42015ad00 2023-10-16T08:53:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.392+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420150fc0 con 0x7fe42015ad00 2023-10-16T08:53:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.393+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4200c7150 con 0x7fe42015ad00 2023-10-16T08:53:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.394+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe408004b80 con 0x7fe42015ad00 2023-10-16T08:53:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.395+0000 7fe416ffd640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe40006aea0 0x7fe40006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.396+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe408088870 con 0x7fe42015ad00 2023-10-16T08:53:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.396+0000 7fe41e59c640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe40006aea0 0x7fe40006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.396+0000 7fe41e59c640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe40006aea0 0x7fe40006d360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe410036000 tx=0x7fe410030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.400+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4200c7150 con 0x7fe42015ad00 2023-10-16T08:53:15.632 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.630+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4200c7150 con 0x7fe42015ad00 2023-10-16T08:53:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.631+0000 7fe416ffd640 1 -- 172.21.15.94:0/141738393 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fe4200c7150 con 0x7fe42015ad00 2023-10-16T08:53:15.634 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:15.634 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/3622211172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":3622211172},{"type":"v1","addr":"172.21.15.130:6834","nonce":3622211172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/612045765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":612045765},{"type":"v1","addr":"172.21.15.130:6835","nonce":612045765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6836/3279734748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3279734748},{"type":"v1","addr":"172.21.15.94:6836","nonce":3279734748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T08:53:08.734532+0000","modified":"2023-10-16T08:53:12.163933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6837/129304957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":129304957},{"type":"v1","addr":"172.21.15.94:6837","nonce":129304957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T08:53:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 15 2023-10-16T08:53:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe40006aea0 msgr2=0x7fe40006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe40006aea0 0x7fe40006d360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe410036000 tx=0x7fe410030000 comp rx=0 tx=0).stop 2023-10-16T08:53:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 msgr2=0x7fe4200c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 0x7fe4200c7430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe40800c4b0 tx=0x7fe40800c970 comp rx=0 tx=0).stop 2023-10-16T08:53:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 shutdown_connections 2023-10-16T08:53:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe42015f040 0x7fe4200c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe42015ad00 0x7fe4200c7430 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fe40006aea0 0x7fe40006d360 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 --2- 172.21.15.94:0/141738393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4200b0010 0x7fe420150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.634+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 >> 172.21.15.94:0/141738393 conn(0x7fe42006c1c0 msgr2=0x7fe420072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.635+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 shutdown_connections 2023-10-16T08:53:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:15.635+0000 7fe424810640 1 -- 172.21.15.94:0/141738393 wait complete. 2023-10-16T08:53:16.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T08:53:08.734532+0000', 'modified': '2023-10-16T08:53:12.163933+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5535}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5535': {'gid': 5535, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.94:6837/129304957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6835', 'nonce': 129304957}, {'type': 'v1', 'addr': '172.21.15.94:6837', 'nonce': 129304957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T08:53:16.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T08:53:16.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T08:53:16.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.282+0000 7f3878cf1640 1 Processor -- start 2023-10-16T08:53:16.284 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.282+0000 7f3878cf1640 1 -- start start 2023-10-16T08:53:16.285 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.283+0000 7f3878cf1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f38740b2dd0 0x7f387406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.283+0000 7f3878cf1640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387415f0d0 con 0x7f387406dc20 2023-10-16T08:53:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.283+0000 7f3878cf1640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387415ab50 con 0x7f38740ced10 2023-10-16T08:53:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.283+0000 7f3878cf1640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387415e2b0 con 0x7f38740b2dd0 2023-10-16T08:53:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.284+0000 7f3872ffd640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f387406dc20 0x7f38740ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:35850/0 (socket says 172.21.15.94:35850) 2023-10-16T08:53:16.286 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.284+0000 7f3872ffd640 1 -- 172.21.15.94:0/2732656290 learned_addr learned my addr 172.21.15.94:0/2732656290 (peer_addr_for_me v1:172.21.15.94:0/0) 2023-10-16T08:53:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.284+0000 7f38737fe640 1 --2- 172.21.15.94:0/2732656290 >> v2:172.21.15.130:3300/0 conn(0x7f38740b2dd0 0x7f387406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.289 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.284+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994096848 0 0) 0x7f387415f0d0 con 0x7f387406dc20 2023-10-16T08:53:16.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.284+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f385c003520 con 0x7f387406dc20 2023-10-16T08:53:16.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187908985 0 0) 0x7f385c003520 con 0x7f387406dc20 2023-10-16T08:53:16.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 >> v2:172.21.15.130:3300/0 conn(0x7f38740b2dd0 msgr2=0x7f387406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.290 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 --2- 172.21.15.94:0/2732656290 >> v2:172.21.15.130:3300/0 conn(0x7f38740b2dd0 0x7f387406d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 >> v1:172.21.15.130:6789/0 conn(0x7f38740ced10 legacy=0x7f38740ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387406d3a0 con 0x7f387406dc20 2023-10-16T08:53:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1419396948 0 0) 0x7f3868001670 con 0x7f387406dc20 2023-10-16T08:53:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 >> v1:172.21.15.94:6789/0 conn(0x7f387406dc20 legacy=0x7f38740ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.291 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f385c0039c0 0x7f385c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f385c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c005180 0x7f385c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387415e2b0 con 0x7f385c0047c0 2023-10-16T08:53:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c00c080 con 0x7f385c005180 2023-10-16T08:53:16.292 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c00c240 con 0x7f385c0039c0 2023-10-16T08:53:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f3872ffd640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f385c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.285+0000 7f3872ffd640 1 -- 172.21.15.94:0/2732656290 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f385c0039c0 msgr2=0x7f385c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.286+0000 7f3872ffd640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f385c0039c0 0x7f385c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.286+0000 7f3872ffd640 1 -- 172.21.15.94:0/2732656290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c005180 msgr2=0x7f385c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.293 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.286+0000 7f3872ffd640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c005180 0x7f385c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.286+0000 7f3872ffd640 1 -- 172.21.15.94:0/2732656290 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c003520 con 0x7f385c0047c0 2023-10-16T08:53:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.286+0000 7f3873fff640 1 -- 172.21.15.94:0/2732656290 reap_dead start 2023-10-16T08:53:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f3872ffd640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f385c004c40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3868007fb0 tx=0x7f385c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daf5a766ffc8282 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868005ad0 con 0x7f385c0047c0 2023-10-16T08:53:16.294 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868005c50 con 0x7f385c0047c0 2023-10-16T08:53:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f38727fc640 1 -- 172.21.15.94:0/2732656290 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386802c7a0 con 0x7f385c0047c0 2023-10-16T08:53:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f3878cf1640 1 -- 172.21.15.94:0/2732656290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 msgr2=0x7f385c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f3878cf1640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f385c004c40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3868007fb0 tx=0x7f385c0057f0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f3878cf1640 1 -- 172.21.15.94:0/2732656290 shutdown_connections 2023-10-16T08:53:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f3878cf1640 1 --2- 172.21.15.94:0/2732656290 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f385c004c40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.287+0000 7f3878cf1640 1 -- 172.21.15.94:0/2732656290 >> 172.21.15.94:0/2732656290 conn(0x7f3874069fc0 msgr2=0x7f387406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.288+0000 7f3878cf1640 1 -- 172.21.15.94:0/2732656290 shutdown_connections 2023-10-16T08:53:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.288+0000 7f3878cf1640 1 -- 172.21.15.94:0/2732656290 wait complete. 2023-10-16T08:53:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.289+0000 7f3878cf1640 1 Processor -- start 2023-10-16T08:53:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.289+0000 7f3878cf1640 1 -- start start 2023-10-16T08:53:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.290+0000 7f3878cf1640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f38741f1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.290+0000 7f3878cf1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f387415ace0 0x7f38741f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.290+0000 7f3878cf1640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f38740c4090 0x7f3874156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.290+0000 7f3878cf1640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741f1990 con 0x7f385c0047c0 2023-10-16T08:53:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.290+0000 7f3878cf1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741f1290 con 0x7f387415ace0 2023-10-16T08:53:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.290+0000 7f3878cf1640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387415b170 con 0x7f38740c4090 2023-10-16T08:53:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f38741f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f38741f1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39592/0 (socket says 172.21.15.94:39592) 2023-10-16T08:53:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 -- 172.21.15.94:0/4075238774 learned_addr learned my addr 172.21.15.94:0/4075238774 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 -- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f38740c4090 msgr2=0x7f3874156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f3873fff640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f38740c4090 0x7f3874156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f3872ffd640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f387415ace0 0x7f38741f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f38740c4090 0x7f3874156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 -- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f387415ace0 msgr2=0x7f38741f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f387415ace0 0x7f38741f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 -- 172.21.15.94:0/4075238774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387415b450 con 0x7f385c0047c0 2023-10-16T08:53:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.291+0000 7f38737fe640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f38741f1450 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f386400e6c0 tx=0x7f386400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.292+0000 7f385bfff640 1 -- 172.21.15.94:0/4075238774 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400c6d0 con 0x7f385c0047c0 2023-10-16T08:53:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.292+0000 7f385bfff640 1 -- 172.21.15.94:0/4075238774 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386400c830 con 0x7f385c0047c0 2023-10-16T08:53:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.292+0000 7f385bfff640 1 -- 172.21.15.94:0/4075238774 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400cbc0 con 0x7f385c0047c0 2023-10-16T08:53:16.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.292+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387415b730 con 0x7f385c0047c0 2023-10-16T08:53:16.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.292+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387415bcf0 con 0x7f385c0047c0 2023-10-16T08:53:16.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.294+0000 7f385bfff640 1 -- 172.21.15.94:0/4075238774 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f386400cd20 con 0x7f385c0047c0 2023-10-16T08:53:16.305 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.295+0000 7f385bfff640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f386006ae70 0x7f386006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.295+0000 7f385bfff640 1 -- 172.21.15.94:0/4075238774 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3864089af0 con 0x7f385c0047c0 2023-10-16T08:53:16.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.295+0000 7f3872ffd640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f386006ae70 0x7f386006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.296+0000 7f387cbbd740 1 Processor -- start 2023-10-16T08:53:16.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.296+0000 7f3872ffd640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f386006ae70 0x7f386006d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3868034000 tx=0x7f3868009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.306 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.296+0000 7f387cbbd740 1 -- start start 2023-10-16T08:53:16.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db662480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f960 0x55b0db692310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db6629c0 0x55b0db692850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f387cbbd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db57e7a0 con 0x55b0db68f580 2023-10-16T08:53:16.307 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db5d0740 con 0x55b0db68f960 2023-10-16T08:53:16.308 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0db5cde30 con 0x55b0db6629c0 2023-10-16T08:53:16.308 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db662480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.308 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db662480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39602/0 (socket says 172.21.15.94:39602) 2023-10-16T08:53:16.308 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.297+0000 7f38737fe640 1 -- 172.21.15.94:0/441461086 learned_addr learned my addr 172.21.15.94:0/441461086 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.308 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38737fe640 1 -- 172.21.15.94:0/441461086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db6629c0 msgr2=0x55b0db692850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38737fe640 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db6629c0 0x55b0db692850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38737fe640 1 -- 172.21.15.94:0/441461086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f960 msgr2=0x55b0db692310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38737fe640 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f960 0x55b0db692310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38737fe640 1 -- 172.21.15.94:0/441461086 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0db58d910 con 0x55b0db68f580 2023-10-16T08:53:16.309 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38737fe640 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db662480 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3864004770 tx=0x7f38640587c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0c57738053cf8c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38597fa640 1 -- 172.21.15.94:0/441461086 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864056aa0 con 0x55b0db68f580 2023-10-16T08:53:16.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38597fa640 1 -- 172.21.15.94:0/441461086 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864054e10 con 0x55b0db68f580 2023-10-16T08:53:16.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.298+0000 7f38597fa640 1 -- 172.21.15.94:0/441461086 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864060790 con 0x55b0db68f580 2023-10-16T08:53:16.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 -- 172.21.15.94:0/441461086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 msgr2=0x55b0db662480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.314 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db662480 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3864004770 tx=0x7f38640587c0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 -- 172.21.15.94:0/441461086 shutdown_connections 2023-10-16T08:53:16.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db6629c0 0x55b0db692850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.315 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f960 0x55b0db692310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 --2- 172.21.15.94:0/441461086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db662480 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 -- 172.21.15.94:0/441461086 >> 172.21.15.94:0/441461086 conn(0x55b0db664790 msgr2=0x55b0db6ad310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 -- 172.21.15.94:0/441461086 shutdown_connections 2023-10-16T08:53:16.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.299+0000 7f387cbbd740 1 -- 172.21.15.94:0/441461086 wait complete. 2023-10-16T08:53:16.316 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.300+0000 7f387cbbd740 1 -- start start 2023-10-16T08:53:16.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.300+0000 7f387cbbd740 1 Processor -- start 2023-10-16T08:53:16.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db67d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 0x55b0db6a4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db67efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.317 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db5c9720 con 0x55b0db68f580 2023-10-16T08:53:16.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db567970 con 0x55b0db695530 2023-10-16T08:53:16.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0db567610 con 0x55b0db68f960 2023-10-16T08:53:16.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f387cbbd740 10 client.0 _ll_register_callbacks cb 0x55b0db5899d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T08:53:16.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db67d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.318 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db67d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39610/0 (socket says 172.21.15.94:39610) 2023-10-16T08:53:16.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 -- 172.21.15.94:0/1218795872 learned_addr learned my addr 172.21.15.94:0/1218795872 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f3873fff640 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db67efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 -- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 msgr2=0x55b0db6a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.319 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 0x55b0db6a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 -- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 msgr2=0x55b0db67efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db67efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.302+0000 7f38737fe640 1 -- 172.21.15.94:0/1218795872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387415bcf0 con 0x55b0db68f580 2023-10-16T08:53:16.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38737fe640 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db67d290 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f386400cfd0 tx=0x7f38640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280a293b4609c86c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.320 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38527fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-10-16T08:53:16.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38527fc640 1 -- 172.21.15.94:0/1218795872 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864060770 con 0x55b0db68f580 2023-10-16T08:53:16.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38527fc640 1 -- 172.21.15.94:0/1218795872 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f38640544f0 con 0x55b0db68f580 2023-10-16T08:53:16.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0db5f0160 con 0x55b0db68f580 2023-10-16T08:53:16.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38527fc640 1 -- 172.21.15.94:0/1218795872 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38640546b0 con 0x55b0db68f580 2023-10-16T08:53:16.321 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 10 client.5718 fetch_fsmap learned FSMap version 15 2023-10-16T08:53:16.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b0db5c7da0 con 0x55b0db68f580 2023-10-16T08:53:16.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38527fc640 1 -- 172.21.15.94:0/1218795872 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0db5f0160 con 0x55b0db68f580 2023-10-16T08:53:16.322 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f38527fc640 1 -- 172.21.15.94:0/1218795872 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 15) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f3864011070 con 0x55b0db68f580 2023-10-16T08:53:16.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 10 client.5718 fetch_fsmap finished waiting for FSMap version 15 2023-10-16T08:53:16.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 10 client.5718 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T08:53:16.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 20 client.5718 populate_metadata read hostname 'smithi094' 2023-10-16T08:53:16.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.303+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6a7e10 0x55b0db67f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.323 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.304+0000 7f387cbbd740 4 client.5718 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T08:53:16.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.304+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 --> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0db59bcc0 con 0x55b0db6a7e10 2023-10-16T08:53:16.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.304+0000 7f3872ffd640 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6a7e10 0x55b0db67f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.304+0000 7f38527fc640 10 client.5718 ms_handle_connect on v2:172.21.15.94:6835/129304957 2023-10-16T08:53:16.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.304+0000 7f3872ffd640 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6a7e10 0x55b0db67f9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5132e1fc831c7f server_cookie=155fbdba2bc39efd in_seq=0 out_seq=0 2023-10-16T08:53:16.324 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.305+0000 7f38527fc640 1 -- 172.21.15.94:0/1218795872 <== mds.0 v2:172.21.15.94:6835/129304957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0db59bcc0 con 0x55b0db6a7e10 2023-10-16T08:53:16.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.305+0000 7f38527fc640 10 client.5718 handle_command_reply: tid=0 2023-10-16T08:53:16.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.305+0000 7f387cbbd740 1 client.5718 shutdown 2023-10-16T08:53:16.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.305+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 msgr2=0x55b0db67d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.305+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db67d290 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f386400cfd0 tx=0x7f38640046c0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.325 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 shutdown_connections 2023-10-16T08:53:16.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6a7e10 0x55b0db67f9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db67efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 0x55b0db6a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.326 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f38527fc640 0 client.5718 ms_handle_reset on v2:172.21.15.94:6835/129304957 2023-10-16T08:53:16.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1218795872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db67d290 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 >> 172.21.15.94:0/1218795872 conn(0x55b0db6629c0 msgr2=0x55b0db6a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 shutdown_connections 2023-10-16T08:53:16.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 1 -- 172.21.15.94:0/1218795872 wait complete. 2023-10-16T08:53:16.327 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.306+0000 7f387cbbd740 20 client.5718 trim_cache size 0 max 16384 2023-10-16T08:53:16.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.322+0000 7f387cbbd740 1 Processor -- start 2023-10-16T08:53:16.333 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.322+0000 7f387cbbd740 1 -- start start 2023-10-16T08:53:16.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.323+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db6b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.323+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 0x55b0db6ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.323+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db6adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.334 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.323+0000 7f387cbbd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db32df20 con 0x55b0db68f580 2023-10-16T08:53:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.323+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db6598a0 con 0x55b0db695530 2023-10-16T08:53:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.323+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0db67dac0 con 0x55b0db68f960 2023-10-16T08:53:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db6b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db6b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39616/0 (socket says 172.21.15.94:39616) 2023-10-16T08:53:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 -- 172.21.15.94:0/1227488329 learned_addr learned my addr 172.21.15.94:0/1227488329 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 -- 172.21.15.94:0/1227488329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 msgr2=0x55b0db6ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 0x55b0db6ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 -- 172.21.15.94:0/1227488329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 msgr2=0x55b0db6adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db6adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.336 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 -- 172.21.15.94:0/1227488329 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0db566b80 con 0x55b0db68f580 2023-10-16T08:53:16.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f38737fe640 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db6b0820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f3864082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb627e8511396ed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f3859ffb640 1 -- 172.21.15.94:0/1227488329 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864060770 con 0x55b0db68f580 2023-10-16T08:53:16.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f3859ffb640 1 -- 172.21.15.94:0/1227488329 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864054a40 con 0x55b0db68f580 2023-10-16T08:53:16.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.324+0000 7f3859ffb640 1 -- 172.21.15.94:0/1227488329 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640579c0 con 0x55b0db68f580 2023-10-16T08:53:16.337 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 -- 172.21.15.94:0/1227488329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 msgr2=0x55b0db6b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db6b0820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f3864082000 comp rx=0 tx=0).stop 2023-10-16T08:53:16.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 -- 172.21.15.94:0/1227488329 shutdown_connections 2023-10-16T08:53:16.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db695530 0x55b0db6adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.338 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db68f960 0x55b0db6ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1227488329 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f580 0x55b0db6b0820 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 -- 172.21.15.94:0/1227488329 >> 172.21.15.94:0/1227488329 conn(0x55b0db6629c0 msgr2=0x55b0db6b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 -- 172.21.15.94:0/1227488329 shutdown_connections 2023-10-16T08:53:16.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.325+0000 7f387cbbd740 1 -- 172.21.15.94:0/1227488329 wait complete. 2023-10-16T08:53:16.339 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.326+0000 7f387cbbd740 1 -- start start 2023-10-16T08:53:16.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.326+0000 7f387cbbd740 1 Processor -- start 2023-10-16T08:53:16.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f580 0x55b0db695a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 0x55b0db714060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db695530 0x55b0db6aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.340 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db7145a0 con 0x55b0db68f960 2023-10-16T08:53:16.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0db668110 con 0x55b0db68f580 2023-10-16T08:53:16.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0db6ae7e0 con 0x55b0db695530 2023-10-16T08:53:16.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f387cbbd740 10 client.0 _ll_register_callbacks cb 0x7f3864070070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T08:53:16.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 0x55b0db714060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 0x55b0db714060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39630/0 (socket says 172.21.15.94:39630) 2023-10-16T08:53:16.341 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.327+0000 7f3872ffd640 1 -- 172.21.15.94:0/1746929218 learned_addr learned my addr 172.21.15.94:0/1746929218 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f38737fe640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f580 0x55b0db695a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f3872ffd640 1 -- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db695530 msgr2=0x55b0db6aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f3872ffd640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db695530 0x55b0db6aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.342 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f3872ffd640 1 -- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f580 msgr2=0x55b0db695a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f3872ffd640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f580 0x55b0db695a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f3872ffd640 1 -- 172.21.15.94:0/1746929218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0db5c7da0 con 0x55b0db68f960 2023-10-16T08:53:16.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f38737fe640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f580 0x55b0db695a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:16.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f3872ffd640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 0x55b0db714060 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f386800c1d0 tx=0x7f386804fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574c0d5da6d45751 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.343 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f38527fc640 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2023-10-16T08:53:16.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f38527fc640 1 -- 172.21.15.94:0/1746929218 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386803c040 con 0x55b0db68f960 2023-10-16T08:53:16.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f38527fc640 1 -- 172.21.15.94:0/1746929218 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3868054030 con 0x55b0db68f960 2023-10-16T08:53:16.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.328+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3864054e10 con 0x55b0db68f960 2023-10-16T08:53:16.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f38527fc640 1 -- 172.21.15.94:0/1746929218 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f386804f260 con 0x55b0db68f960 2023-10-16T08:53:16.344 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 10 client.5724 fetch_fsmap learned FSMap version 15 2023-10-16T08:53:16.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b0db58c170 con 0x55b0db68f960 2023-10-16T08:53:16.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f38527fc640 1 -- 172.21.15.94:0/1746929218 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864054e10 con 0x55b0db68f960 2023-10-16T08:53:16.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f38527fc640 1 -- 172.21.15.94:0/1746929218 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 15) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f386804c040 con 0x55b0db68f960 2023-10-16T08:53:16.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 10 client.5724 fetch_fsmap finished waiting for FSMap version 15 2023-10-16T08:53:16.345 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 10 client.5724 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T08:53:16.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 20 client.5724 populate_metadata read hostname 'smithi094' 2023-10-16T08:53:16.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6bf7e0 0x55b0db6bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 4 client.5724 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T08:53:16.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 --> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b0db5c2700 con 0x55b0db6bf7e0 2023-10-16T08:53:16.346 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.329+0000 7f38737fe640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6bf7e0 0x55b0db6bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f38737fe640 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6bf7e0 0x55b0db6bfbc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e50710dcd1af724c server_cookie=8274f1890d693df6 in_seq=0 out_seq=0 2023-10-16T08:53:16.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f38527fc640 10 client.5724 ms_handle_connect on v2:172.21.15.94:6835/129304957 2023-10-16T08:53:16.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f38527fc640 1 -- 172.21.15.94:0/1746929218 <== mds.0 v2:172.21.15.94:6835/129304957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55b0db5c2700 con 0x55b0db6bf7e0 2023-10-16T08:53:16.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f38527fc640 10 client.5724 handle_command_reply: tid=0 2023-10-16T08:53:16.347 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 client.5724 shutdown 2023-10-16T08:53:16.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 msgr2=0x55b0db714060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 0x55b0db714060 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f386800c1d0 tx=0x7f386804fdd0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 shutdown_connections 2023-10-16T08:53:16.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:6835/129304957,v1:172.21.15.94:6837/129304957] conn(0x55b0db6bf7e0 0x55b0db6bfbc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.348 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55b0db695530 0x55b0db6aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55b0db68f960 0x55b0db714060 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 --2- 172.21.15.94:0/1746929218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b0db68f580 0x55b0db695a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 >> 172.21.15.94:0/1746929218 conn(0x55b0db6629c0 msgr2=0x55b0db666470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.330+0000 7f38527fc640 0 client.5724 ms_handle_reset on v2:172.21.15.94:6835/129304957 2023-10-16T08:53:16.349 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 shutdown_connections 2023-10-16T08:53:16.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f387cbbd740 1 -- 172.21.15.94:0/1746929218 wait complete. 2023-10-16T08:53:16.350 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f387cbbd740 20 client.5724 trim_cache size 0 max 16384 2023-10-16T08:53:16.350 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:53:16.350 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "d7b7598f-7f16-4780-92e5-7e8a731f0195", 2023-10-16T08:53:16.351 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2023-10-16T08:53:16.351 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5535, 2023-10-16T08:53:16.351 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2023-10-16T08:53:16.351 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2023-10-16T08:53:16.351 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "testcephfs1", 2023-10-16T08:53:16.352 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 7.0189334209999998, 2023-10-16T08:53:16.352 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 15, 2023-10-16T08:53:16.352 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 41, 2023-10-16T08:53:16.352 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 41, 2023-10-16T08:53:16.352 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 15.887959498000001 2023-10-16T08:53:16.353 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:53:16.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f386006ae70 msgr2=0x7f386006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f386006ae70 0x7f386006d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3868034000 tx=0x7f3868009030 comp rx=0 tx=0).stop 2023-10-16T08:53:16.354 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 msgr2=0x7f38741f1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f38741f1450 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f386400e6c0 tx=0x7f386400eb80 comp rx=0 tx=0).stop 2023-10-16T08:53:16.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 shutdown_connections 2023-10-16T08:53:16.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f38740c4090 0x7f3874156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.355 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f386006ae70 0x7f386006d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f387415ace0 0x7f38741f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 --2- 172.21.15.94:0/4075238774 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f385c0047c0 0x7f38741f1450 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 >> 172.21.15.94:0/4075238774 conn(0x7f3874069fc0 msgr2=0x7f387415a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.331+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 shutdown_connections 2023-10-16T08:53:16.356 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.332+0000 7f3878cf1640 1 -- 172.21.15.94:0/4075238774 wait complete. 2023-10-16T08:53:16.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T08:53:16.565 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.563+0000 7f6cb6e39640 1 Processor -- start 2023-10-16T08:53:16.566 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.563+0000 7f6cb6e39640 1 -- start start 2023-10-16T08:53:16.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6cb6e39640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6cb015ad00 0x7f6cb00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.567 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6cb6e39640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6cb6e39640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00707f0 con 0x7f6cb00b0010 2023-10-16T08:53:16.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6cb6e39640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb0070ad0 con 0x7f6cb015ad00 2023-10-16T08:53:16.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6cb6e39640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb015b1d0 con 0x7f6cb015f040 2023-10-16T08:53:16.568 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6cb015ad00 0x7f6cb00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6cb015ad00 0x7f6cb00701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39632/0 (socket says 172.21.15.94:39632) 2023-10-16T08:53:16.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 -- 172.21.15.94:0/1589898495 learned_addr learned my addr 172.21.15.94:0/1589898495 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 -- 172.21.15.94:0/1589898495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 msgr2=0x7f6cb015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 --2- 172.21.15.94:0/1589898495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.569 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 -- 172.21.15.94:0/1589898495 >> v1:172.21.15.130:6789/0 conn(0x7f6cb00b0010 legacy=0x7f6cb00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:16.570 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.565+0000 7f6caffff640 1 -- 172.21.15.94:0/1589898495 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb015b4b0 con 0x7f6cb015ad00 2023-10-16T08:53:16.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.566+0000 7f6caffff640 1 --2- 172.21.15.94:0/1589898495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb015ad00 0x7f6cb00701a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009870 tx=0x7f6c9c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e47afe5cfbce161 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.571 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6caf7fe640 1 -- 172.21.15.94:0/1589898495 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c031640 con 0x7f6cb015ad00 2023-10-16T08:53:16.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6caf7fe640 1 -- 172.21.15.94:0/1589898495 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c0317a0 con 0x7f6cb015ad00 2023-10-16T08:53:16.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6caf7fe640 1 -- 172.21.15.94:0/1589898495 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c031b30 con 0x7f6cb015ad00 2023-10-16T08:53:16.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1589898495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb015ad00 msgr2=0x7f6cb00701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1589898495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb015ad00 0x7f6cb00701a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009870 tx=0x7f6c9c02b8f0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.572 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1589898495 shutdown_connections 2023-10-16T08:53:16.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1589898495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1589898495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb015ad00 0x7f6cb00701a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1589898495 >> 172.21.15.94:0/1589898495 conn(0x7f6cb006c1c0 msgr2=0x7f6cb006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.567+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1589898495 shutdown_connections 2023-10-16T08:53:16.573 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.568+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1589898495 wait complete. 2023-10-16T08:53:16.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.569+0000 7f6cb6e39640 1 Processor -- start 2023-10-16T08:53:16.574 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.569+0000 7f6cb6e39640 1 -- start start 2023-10-16T08:53:16.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb6e39640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 0x7f6cb00c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb6e39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cb015ad00 0x7f6cb01f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.576 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb6e39640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb01462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb6e39640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00c4b80 con 0x7f6cb00b0010 2023-10-16T08:53:16.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb6e39640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00c3f00 con 0x7f6cb015ad00 2023-10-16T08:53:16.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb6e39640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00c41e0 con 0x7f6cb015f040 2023-10-16T08:53:16.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.570+0000 7f6cb4bd5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 0x7f6cb00c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 0x7f6cb00c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39644/0 (socket says 172.21.15.94:39644) 2023-10-16T08:53:16.577 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 -- 172.21.15.94:0/1892751424 learned_addr learned my addr 172.21.15.94:0/1892751424 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:16.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6caffff640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cb015ad00 0x7f6cb01f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb53d6640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb01462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 -- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 msgr2=0x7f6cb01462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.578 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb01462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 -- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cb015ad00 msgr2=0x7f6cb01f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cb015ad00 0x7f6cb01f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 -- 172.21.15.94:0/1892751424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0094d0 con 0x7f6cb00b0010 2023-10-16T08:53:16.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6caffff640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cb015ad00 0x7f6cb01f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T08:53:16.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cb4bd5640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 0x7f6cb00c20c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c430 tx=0x7f6ca400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.579 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4011790 con 0x7f6cb00b0010 2023-10-16T08:53:16.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.571+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40118f0 con 0x7f6cb00b0010 2023-10-16T08:53:16.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.572+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb00c44c0 con 0x7f6cb00b0010 2023-10-16T08:53:16.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.572+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4011ce0 con 0x7f6cb00b0010 2023-10-16T08:53:16.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.572+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb00c2600 con 0x7f6cb00b0010 2023-10-16T08:53:16.580 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.573+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb00c4cc0 con 0x7f6cb00b0010 2023-10-16T08:53:16.581 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.574+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ca401c460 con 0x7f6cb00b0010 2023-10-16T08:53:16.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.575+0000 7f6cad7fa640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6c9406ae70 0x7f6c9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:16.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.575+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6ca40896a0 con 0x7f6cb00b0010 2023-10-16T08:53:16.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.576+0000 7f6caffff640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6c9406ae70 0x7f6c9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:16.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.576+0000 7f6caffff640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6c9406ae70 0x7f6c9406d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c036000 tx=0x7f6c9c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:16.582 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.580+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ca4054680 con 0x7f6cb00b0010 2023-10-16T08:53:16.809 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.807+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6cb0073ef0 con 0x7f6cb00b0010 2023-10-16T08:53:16.810 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.808+0000 7f6cad7fa640 1 -- 172.21.15.94:0/1892751424 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6ca4057ca0 con 0x7f6cb00b0010 2023-10-16T08:53:16.810 INFO:teuthology.orchestra.run.smithi094.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-16T08:53:16.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6c9406ae70 msgr2=0x7f6c9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6c9406ae70 0x7f6c9406d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c036000 tx=0x7f6c9c03c040 comp rx=0 tx=0).stop 2023-10-16T08:53:16.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 msgr2=0x7f6cb00c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:16.813 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 0x7f6cb00c20c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c430 tx=0x7f6ca400c8f0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 shutdown_connections 2023-10-16T08:53:16.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6cb015f040 0x7f6cb01462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7f6c9406ae70 0x7f6c9406d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6cb015ad00 0x7f6cb01f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.814 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 --2- 172.21.15.94:0/1892751424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cb00b0010 0x7f6cb00c20c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:16.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 >> 172.21.15.94:0/1892751424 conn(0x7f6cb006c1c0 msgr2=0x7f6cb00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:16.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 shutdown_connections 2023-10-16T08:53:16.815 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:16.811+0000 7f6cb6e39640 1 -- 172.21.15.94:0/1892751424 wait complete. 2023-10-16T08:53:16.831 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T08:53:16.832 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T08:53:16.832 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2023-10-16T08:53:16.833 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T08:53:16.833 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T08:53:16.833 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T08:53:16.834 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T08:53:16.834 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T08:53:16.834 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T08:53:16.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:16.835 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2023-10-16T08:53:16.886 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T08:53:16.887 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T08:53:16.887 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T08:53:16.887 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.887 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-16T08:53:16.887 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.888 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:53:16.888 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2023-10-16T08:53:16.888 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2023-10-16T08:53:16.888 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:53:16.889 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2023-10-16T08:53:16.889 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2023-10-16T08:53:16.889 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T08:53:16.889 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:53:16.889 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T08:53:16.890 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:53:16.890 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T08:53:16.890 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-10-16T08:53:16.890 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2023-10-16T08:53:16.891 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.891 INFO:teuthology.orchestra.run.smithi094.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T08:53:16.891 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether b2:51:b1:f7:17:77 brd ff:ff:ff:ff:ff:ff 2023-10-16T08:53:16.891 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T08:53:16.891 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.892 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::a044:9dff:fecb:5544/64 scope link 2023-10-16T08:53:16.892 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.892 INFO:teuthology.orchestra.run.smithi094.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T08:53:16.892 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether f6:a7:fe:81:04:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:53:16.893 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::f4a7:feff:fe81:460/64 scope link 2023-10-16T08:53:16.893 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.893 INFO:teuthology.orchestra.run.smithi094.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T08:53:16.893 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether b2:51:b1:f7:17:77 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:53:16.893 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::b051:b1ff:fef7:1777/64 scope link 2023-10-16T08:53:16.894 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-16T08:53:16.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:16.895 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T08:53:16.986 INFO:teuthology.orchestra.run.smithi094.stdout:1 2023-10-16T08:53:16.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:16.991 DEBUG:teuthology.orchestra.run.smithi094:> route 2023-10-16T08:53:17.044 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2023-10-16T08:53:17.044 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T08:53:17.044 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T08:53:17.045 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T08:53:17.045 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T08:53:17.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:17.046 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-16T08:53:17.046 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-16T08:53:17.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T08:53:17.047 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T08:53:17.048 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T08:53:17.048 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-16T08:53:17.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:17.237 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-16T08:53:17.290 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T08:53:17.290 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T08:53:17.291 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T08:53:17.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:17.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2023-10-16T08:53:17.387 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-16T08:53:17.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:53:17.389 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T08:53:17.445 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T08:53:17.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T08:53:17.446 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T08:53:17.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:53:17.603 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:53:17.662 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:53:17.663 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:53:17.663 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:53:17.663 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:53:17.663 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:53:17.664 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:53:17.664 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:53:17.664 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:53:17.664 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:53:17.664 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:53:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:53:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:53:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:53:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:53:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:53:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:53:17.666 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:53:17.666 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:53:17.666 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:53:17.666 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:53:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:53:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:53:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:53:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:53:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:53:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:53:17.668 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:53:17.668 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:53:17.668 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:53:17.668 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:53:17.668 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:53:17.669 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:53:17.669 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:53:17.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:17.670 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:53:17.727 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T08:53:17.728 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-16T08:53:17.734 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-16T08:53:17.813 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T08:53:17.859 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-16T08:53:17.860 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-16T08:53:17.860 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-16T08:53:17.860 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-16T08:53:17.860 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-16T08:53:17.861 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-16T08:53:17.861 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-16T08:53:17.861 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-16T08:53:17.861 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-16T08:53:17.861 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-16T08:53:17.862 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-16T08:53:17.862 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T08:53:17.862 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-16T08:53:17.862 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-16T08:53:17.862 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-16T08:53:17.863 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-16T08:53:17.863 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-16T08:53:17.863 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T08:53:17.863 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-16T08:53:17.863 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T08:53:17.864 INFO:teuthology.orchestra.run.smithi094.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T08:53:17.864 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T08:53:17.864 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-16T08:53:17.864 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-16T08:53:17.864 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T08:53:17.864 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T08:53:17.865 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T08:53:17.865 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T08:53:17.865 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-16T08:53:17.865 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:53:17.865 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T08:53:17.866 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:53:17.866 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T08:53:17.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:17.867 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-16T08:53:17.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2023-10-16T08:53:17.927+0000 7fbce1385480 -1 init, newargv = 0x5610f8c978b0 newargc=15 2023-10-16T08:53:17.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[102278]: starting ceph client 2023-10-16T08:53:17.938 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[102278]: starting fuse 2023-10-16T08:53:17.954 INFO:teuthology.orchestra.run.smithi094.stdout:39 2023-10-16T08:53:17.954 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-16T08:53:17.955 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2023-10-16T08:53:17.955 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2023-10-16T08:53:17.956 DEBUG:teuthology.orchestra.run.smithi094:> import re 2023-10-16T08:53:17.956 DEBUG:teuthology.orchestra.run.smithi094:> import os 2023-10-16T08:53:17.956 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2023-10-16T08:53:17.957 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:53:17.957 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2023-10-16T08:53:17.957 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-16T08:53:17.958 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2023-10-16T08:53:17.958 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-16T08:53:17.959 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:53:17.959 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2023-10-16T08:53:17.959 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2023-10-16T08:53:17.960 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2023-10-16T08:53:17.960 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2023-10-16T08:53:17.960 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:53:17.961 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2023-10-16T08:53:17.961 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T08:53:17.961 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T08:53:17.962 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T08:53:17.962 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2023-10-16T08:53:17.963 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2023-10-16T08:53:17.963 DEBUG:teuthology.orchestra.run.smithi094:> return f 2023-10-16T08:53:17.963 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T08:53:17.964 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-16T08:53:17.964 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2023-10-16T08:53:17.964 DEBUG:teuthology.orchestra.run.smithi094:> ' 2023-10-16T08:53:18.156 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.102278.asok 2023-10-16T08:53:18.160 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T08:53:18.173 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.102278.asok 2023-10-16T08:53:18.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:18.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.102278.asok status 2023-10-16T08:53:18.414 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-16T08:53:18.415 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2023-10-16T08:53:18.415 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T08:53:18.415 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T08:53:18.415 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2023-10-16T08:53:18.415 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2023-10-16T08:53:18.416 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-16T08:53:18.416 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "102278", 2023-10-16T08:53:18.416 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2023-10-16T08:53:18.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:18.416 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2023-10-16T08:53:18.417 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2023-10-16T08:53:18.417 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 5736, 2023-10-16T08:53:18.417 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2023-10-16T08:53:18.417 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2023-10-16T08:53:18.417 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2023-10-16T08:53:18.417 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 5736 2023-10-16T08:53:18.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:18.418 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:53:18.418 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:53:18.418 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:53:18.418 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1521420212 2023-10-16T08:53:18.419 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-16T08:53:18.419 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:18.419 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-16T08:53:18.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-16T08:53:18.419 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "192.168.0.1:0", 2023-10-16T08:53:18.420 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1521420212 2023-10-16T08:53:18.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-16T08:53:18.420 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.5736 192.168.0.1:0/1521420212", 2023-10-16T08:53:18.420 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "192.168.0.1:0/1521420212", 2023-10-16T08:53:18.420 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2023-10-16T08:53:18.421 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 15, 2023-10-16T08:53:18.421 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 41, 2023-10-16T08:53:18.421 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2023-10-16T08:53:18.421 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2023-10-16T08:53:18.421 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "testcephfs1" 2023-10-16T08:53:18.421 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-16T08:53:18.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:18.429 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2023-10-16T08:53:18.429 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-16T08:53:18.484 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2023-10-16T08:53:18.485 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-16T08:53:18.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:18.486 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T08:53:18.582 DEBUG:teuthology.orchestra.run.smithi094:> mktemp -d --suffix=xfstests-dev 2023-10-16T08:53:18.637 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.tcp0mkZMHZxfstests-dev 2023-10-16T08:53:18.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:18.638 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.tcp0mkZMHZxfstests-dev) 2023-10-16T08:53:18.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:18.733 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.tcp0mkZMHZxfstests-dev) 2023-10-16T08:53:18.794 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/tmp/tmp.tcp0mkZMHZxfstests-dev'... 2023-10-16T08:53:19.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:19.797 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-16T08:53:19.867 DEBUG:teuthology.orchestra.run.smithi094:> mktemp -d --suffix=test 2023-10-16T08:53:19.923 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.VH3pOVWuu6test 2023-10-16T08:53:19.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:53:19.924 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-16T08:53:19.983 DEBUG:teuthology.orchestra.run.smithi094:> mktemp -d --suffix=scratch 2023-10-16T08:53:20.036 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.52chpTxwVbscratch 2023-10-16T08:53:20.037 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-10-16T08:53:20.037 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-10-16T08:53:20.880 INFO:teuthology.orchestra.run.smithi094.stdout:Last metadata expiration check: 0:04:47 ago on Mon 16 Oct 2023 08:48:33 AM UTC. 2023-10-16T08:53:20.976 INFO:teuthology.orchestra.run.smithi094.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-10-16T08:53:20.977 INFO:teuthology.orchestra.run.smithi094.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T08:53:20.978 INFO:teuthology.orchestra.run.smithi094.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-10-16T08:53:20.979 INFO:teuthology.orchestra.run.smithi094.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-10-16T08:53:20.980 INFO:teuthology.orchestra.run.smithi094.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-10-16T08:53:20.982 INFO:teuthology.orchestra.run.smithi094.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-10-16T08:53:20.983 INFO:teuthology.orchestra.run.smithi094.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-10-16T08:53:20.984 INFO:teuthology.orchestra.run.smithi094.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-10-16T08:53:20.986 INFO:teuthology.orchestra.run.smithi094.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-10-16T08:53:20.987 INFO:teuthology.orchestra.run.smithi094.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-10-16T08:53:20.988 INFO:teuthology.orchestra.run.smithi094.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-10-16T08:53:20.989 INFO:teuthology.orchestra.run.smithi094.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-10-16T08:53:20.990 INFO:teuthology.orchestra.run.smithi094.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-10-16T08:53:20.991 INFO:teuthology.orchestra.run.smithi094.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-10-16T08:53:20.992 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-10-16T08:53:20.993 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T08:53:20.995 INFO:teuthology.orchestra.run.smithi094.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-10-16T08:53:20.996 INFO:teuthology.orchestra.run.smithi094.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T08:53:20.997 INFO:teuthology.orchestra.run.smithi094.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-10-16T08:53:20.997 INFO:teuthology.orchestra.run.smithi094.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T08:53:20.999 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T08:53:20.999 INFO:teuthology.orchestra.run.smithi094.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-10-16T08:53:21.004 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T08:53:21.058 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2023-10-16T08:53:21.062 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-16T08:53:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2023-10-16T08:53:21.062 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-16T08:53:21.062 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2023-10-16T08:53:21.062 INFO:teuthology.orchestra.run.smithi094.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-10-16T08:53:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2023-10-16T08:53:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-10-16T08:53:21.063 INFO:teuthology.orchestra.run.smithi094.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-10-16T08:53:21.063 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2023-10-16T08:53:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-10-16T08:53:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-10-16T08:53:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-10-16T08:53:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-10-16T08:53:21.064 INFO:teuthology.orchestra.run.smithi094.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-10-16T08:53:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-10-16T08:53:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-10-16T08:53:21.065 INFO:teuthology.orchestra.run.smithi094.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-10-16T08:53:21.065 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2023-10-16T08:53:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: libnbd x86_64 1.16.0-1.el9 appstream 161 k 2023-10-16T08:53:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-10-16T08:53:21.066 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2023-10-16T08:53:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2023-10-16T08:53:21.066 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2023-10-16T08:53:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2023-10-16T08:53:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2023-10-16T08:53:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2023-10-16T08:53:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2023-10-16T08:53:21.067 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:21.068 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2023-10-16T08:53:21.068 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-16T08:53:21.068 INFO:teuthology.orchestra.run.smithi094.stdout:Install 12 Packages 2023-10-16T08:53:21.068 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 8 Packages 2023-10-16T08:53:21.068 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:21.069 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 66 M 2023-10-16T08:53:21.069 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2023-10-16T08:53:21.636 INFO:teuthology.orchestra.run.smithi094.stdout:(1/20): rmt-1.6-6.el9.x86_64.rpm 243 kB/s | 45 kB 00:00 2023-10-16T08:53:21.736 INFO:teuthology.orchestra.run.smithi094.stdout:(2/20): fio-engine-http-3.35-1.el9.x86_64.rpm 183 kB/s | 18 kB 00:00 2023-10-16T08:53:21.786 INFO:teuthology.orchestra.run.smithi094.stdout:(3/20): sqlite-3.34.1-6.el9.x86_64.rpm 2.2 MB/s | 747 kB 00:00 2023-10-16T08:53:21.820 INFO:teuthology.orchestra.run.smithi094.stdout:(4/20): fio-engine-libaio-3.35-1.el9.x86_64.rpm 193 kB/s | 16 kB 00:00 2023-10-16T08:53:21.887 INFO:teuthology.orchestra.run.smithi094.stdout:(5/20): fio-engine-rados-3.35-1.el9.x86_64.rpm 239 kB/s | 16 kB 00:00 2023-10-16T08:53:21.912 INFO:teuthology.orchestra.run.smithi094.stdout:(6/20): fio-engine-nbd-3.35-1.el9.x86_64.rpm 117 kB/s | 15 kB 00:00 2023-10-16T08:53:22.038 INFO:teuthology.orchestra.run.smithi094.stdout:(7/20): fio-3.35-1.el9.x86_64.rpm 11 MB/s | 6.2 MB 00:00 2023-10-16T08:53:22.063 INFO:teuthology.orchestra.run.smithi094.stdout:(8/20): fio-engine-rbd-3.35-1.el9.x86_64.rpm 93 kB/s | 16 kB 00:00 2023-10-16T08:53:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:(9/20): fio-engine-rdma-3.35-1.el9.x86_64.rpm 118 kB/s | 21 kB 00:00 2023-10-16T08:53:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:(10/20): libnbd-1.16.0-1.el9.x86_64.rpm 1.7 MB/s | 161 kB 00:00 2023-10-16T08:53:22.397 INFO:teuthology.orchestra.run.smithi094.stdout:(11/20): dump-0.4-0.51.b47.el9.x86_64.rpm 264 kB/s | 88 kB 00:00 2023-10-16T08:53:22.573 INFO:teuthology.orchestra.run.smithi094.stdout:(12/20): cpp-11.4.1-2.3.el9.x86_64.rpm 26 MB/s | 11 MB 00:00 2023-10-16T08:53:22.681 INFO:teuthology.orchestra.run.smithi094.stdout:(13/20): indent-2.2.13-4.el9.x86_64.rpm 303 kB/s | 179 kB 00:00 2023-10-16T08:53:22.839 INFO:teuthology.orchestra.run.smithi094.stdout:(14/20): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 317 kB/s | 47 kB 00:00 2023-10-16T08:53:23.249 INFO:teuthology.orchestra.run.smithi094.stdout:(15/20): gcc-11.4.1-2.3.el9.x86_64.rpm 38 MB/s | 32 MB 00:00 2023-10-16T08:53:23.440 INFO:teuthology.orchestra.run.smithi094.stdout:(16/20): libstdc++-devel-11.4.1-2.3.el9.x86_64. 3.7 MB/s | 2.2 MB 00:00 2023-10-16T08:53:23.616 INFO:teuthology.orchestra.run.smithi094.stdout:(17/20): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 13 MB 00:01 2023-10-16T08:53:23.641 INFO:teuthology.orchestra.run.smithi094.stdout:(18/20): libgcc-11.4.1-2.3.el9.x86_64.rpm 242 kB/s | 92 kB 00:00 2023-10-16T08:53:23.675 INFO:teuthology.orchestra.run.smithi094.stdout:(19/20): libgomp-11.4.1-2.3.el9.x86_64.rpm 1.2 MB/s | 268 kB 00:00 2023-10-16T08:53:23.717 INFO:teuthology.orchestra.run.smithi094.stdout:(20/20): libstdc++-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 735 kB 00:00 2023-10-16T08:53:23.720 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2023-10-16T08:53:23.721 INFO:teuthology.orchestra.run.smithi094.stdout:Total 25 MB/s | 66 MB 00:02 2023-10-16T08:53:24.073 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2023-10-16T08:53:24.246 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2023-10-16T08:53:24.246 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2023-10-16T08:53:24.876 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2023-10-16T08:53:24.877 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2023-10-16T08:53:26.311 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2023-10-16T08:53:26.384 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 1/28 2023-10-16T08:53:26.546 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 1/28 2023-10-16T08:53:27.247 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 2/28 2023-10-16T08:53:27.338 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 3/28 2023-10-16T08:53:27.610 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 4/28 2023-10-16T08:53:28.826 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 5/28 2023-10-16T08:53:29.080 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 6/28 2023-10-16T08:53:29.163 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 6/28 2023-10-16T08:53:29.200 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libnbd-1.16.0-1.el9.x86_64 7/28 2023-10-16T08:53:29.233 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 8/28 2023-10-16T08:53:29.268 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 9/28 2023-10-16T08:53:29.302 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 10/28 2023-10-16T08:53:29.356 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 11/28 2023-10-16T08:53:29.394 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 12/28 2023-10-16T08:53:29.649 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 13/28 2023-10-16T08:53:29.690 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fio-3.35-1.el9.x86_64 14/28 2023-10-16T08:53:29.731 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rmt-2:1.6-6.el9.x86_64 15/28 2023-10-16T08:53:30.082 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 16/28 2023-10-16T08:53:30.293 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 17/28 2023-10-16T08:53:30.338 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 18/28 2023-10-16T08:53:30.453 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 18/28 2023-10-16T08:53:30.514 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : indent-2.2.13-4.el9.x86_64 19/28 2023-10-16T08:53:30.544 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 20/28 2023-10-16T08:53:30.575 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 21/28 2023-10-16T08:53:30.576 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 22/28 2023-10-16T08:53:30.719 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 22/28 2023-10-16T08:53:30.778 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 23/28 2023-10-16T08:53:30.826 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 24/28 2023-10-16T08:53:30.881 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 25/28 2023-10-16T08:53:30.920 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 26/28 2023-10-16T08:53:30.921 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 27/28 2023-10-16T08:53:31.081 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 27/28 2023-10-16T08:53:31.194 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 28/28 2023-10-16T08:53:32.430 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:53:32.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:53:33.036 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libgomp-11.4.1-2.1.el9.x86_64 28/28 2023-10-16T08:53:33.036 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 1/28 2023-10-16T08:53:33.036 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 2/28 2023-10-16T08:53:33.037 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-3.35-1.el9.x86_64 3/28 2023-10-16T08:53:33.037 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 4/28 2023-10-16T08:53:33.037 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 5/28 2023-10-16T08:53:33.037 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 6/28 2023-10-16T08:53:33.037 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 7/28 2023-10-16T08:53:33.038 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 8/28 2023-10-16T08:53:33.038 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 9/28 2023-10-16T08:53:33.038 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libnbd-1.16.0-1.el9.x86_64 10/28 2023-10-16T08:53:33.038 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 11/28 2023-10-16T08:53:33.039 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : indent-2.2.13-4.el9.x86_64 12/28 2023-10-16T08:53:33.039 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 13/28 2023-10-16T08:53:33.039 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 14/28 2023-10-16T08:53:33.039 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 15/28 2023-10-16T08:53:33.039 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 16/28 2023-10-16T08:53:33.040 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 17/28 2023-10-16T08:53:33.040 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 18/28 2023-10-16T08:53:33.040 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 19/28 2023-10-16T08:53:33.041 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 20/28 2023-10-16T08:53:33.041 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 21/28 2023-10-16T08:53:33.041 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 22/28 2023-10-16T08:53:33.041 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 23/28 2023-10-16T08:53:33.042 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 24/28 2023-10-16T08:53:33.043 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 25/28 2023-10-16T08:53:33.043 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 26/28 2023-10-16T08:53:33.043 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 27/28 2023-10-16T08:53:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 28/28 2023-10-16T08:53:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:33.655 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2023-10-16T08:53:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: cpp-11.4.1-2.3.el9.x86_64 gcc-11.4.1-2.3.el9.x86_64 2023-10-16T08:53:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-10-16T08:53:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: libgcc-11.4.1-2.3.el9.x86_64 libgomp-11.4.1-2.3.el9.x86_64 2023-10-16T08:53:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: libstdc++-11.4.1-2.3.el9.x86_64 libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-10-16T08:53:33.655 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2023-10-16T08:53:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-10-16T08:53:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-10-16T08:53:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-10-16T08:53:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-10-16T08:53:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: indent-2.2.13-4.el9.x86_64 libnbd-1.16.0-1.el9.x86_64 2023-10-16T08:53:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-10-16T08:53:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:33.657 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2023-10-16T08:53:34.220 DEBUG:teuthology.orchestra.run.smithi094:> sudo useradd -m fsgqa 2023-10-16T08:53:34.315 INFO:teuthology.orchestra.run.smithi094.stderr:useradd: user 'fsgqa' already exists 2023-10-16T08:53:34.320 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-16T08:53:34.320 DEBUG:teuthology.orchestra.run.smithi094:> sudo groupadd fsgqa 2023-10-16T08:53:34.412 INFO:teuthology.orchestra.run.smithi094.stderr:groupadd: group 'fsgqa' already exists 2023-10-16T08:53:34.416 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-16T08:53:34.417 DEBUG:teuthology.orchestra.run.smithi094:> sudo useradd fsgqa2 2023-10-16T08:53:35.411 DEBUG:teuthology.orchestra.run.smithi094:> sudo useradd 123456-fsgqa 2023-10-16T08:53:36.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-16T08:53:36.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.379+0000 7ff6e20d7640 1 Processor -- start 2023-10-16T08:53:36.380 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.379+0000 7ff6e20d7640 1 -- start start 2023-10-16T08:53:36.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.381+0000 7ff6e20d7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6dc0cdd90 0x7ff6dc0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.381+0000 7ff6e20d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cad30 0x7ff6dc0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.381+0000 7ff6e20d7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc0cb720 con 0x7ff6dc15cba0 2023-10-16T08:53:36.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.381+0000 7ff6e20d7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc15d570 con 0x7ff6dc0cdd90 2023-10-16T08:53:36.382 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.381+0000 7ff6e20d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc15cf80 con 0x7ff6dc0cad30 2023-10-16T08:53:36.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.382+0000 7ff6e08d4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6dc0cdd90 0x7ff6dc0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.382+0000 7ff6e18d6640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cad30 0x7ff6dc0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.382+0000 7ff6e08d4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff6dc0cdd90 0x7ff6dc0cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.94:54870/0 (socket says 172.21.15.94:54870) 2023-10-16T08:53:36.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.382+0000 7ff6e08d4640 1 -- 172.21.15.94:0/312442685 learned_addr learned my addr 172.21.15.94:0/312442685 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:36.384 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.382+0000 7ff6e10d5640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff6dc15cba0 0x7ff6dc15da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:54304/0 (socket says 172.21.15.94:54304) 2023-10-16T08:53:36.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.383+0000 7ff6e08d4640 1 -- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cad30 msgr2=0x7ff6dc0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:36.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.383+0000 7ff6e08d4640 1 --2- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cad30 0x7ff6dc0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.383+0000 7ff6e08d4640 1 -- 172.21.15.94:0/312442685 >> v1:172.21.15.130:6789/0 conn(0x7ff6dc15cba0 legacy=0x7ff6dc15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.385 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.383+0000 7ff6e08d4640 1 -- 172.21.15.94:0/312442685 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0ccfc0 con 0x7ff6dc0cdd90 2023-10-16T08:53:36.386 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.383+0000 7ff6e18d6640 1 --2- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cad30 0x7ff6dc0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T08:53:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.384+0000 7ff6e08d4640 1 --2- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cdd90 0x7ff6dc0cc650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009870 tx=0x7ff6cc02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15f220e33f0694c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.384+0000 7ff6d3fff640 1 -- 172.21.15.94:0/312442685 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc030840 con 0x7ff6dc0cdd90 2023-10-16T08:53:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6d3fff640 1 -- 172.21.15.94:0/312442685 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc0309a0 con 0x7ff6dc0cdd90 2023-10-16T08:53:36.387 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6d3fff640 1 -- 172.21.15.94:0/312442685 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc030d30 con 0x7ff6dc0cdd90 2023-10-16T08:53:36.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 -- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cdd90 msgr2=0x7ff6dc0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cdd90 0x7ff6dc0cc650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009870 tx=0x7ff6cc02b980 comp rx=0 tx=0).stop 2023-10-16T08:53:36.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 -- 172.21.15.94:0/312442685 shutdown_connections 2023-10-16T08:53:36.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cad30 0x7ff6dc0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.388 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/312442685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cdd90 0x7ff6dc0cc650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 -- 172.21.15.94:0/312442685 >> 172.21.15.94:0/312442685 conn(0x7ff6dc06a470 msgr2=0x7ff6dc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:36.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 -- 172.21.15.94:0/312442685 shutdown_connections 2023-10-16T08:53:36.389 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.385+0000 7ff6e20d7640 1 -- 172.21.15.94:0/312442685 wait complete. 2023-10-16T08:53:36.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.387+0000 7ff6e20d7640 1 Processor -- start 2023-10-16T08:53:36.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.387+0000 7ff6e20d7640 1 -- start start 2023-10-16T08:53:36.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.388+0000 7ff6e20d7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cad30 0x7ff6dc0c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.391 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.388+0000 7ff6e20d7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cdd90 0x7ff6dc071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.388+0000 7ff6e20d7640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 0x7ff6dc0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.388+0000 7ff6e20d7640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c3020 con 0x7ff6dc15cba0 2023-10-16T08:53:36.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.388+0000 7ff6e20d7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc1490e0 con 0x7ff6dc0cad30 2023-10-16T08:53:36.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.388+0000 7ff6e20d7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c2810 con 0x7ff6dc0cdd90 2023-10-16T08:53:36.392 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 0x7ff6dc0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 0x7ff6dc0c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39164/0 (socket says 172.21.15.94:39164) 2023-10-16T08:53:36.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 -- 172.21.15.94:0/286204473 learned_addr learned my addr 172.21.15.94:0/286204473 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:36.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e08d4640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cdd90 0x7ff6dc071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e10d5640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cad30 0x7ff6dc0c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.393 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 -- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cdd90 msgr2=0x7ff6dc071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cdd90 0x7ff6dc071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 -- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cad30 msgr2=0x7ff6dc0c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cad30 0x7ff6dc0c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e18d6640 1 -- 172.21.15.94:0/286204473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009a70 con 0x7ff6dc15cba0 2023-10-16T08:53:36.394 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.389+0000 7ff6e10d5640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cad30 0x7ff6dc0c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T08:53:36.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.390+0000 7ff6e18d6640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 0x7ff6dc0c4410 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009e60 tx=0x7ff6d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:36.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.390+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4009cd0 con 0x7ff6dc15cba0 2023-10-16T08:53:36.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.390+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d400f040 con 0x7ff6dc15cba0 2023-10-16T08:53:36.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.390+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4003990 con 0x7ff6dc15cba0 2023-10-16T08:53:36.395 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.390+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc0094d0 con 0x7ff6dc15cba0 2023-10-16T08:53:36.396 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.390+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc0c2a60 con 0x7ff6dc15cba0 2023-10-16T08:53:36.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.391+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc04e9b0 con 0x7ff6dc15cba0 2023-10-16T08:53:36.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.392+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6d4014480 con 0x7ff6dc15cba0 2023-10-16T08:53:36.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.393+0000 7ff6d1ffb640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff6c006ae70 0x7ff6c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.397 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.393+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff6d408a210 con 0x7ff6dc15cba0 2023-10-16T08:53:36.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.394+0000 7ff6e10d5640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff6c006ae70 0x7ff6c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.394+0000 7ff6e10d5640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff6c006ae70 0x7ff6c006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000fb0 tx=0x7ff6d8007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:36.398 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.398+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6d40551f0 con 0x7ff6dc15cba0 2023-10-16T08:53:36.661 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.660+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff6dc0b42f0 con 0x7ff6dc15cba0 2023-10-16T08:53:36.662 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.661+0000 7ff6d1ffb640 1 -- 172.21.15.94:0/286204473 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7ff6d4058810 con 0x7ff6dc15cba0 2023-10-16T08:53:36.663 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:53:36.663 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":1,"fsid":"d7b7598f-7f16-4780-92e5-7e8a731f0195","modified":"2023-10-16T08:50:03.946841Z","created":"2023-10-16T08:50:03.946841Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3301","nonce":0},{"type":"v1","addr":"172.21.15.130:6790","nonce":0}]},"addr":"172.21.15.130:6790/0","public_addr":"172.21.15.130:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-16T08:53:36.663 INFO:teuthology.orchestra.run.smithi094.stderr:dumped monmap epoch 1 2023-10-16T08:53:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff6c006ae70 msgr2=0x7ff6c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.665 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff6c006ae70 0x7ff6c006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000fb0 tx=0x7ff6d8007cf0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 msgr2=0x7ff6dc0c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 0x7ff6dc0c4410 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009e60 tx=0x7ff6d400c490 comp rx=0 tx=0).stop 2023-10-16T08:53:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 shutdown_connections 2023-10-16T08:53:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6dc15cba0 0x7ff6dc0c4410 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.666 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6dc0cdd90 0x7ff6dc071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7ff6c006ae70 0x7ff6c006d330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 --2- 172.21.15.94:0/286204473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6dc0cad30 0x7ff6dc0c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.664+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 >> 172.21.15.94:0/286204473 conn(0x7ff6dc06a470 msgr2=0x7ff6dc0ac370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.665+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 shutdown_connections 2023-10-16T08:53:36.667 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.665+0000 7ff6e20d7640 1 -- 172.21.15.94:0/286204473 wait complete. 2023-10-16T08:53:36.685 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-10-16T08:53:36.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.894+0000 7fb53e9a9640 1 Processor -- start 2023-10-16T08:53:36.895 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.894+0000 7fb53e9a9640 1 -- start start 2023-10-16T08:53:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.895+0000 7fb53e9a9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 0x7fb538159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb53e9a9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5380b01b0 0x7fb5380b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.898 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb53e9a9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53815a2c0 con 0x7fb53815dae0 2023-10-16T08:53:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb53e9a9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380b0b80 con 0x7fb5380b01b0 2023-10-16T08:53:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb53e9a9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53815a5a0 con 0x7fb53815d700 2023-10-16T08:53:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb537fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 0x7fb538159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb537fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 0x7fb538159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.94:40166/0 (socket says 172.21.15.94:40166) 2023-10-16T08:53:36.899 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb537fff640 1 -- 172.21.15.94:0/2159282707 learned_addr learned my addr 172.21.15.94:0/2159282707 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb5377fe640 1 --1- 172.21.15.94:0/2159282707 >> v1:172.21.15.130:6789/0 conn(0x7fb53815dae0 0x7fb53806cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.94:54312/0 (socket says 172.21.15.94:54312) 2023-10-16T08:53:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.896+0000 7fb53cf46640 1 --2- 172.21.15.94:0/2159282707 >> v2:172.21.15.130:3300/0 conn(0x7fb5380b01b0 0x7fb5380b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.897+0000 7fb537fff640 1 -- 172.21.15.94:0/2159282707 >> v2:172.21.15.130:3300/0 conn(0x7fb5380b01b0 msgr2=0x7fb5380b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T08:53:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.897+0000 7fb537fff640 1 --2- 172.21.15.94:0/2159282707 >> v2:172.21.15.130:3300/0 conn(0x7fb5380b01b0 0x7fb5380b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.900 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.897+0000 7fb537fff640 1 -- 172.21.15.94:0/2159282707 >> v1:172.21.15.130:6789/0 conn(0x7fb53815dae0 legacy=0x7fb53806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.901 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.897+0000 7fb537fff640 1 -- 172.21.15.94:0/2159282707 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53815a880 con 0x7fb53815d700 2023-10-16T08:53:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.898+0000 7fb537fff640 1 --2- 172.21.15.94:0/2159282707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 0x7fb538159c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb528009870 tx=0x7fb52802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb8c42d99cd00e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.899+0000 7fb536ffd640 1 -- 172.21.15.94:0/2159282707 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528030840 con 0x7fb53815d700 2023-10-16T08:53:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.899+0000 7fb536ffd640 1 -- 172.21.15.94:0/2159282707 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5280309a0 con 0x7fb53815d700 2023-10-16T08:53:36.902 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.899+0000 7fb536ffd640 1 -- 172.21.15.94:0/2159282707 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528030d30 con 0x7fb53815d700 2023-10-16T08:53:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.899+0000 7fb53e9a9640 1 -- 172.21.15.94:0/2159282707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 msgr2=0x7fb538159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.899+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/2159282707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 0x7fb538159c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb528009870 tx=0x7fb52802b980 comp rx=0 tx=0).stop 2023-10-16T08:53:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.900+0000 7fb53e9a9640 1 -- 172.21.15.94:0/2159282707 shutdown_connections 2023-10-16T08:53:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.900+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/2159282707 >> v2:172.21.15.130:3300/0 conn(0x7fb5380b01b0 0x7fb5380b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.903 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.900+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/2159282707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815d700 0x7fb538159c80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.900+0000 7fb53e9a9640 1 -- 172.21.15.94:0/2159282707 >> 172.21.15.94:0/2159282707 conn(0x7fb5380cb1b0 msgr2=0x7fb5380cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.900+0000 7fb53e9a9640 1 -- 172.21.15.94:0/2159282707 shutdown_connections 2023-10-16T08:53:36.904 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.900+0000 7fb53e9a9640 1 -- 172.21.15.94:0/2159282707 wait complete. 2023-10-16T08:53:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.902+0000 7fb53e9a9640 1 Processor -- start 2023-10-16T08:53:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.902+0000 7fb53e9a9640 1 -- start start 2023-10-16T08:53:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb53e9a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5380b01b0 0x7fb5381553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.906 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb53e9a9640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 0x7fb5381f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb53e9a9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815dae0 0x7fb5381f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb53e9a9640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380aeb90 con 0x7fb53815d700 2023-10-16T08:53:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb53e9a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380aee70 con 0x7fb5380b01b0 2023-10-16T08:53:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb53e9a9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380af150 con 0x7fb53815dae0 2023-10-16T08:53:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb5377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 0x7fb5381f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb5377fe640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 0x7fb5381f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:39178/0 (socket says 172.21.15.94:39178) 2023-10-16T08:53:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.903+0000 7fb5377fe640 1 -- 172.21.15.94:0/523258602 learned_addr learned my addr 172.21.15.94:0/523258602 (peer_addr_for_me v2:172.21.15.94:0/0) 2023-10-16T08:53:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb537fff640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5380b01b0 0x7fb5381553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb53cf46640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815dae0 0x7fb5381f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb5377fe640 1 -- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815dae0 msgr2=0x7fb5381f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb5377fe640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815dae0 0x7fb5381f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb5377fe640 1 -- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5380b01b0 msgr2=0x7fb5381553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb5377fe640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5380b01b0 0x7fb5381553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb5377fe640 1 -- 172.21.15.94:0/523258602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280094d0 con 0x7fb53815d700 2023-10-16T08:53:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb5377fe640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 0x7fb5381f57e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00c3e0 tx=0x7fb52c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0074e0 con 0x7fb53815d700 2023-10-16T08:53:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c007640 con 0x7fb53815d700 2023-10-16T08:53:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.904+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380af430 con 0x7fb53815d700 2023-10-16T08:53:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.905+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0049e0 con 0x7fb53815d700 2023-10-16T08:53:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.905+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381558e0 con 0x7fb53815d700 2023-10-16T08:53:36.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.906+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5380af950 con 0x7fb53815d700 2023-10-16T08:53:36.911 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.907+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb52c004b40 con 0x7fb53815d700 2023-10-16T08:53:36.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.908+0000 7fb534ff9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb52406ae70 0x7fb52406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T08:53:36.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.908+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb52c089170 con 0x7fb53815d700 2023-10-16T08:53:36.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.908+0000 7fb537fff640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb52406ae70 0x7fb52406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T08:53:36.912 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.909+0000 7fb537fff640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb52406ae70 0x7fb52406d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb528036000 tx=0x7fb528008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T08:53:36.914 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:36.914+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5380af950 con 0x7fb53815d700 2023-10-16T08:53:37.169 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.169+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7fb5380af950 con 0x7fb53815d700 2023-10-16T08:53:37.170 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.169+0000 7fb534ff9640 1 -- 172.21.15.94:0/523258602 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7fb5380af950 con 0x7fb53815d700 2023-10-16T08:53:37.171 INFO:teuthology.orchestra.run.smithi094.stdout:[client.admin] 2023-10-16T08:53:37.171 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA8+SxlMurHFxAAV1ShgYYNNPyCtBuw3sk4fw== 2023-10-16T08:53:37.171 INFO:teuthology.orchestra.run.smithi094.stdout: caps mds = "allow *" 2023-10-16T08:53:37.171 INFO:teuthology.orchestra.run.smithi094.stdout: caps mgr = "allow *" 2023-10-16T08:53:37.171 INFO:teuthology.orchestra.run.smithi094.stdout: caps mon = "allow *" 2023-10-16T08:53:37.172 INFO:teuthology.orchestra.run.smithi094.stdout: caps osd = "allow *" 2023-10-16T08:53:37.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb52406ae70 msgr2=0x7fb52406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:37.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb52406ae70 0x7fb52406d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb528036000 tx=0x7fb528008030 comp rx=0 tx=0).stop 2023-10-16T08:53:37.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 msgr2=0x7fb5381f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T08:53:37.173 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 0x7fb5381f57e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00c3e0 tx=0x7fb52c00c8a0 comp rx=0 tx=0).stop 2023-10-16T08:53:37.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 shutdown_connections 2023-10-16T08:53:37.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb53815dae0 0x7fb5381f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:37.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb53815d700 0x7fb5381f57e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:37.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.94:6832/2208206022,v1:172.21.15.94:6833/2208206022] conn(0x7fb52406ae70 0x7fb52406d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:37.174 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 --2- 172.21.15.94:0/523258602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5380b01b0 0x7fb5381553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T08:53:37.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 >> 172.21.15.94:0/523258602 conn(0x7fb5380cb1b0 msgr2=0x7fb5380b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T08:53:37.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 shutdown_connections 2023-10-16T08:53:37.175 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-16T08:53:37.172+0000 7fb53e9a9640 1 -- 172.21.15.94:0/523258602 wait complete. 2023-10-16T08:53:37.191 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2023-10-16T08:53:37.241 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.zScna9hcyD 2023-10-16T08:53:37.242 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:53:37.242 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/tmp/tmp.zScna9hcyD 2023-10-16T08:53:37.297 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:53:37.297 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/tmp/tmp.tcp0mkZMHZxfstests-dev/local.config 2023-10-16T08:53:37.439 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.VH3pOVWuu6test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.52chpTxwVbscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.94:6789 -k /tmp/tmp.zScna9hcyD --client_mountpoint /test" 2023-10-16T08:53:37.441 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T08:53:37.442 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/tmp/tmp.tcp0mkZMHZxfstests-dev/ceph.exclude 2023-10-16T08:53:37.581 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo make) 2023-10-16T08:53:37.741 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize -cfi 2023-10-16T08:53:38.461 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-16T08:53:38.462 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file './config.guess' 2023-10-16T08:53:38.477 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file './config.sub' 2023-10-16T08:53:38.492 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file './install-sh' 2023-10-16T08:53:38.509 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file './ltmain.sh' 2023-10-16T08:53:38.604 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-16T08:53:38.605 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-16T08:53:38.623 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-16T08:53:38.642 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-16T08:53:38.661 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-16T08:53:38.680 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-16T08:53:38.706 INFO:teuthology.orchestra.run.smithi094.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-16T08:53:38.711 INFO:teuthology.orchestra.run.smithi094.stdout:cp include/install-sh . 2023-10-16T08:53:38.714 INFO:teuthology.orchestra.run.smithi094.stdout:aclocal -I m4 2023-10-16T08:53:40.141 INFO:teuthology.orchestra.run.smithi094.stdout:autoheader 2023-10-16T08:53:40.554 INFO:teuthology.orchestra.run.smithi094.stdout:autoconf 2023-10-16T08:53:40.803 INFO:teuthology.orchestra.run.smithi094.stdout:./configure \ 2023-10-16T08:53:40.803 INFO:teuthology.orchestra.run.smithi094.stdout: --libexecdir=/usr/lib \ 2023-10-16T08:53:40.803 INFO:teuthology.orchestra.run.smithi094.stdout: --exec_prefix=/var/lib 2023-10-16T08:53:41.290 INFO:teuthology.orchestra.run.smithi094.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-16T08:53:41.290 INFO:teuthology.orchestra.run.smithi094.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-16T08:53:41.295 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to print strings... printf 2023-10-16T08:53:41.295 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gcc... gcc 2023-10-16T08:53:41.443 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether the C compiler works... yes 2023-10-16T08:53:41.443 INFO:teuthology.orchestra.run.smithi094.stdout:checking for C compiler default output file name... a.out 2023-10-16T08:53:41.512 INFO:teuthology.orchestra.run.smithi094.stdout:checking for suffix of executables... 2023-10-16T08:53:41.612 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether we are cross compiling... no 2023-10-16T08:53:41.663 INFO:teuthology.orchestra.run.smithi094.stdout:checking for suffix of object files... o 2023-10-16T08:53:41.707 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether we are using the GNU C compiler... yes 2023-10-16T08:53:41.753 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether gcc accepts -g... yes 2023-10-16T08:53:41.820 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-16T08:53:41.829 INFO:teuthology.orchestra.run.smithi094.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-16T08:53:41.837 INFO:teuthology.orchestra.run.smithi094.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-16T08:53:41.841 INFO:teuthology.orchestra.run.smithi094.stdout:checking for egrep... /bin/grep -E 2023-10-16T08:53:41.845 INFO:teuthology.orchestra.run.smithi094.stdout:checking for fgrep... /bin/grep -F 2023-10-16T08:53:41.858 INFO:teuthology.orchestra.run.smithi094.stdout:checking for ld used by gcc... /bin/ld 2023-10-16T08:53:41.863 INFO:teuthology.orchestra.run.smithi094.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-16T08:53:41.880 INFO:teuthology.orchestra.run.smithi094.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-16T08:53:42.998 INFO:teuthology.orchestra.run.smithi094.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-16T08:53:42.998 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether ln -s works... yes 2023-10-16T08:53:43.017 INFO:teuthology.orchestra.run.smithi094.stdout:checking the maximum length of command line arguments... 1572864 2023-10-16T08:53:43.028 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-16T08:53:43.029 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-16T08:53:43.029 INFO:teuthology.orchestra.run.smithi094.stdout:checking for /bin/ld option to reload object files... -r 2023-10-16T08:53:43.030 INFO:teuthology.orchestra.run.smithi094.stdout:checking for objdump... objdump 2023-10-16T08:53:43.031 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to recognize dependent libraries... pass_all 2023-10-16T08:53:43.033 INFO:teuthology.orchestra.run.smithi094.stdout:checking for dlltool... no 2023-10-16T08:53:43.033 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-16T08:53:43.034 INFO:teuthology.orchestra.run.smithi094.stdout:checking for ar... ar 2023-10-16T08:53:43.152 INFO:teuthology.orchestra.run.smithi094.stdout:checking for archiver @FILE support... @ 2023-10-16T08:53:43.152 INFO:teuthology.orchestra.run.smithi094.stdout:checking for strip... strip 2023-10-16T08:53:43.154 INFO:teuthology.orchestra.run.smithi094.stdout:checking for ranlib... ranlib 2023-10-16T08:53:43.155 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gawk... gawk 2023-10-16T08:53:43.342 INFO:teuthology.orchestra.run.smithi094.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-16T08:53:43.347 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sysroot... no 2023-10-16T08:53:43.358 INFO:teuthology.orchestra.run.smithi094.stdout:checking for a working dd... /bin/dd 2023-10-16T08:53:43.369 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-16T08:53:43.411 INFO:teuthology.orchestra.run.smithi094.stdout:checking for mt... no 2023-10-16T08:53:43.420 INFO:teuthology.orchestra.run.smithi094.stdout:checking if : is a manifest tool... no 2023-10-16T08:53:43.518 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to run the C preprocessor... gcc -E 2023-10-16T08:53:43.864 INFO:teuthology.orchestra.run.smithi094.stdout:checking for ANSI C header files... yes 2023-10-16T08:53:43.923 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/types.h... yes 2023-10-16T08:53:44.002 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/stat.h... yes 2023-10-16T08:53:44.075 INFO:teuthology.orchestra.run.smithi094.stdout:checking for stdlib.h... yes 2023-10-16T08:53:44.145 INFO:teuthology.orchestra.run.smithi094.stdout:checking for string.h... yes 2023-10-16T08:53:44.223 INFO:teuthology.orchestra.run.smithi094.stdout:checking for memory.h... yes 2023-10-16T08:53:44.294 INFO:teuthology.orchestra.run.smithi094.stdout:checking for strings.h... yes 2023-10-16T08:53:44.382 INFO:teuthology.orchestra.run.smithi094.stdout:checking for inttypes.h... yes 2023-10-16T08:53:44.457 INFO:teuthology.orchestra.run.smithi094.stdout:checking for stdint.h... yes 2023-10-16T08:53:44.541 INFO:teuthology.orchestra.run.smithi094.stdout:checking for unistd.h... yes 2023-10-16T08:53:44.619 INFO:teuthology.orchestra.run.smithi094.stdout:checking for dlfcn.h... yes 2023-10-16T08:53:44.632 INFO:teuthology.orchestra.run.smithi094.stdout:checking for objdir... .libs 2023-10-16T08:53:44.823 INFO:teuthology.orchestra.run.smithi094.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-16T08:53:44.824 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-16T08:53:44.876 INFO:teuthology.orchestra.run.smithi094.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-16T08:53:44.928 INFO:teuthology.orchestra.run.smithi094.stdout:checking if gcc static flag -static works... no 2023-10-16T08:53:45.006 INFO:teuthology.orchestra.run.smithi094.stdout:checking if gcc supports -c -o file.o... yes 2023-10-16T08:53:45.007 INFO:teuthology.orchestra.run.smithi094.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-16T08:53:45.033 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-16T08:53:45.102 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether -lc should be explicitly linked in... no 2023-10-16T08:53:45.259 INFO:teuthology.orchestra.run.smithi094.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-16T08:53:45.260 INFO:teuthology.orchestra.run.smithi094.stdout:checking how to hardcode library paths into programs... immediate 2023-10-16T08:53:45.264 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether stripping libraries is possible... yes 2023-10-16T08:53:45.264 INFO:teuthology.orchestra.run.smithi094.stdout:checking if libtool supports shared libraries... yes 2023-10-16T08:53:45.264 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether to build shared libraries... yes 2023-10-16T08:53:45.264 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether to build static libraries... yes 2023-10-16T08:53:45.283 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gcc... (cached) gcc 2023-10-16T08:53:45.333 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-16T08:53:45.334 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-16T08:53:45.335 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-16T08:53:45.335 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gmake... /usr/bin/gmake 2023-10-16T08:53:45.335 INFO:teuthology.orchestra.run.smithi094.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-10-16T08:53:45.336 INFO:teuthology.orchestra.run.smithi094.stdout:checking for tar... /bin/tar 2023-10-16T08:53:45.336 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gzip... /bin/gzip 2023-10-16T08:53:45.361 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether gcc -MM is supported... yes 2023-10-16T08:53:45.361 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sort... /bin/sort 2023-10-16T08:53:45.361 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether ln -s works... yes 2023-10-16T08:53:45.362 INFO:teuthology.orchestra.run.smithi094.stdout:checking for rpm... /bin/rpm 2023-10-16T08:53:45.373 INFO:teuthology.orchestra.run.smithi094.stdout:checking for rpmbuild... no 2023-10-16T08:53:45.442 INFO:teuthology.orchestra.run.smithi094.stdout:checking assert.h usability... yes 2023-10-16T08:53:45.469 INFO:teuthology.orchestra.run.smithi094.stdout:checking assert.h presence... yes 2023-10-16T08:53:45.469 INFO:teuthology.orchestra.run.smithi094.stdout:checking for assert.h... yes 2023-10-16T08:53:45.550 INFO:teuthology.orchestra.run.smithi094.stdout:checking bstring.h usability... no 2023-10-16T08:53:45.593 INFO:teuthology.orchestra.run.smithi094.stdout:checking bstring.h presence... no 2023-10-16T08:53:45.594 INFO:teuthology.orchestra.run.smithi094.stdout:checking for bstring.h... no 2023-10-16T08:53:45.663 INFO:teuthology.orchestra.run.smithi094.stdout:checking libgen.h usability... yes 2023-10-16T08:53:45.691 INFO:teuthology.orchestra.run.smithi094.stdout:checking libgen.h presence... yes 2023-10-16T08:53:45.692 INFO:teuthology.orchestra.run.smithi094.stdout:checking for libgen.h... yes 2023-10-16T08:53:45.776 INFO:teuthology.orchestra.run.smithi094.stdout:checking dirent.h usability... yes 2023-10-16T08:53:45.804 INFO:teuthology.orchestra.run.smithi094.stdout:checking dirent.h presence... yes 2023-10-16T08:53:45.804 INFO:teuthology.orchestra.run.smithi094.stdout:checking for dirent.h... yes 2023-10-16T08:53:45.911 INFO:teuthology.orchestra.run.smithi094.stdout:checking errno.h usability... yes 2023-10-16T08:53:45.941 INFO:teuthology.orchestra.run.smithi094.stdout:checking errno.h presence... yes 2023-10-16T08:53:45.942 INFO:teuthology.orchestra.run.smithi094.stdout:checking for errno.h... yes 2023-10-16T08:53:46.025 INFO:teuthology.orchestra.run.smithi094.stdout:checking malloc.h usability... yes 2023-10-16T08:53:46.054 INFO:teuthology.orchestra.run.smithi094.stdout:checking malloc.h presence... yes 2023-10-16T08:53:46.055 INFO:teuthology.orchestra.run.smithi094.stdout:checking for malloc.h... yes 2023-10-16T08:53:46.135 INFO:teuthology.orchestra.run.smithi094.stdout:checking uuid.h usability... no 2023-10-16T08:53:46.177 INFO:teuthology.orchestra.run.smithi094.stdout:checking uuid.h presence... no 2023-10-16T08:53:46.178 INFO:teuthology.orchestra.run.smithi094.stdout:checking for uuid.h... no 2023-10-16T08:53:46.266 INFO:teuthology.orchestra.run.smithi094.stdout:checking uuid/uuid.h usability... yes 2023-10-16T08:53:46.296 INFO:teuthology.orchestra.run.smithi094.stdout:checking uuid/uuid.h presence... yes 2023-10-16T08:53:46.296 INFO:teuthology.orchestra.run.smithi094.stdout:checking for uuid/uuid.h... yes 2023-10-16T08:53:46.375 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/uuid.h usability... no 2023-10-16T08:53:46.415 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/uuid.h presence... no 2023-10-16T08:53:46.416 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/uuid.h... no 2023-10-16T08:53:46.494 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/file.h usability... yes 2023-10-16T08:53:46.521 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/file.h presence... yes 2023-10-16T08:53:46.521 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/file.h... yes 2023-10-16T08:53:46.603 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/fcntl.h usability... yes 2023-10-16T08:53:46.631 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/fcntl.h presence... yes 2023-10-16T08:53:46.632 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/fcntl.h... yes 2023-10-16T08:53:46.710 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/syssgi.h usability... no 2023-10-16T08:53:46.754 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/syssgi.h presence... no 2023-10-16T08:53:46.755 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/syssgi.h... no 2023-10-16T08:53:46.846 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/param.h usability... yes 2023-10-16T08:53:46.881 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/param.h presence... yes 2023-10-16T08:53:46.882 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/param.h... yes 2023-10-16T08:53:46.902 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/stat.h... (cached) yes 2023-10-16T08:53:46.998 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/statvfs.h usability... yes 2023-10-16T08:53:47.025 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/statvfs.h presence... yes 2023-10-16T08:53:47.026 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/statvfs.h... yes 2023-10-16T08:53:47.106 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/time.h usability... yes 2023-10-16T08:53:47.135 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/time.h presence... yes 2023-10-16T08:53:47.136 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/time.h... yes 2023-10-16T08:53:47.235 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/ioctl.h usability... yes 2023-10-16T08:53:47.263 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/ioctl.h presence... yes 2023-10-16T08:53:47.263 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/ioctl.h... yes 2023-10-16T08:53:47.354 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/wait.h usability... yes 2023-10-16T08:53:47.383 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/wait.h presence... yes 2023-10-16T08:53:47.383 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/wait.h... yes 2023-10-16T08:53:47.403 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/types.h... (cached) yes 2023-10-16T08:53:47.420 INFO:teuthology.orchestra.run.smithi094.stdout:checking for strings.h... (cached) yes 2023-10-16T08:53:47.497 INFO:teuthology.orchestra.run.smithi094.stdout:checking err.h usability... yes 2023-10-16T08:53:47.526 INFO:teuthology.orchestra.run.smithi094.stdout:checking err.h presence... yes 2023-10-16T08:53:47.526 INFO:teuthology.orchestra.run.smithi094.stdout:checking for err.h... yes 2023-10-16T08:53:47.608 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/falloc.h usability... yes 2023-10-16T08:53:47.631 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/falloc.h presence... yes 2023-10-16T08:53:47.631 INFO:teuthology.orchestra.run.smithi094.stdout:checking for linux/falloc.h... yes 2023-10-16T08:53:47.707 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-16T08:53:47.750 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-16T08:53:47.750 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-16T08:53:47.825 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-16T08:53:47.868 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-16T08:53:47.868 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-16T08:53:47.942 INFO:teuthology.orchestra.run.smithi094.stdout:checking xfs/platform_defs.h usability... no 2023-10-16T08:53:47.984 INFO:teuthology.orchestra.run.smithi094.stdout:checking xfs/platform_defs.h presence... no 2023-10-16T08:53:47.984 INFO:teuthology.orchestra.run.smithi094.stdout:checking for xfs/platform_defs.h... no 2023-10-16T08:53:48.059 INFO:teuthology.orchestra.run.smithi094.stdout:checking btrfs/ioctl.h usability... no 2023-10-16T08:53:48.104 INFO:teuthology.orchestra.run.smithi094.stdout:checking btrfs/ioctl.h presence... no 2023-10-16T08:53:48.104 INFO:teuthology.orchestra.run.smithi094.stdout:checking for btrfs/ioctl.h... no 2023-10-16T08:53:48.178 INFO:teuthology.orchestra.run.smithi094.stdout:checking cifs/ioctl.h usability... no 2023-10-16T08:53:48.221 INFO:teuthology.orchestra.run.smithi094.stdout:checking cifs/ioctl.h presence... no 2023-10-16T08:53:48.221 INFO:teuthology.orchestra.run.smithi094.stdout:checking for cifs/ioctl.h... no 2023-10-16T08:53:48.297 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/mman.h usability... yes 2023-10-16T08:53:48.326 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/mman.h presence... yes 2023-10-16T08:53:48.326 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/mman.h... yes 2023-10-16T08:53:48.381 INFO:teuthology.orchestra.run.smithi094.stdout:checking for xfs/xfs_log_format.h... no 2023-10-16T08:53:48.477 INFO:teuthology.orchestra.run.smithi094.stdout:checking for uuid_compare... no 2023-10-16T08:53:48.562 INFO:teuthology.orchestra.run.smithi094.stdout:checking for uuid_compare in -luuid... yes 2023-10-16T08:53:48.697 INFO:teuthology.orchestra.run.smithi094.stdout:checking for xfs/xfs.h... yes 2023-10-16T08:53:48.744 INFO:teuthology.orchestra.run.smithi094.stdout:checking for xfs/libxfs.h... no 2023-10-16T08:53:48.808 INFO:teuthology.orchestra.run.smithi094.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-16T08:53:48.886 INFO:teuthology.orchestra.run.smithi094.stdout:checking for xfs/xqm.h... yes 2023-10-16T08:53:48.989 INFO:teuthology.orchestra.run.smithi094.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-16T08:53:49.053 INFO:teuthology.orchestra.run.smithi094.stdout:checking xfs/handle.h usability... yes 2023-10-16T08:53:49.078 INFO:teuthology.orchestra.run.smithi094.stdout:checking xfs/handle.h presence... yes 2023-10-16T08:53:49.079 INFO:teuthology.orchestra.run.smithi094.stdout:checking for xfs/handle.h... yes 2023-10-16T08:53:49.178 INFO:teuthology.orchestra.run.smithi094.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-16T08:53:49.242 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/acl.h usability... yes 2023-10-16T08:53:49.273 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/acl.h presence... yes 2023-10-16T08:53:49.273 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/acl.h... yes 2023-10-16T08:53:49.338 INFO:teuthology.orchestra.run.smithi094.stdout:checking acl/libacl.h usability... yes 2023-10-16T08:53:49.369 INFO:teuthology.orchestra.run.smithi094.stdout:checking acl/libacl.h presence... yes 2023-10-16T08:53:49.370 INFO:teuthology.orchestra.run.smithi094.stdout:checking for acl/libacl.h... yes 2023-10-16T08:53:49.454 INFO:teuthology.orchestra.run.smithi094.stdout:checking for acl_init in -lacl... yes 2023-10-16T08:53:49.527 INFO:teuthology.orchestra.run.smithi094.stdout:checking gdbm-ndbm.h usability... no 2023-10-16T08:53:49.570 INFO:teuthology.orchestra.run.smithi094.stdout:checking gdbm-ndbm.h presence... no 2023-10-16T08:53:49.570 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gdbm-ndbm.h... no 2023-10-16T08:53:49.635 INFO:teuthology.orchestra.run.smithi094.stdout:checking gdbm/ndbm.h usability... no 2023-10-16T08:53:49.676 INFO:teuthology.orchestra.run.smithi094.stdout:checking gdbm/ndbm.h presence... no 2023-10-16T08:53:49.676 INFO:teuthology.orchestra.run.smithi094.stdout:checking for gdbm/ndbm.h... no 2023-10-16T08:53:49.743 INFO:teuthology.orchestra.run.smithi094.stdout:checking ndbm.h usability... no 2023-10-16T08:53:49.783 INFO:teuthology.orchestra.run.smithi094.stdout:checking ndbm.h presence... no 2023-10-16T08:53:49.783 INFO:teuthology.orchestra.run.smithi094.stdout:checking for ndbm.h... no 2023-10-16T08:53:49.842 INFO:teuthology.orchestra.run.smithi094.stdout:checking libaio.h usability... yes 2023-10-16T08:53:49.877 INFO:teuthology.orchestra.run.smithi094.stdout:checking libaio.h presence... yes 2023-10-16T08:53:49.878 INFO:teuthology.orchestra.run.smithi094.stdout:checking for libaio.h... yes 2023-10-16T08:53:49.943 INFO:teuthology.orchestra.run.smithi094.stdout:checking liburing.h usability... no 2023-10-16T08:53:49.985 INFO:teuthology.orchestra.run.smithi094.stdout:checking liburing.h presence... no 2023-10-16T08:53:49.986 INFO:teuthology.orchestra.run.smithi094.stdout:checking for liburing.h... no 2023-10-16T08:53:50.050 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/capability.h usability... no 2023-10-16T08:53:50.091 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/capability.h presence... no 2023-10-16T08:53:50.092 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/capability.h... no 2023-10-16T08:53:50.152 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/fiemap.h usability... yes 2023-10-16T08:53:50.176 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/fiemap.h presence... yes 2023-10-16T08:53:50.177 INFO:teuthology.orchestra.run.smithi094.stdout:checking for linux/fiemap.h... yes 2023-10-16T08:53:50.261 INFO:teuthology.orchestra.run.smithi094.stdout:checking for fallocate... yes 2023-10-16T08:53:50.342 INFO:teuthology.orchestra.run.smithi094.stdout:checking for open_by_handle_at... yes 2023-10-16T08:53:50.409 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/prctl.h usability... yes 2023-10-16T08:53:50.437 INFO:teuthology.orchestra.run.smithi094.stdout:checking sys/prctl.h presence... yes 2023-10-16T08:53:50.438 INFO:teuthology.orchestra.run.smithi094.stdout:checking for sys/prctl.h... yes 2023-10-16T08:53:50.503 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/fs.h usability... yes 2023-10-16T08:53:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/fs.h presence... yes 2023-10-16T08:53:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:checking for linux/fs.h... yes 2023-10-16T08:53:50.594 INFO:teuthology.orchestra.run.smithi094.stdout:checking btrfsutil.h usability... no 2023-10-16T08:53:50.637 INFO:teuthology.orchestra.run.smithi094.stdout:checking btrfsutil.h presence... no 2023-10-16T08:53:50.637 INFO:teuthology.orchestra.run.smithi094.stdout:checking for btrfsutil.h... no 2023-10-16T08:53:50.727 INFO:teuthology.orchestra.run.smithi094.stdout:checking for copy_file_range... yes 2023-10-16T08:53:50.814 INFO:teuthology.orchestra.run.smithi094.stdout:checking for SEEK_DATA... yes 2023-10-16T08:53:50.924 INFO:teuthology.orchestra.run.smithi094.stdout:checking for BMV_OF_SHARED... yes 2023-10-16T08:53:51.015 INFO:teuthology.orchestra.run.smithi094.stdout:checking for nftw... yes 2023-10-16T08:53:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:checking for RLIMIT_NOFILE... yes 2023-10-16T08:53:51.162 INFO:teuthology.orchestra.run.smithi094.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-16T08:53:51.248 INFO:teuthology.orchestra.run.smithi094.stdout:checking for renameat2... yes 2023-10-16T08:53:51.334 INFO:teuthology.orchestra.run.smithi094.stdout:checking for reallocarray... yes 2023-10-16T08:53:51.430 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct mount_attr... yes 2023-10-16T08:53:51.541 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-16T08:53:51.647 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-16T08:53:51.758 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-16T08:53:51.866 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-16T08:53:51.977 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-16T08:53:52.080 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-16T08:53:52.181 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-16T08:53:52.258 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/btrfs.h usability... yes 2023-10-16T08:53:52.282 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/btrfs.h presence... yes 2023-10-16T08:53:52.283 INFO:teuthology.orchestra.run.smithi094.stdout:checking for linux/btrfs.h... yes 2023-10-16T08:53:52.370 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-16T08:53:52.398 INFO:teuthology.orchestra.run.smithi094.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-16T08:53:52.399 INFO:teuthology.orchestra.run.smithi094.stdout:checking for linux/btrfs_tree.h... yes 2023-10-16T08:53:52.462 INFO:teuthology.orchestra.run.smithi094.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-10-16T08:53:52.502 INFO:teuthology.orchestra.run.smithi094.stdout:configure: creating ./config.status 2023-10-16T08:53:53.745 INFO:teuthology.orchestra.run.smithi094.stdout:config.status: creating include/builddefs 2023-10-16T08:53:53.789 INFO:teuthology.orchestra.run.smithi094.stdout:config.status: creating include/config.h 2023-10-16T08:53:53.818 INFO:teuthology.orchestra.run.smithi094.stdout:config.status: executing libtool commands 2023-10-16T08:53:53.930 INFO:teuthology.orchestra.run.smithi094.stdout:Building include 2023-10-16T08:53:53.941 INFO:teuthology.orchestra.run.smithi094.stdout:Building lib 2023-10-16T08:53:53.952 INFO:teuthology.orchestra.run.smithi094.stdout: [LTDEP] 2023-10-16T08:53:54.260 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dataascii.lo 2023-10-16T08:53:54.519 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] databin.lo 2023-10-16T08:53:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] datapid.lo 2023-10-16T08:53:55.077 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] file_lock.lo 2023-10-16T08:53:55.373 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] forker.lo 2023-10-16T08:53:55.652 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] pattern.lo 2023-10-16T08:53:55.910 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] open_flags.lo 2023-10-16T08:53:56.201 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] random_range.lo 2023-10-16T08:53:56.581 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] string_to_tokens.lo 2023-10-16T08:53:56.834 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] str_to_bytes.lo 2023-10-16T08:53:57.126 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] tlibio.lo 2023-10-16T08:53:57.537 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] write_log.lo 2023-10-16T08:53:57.942 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] random.lo 2023-10-16T08:53:58.194 INFO:teuthology.orchestra.run.smithi094.stdout: [LD] 2023-10-16T08:53:58.425 INFO:teuthology.orchestra.run.smithi094.stdout:Building ltp 2023-10-16T08:53:58.434 INFO:teuthology.orchestra.run.smithi094.stdout: [DEP] 2023-10-16T08:53:58.727 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] doio 2023-10-16T08:53:59.639 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fsstress 2023-10-16T08:54:01.295 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fsx 2023-10-16T08:54:02.242 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] growfiles 2023-10-16T08:54:02.838 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:54:02.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:54:02.999 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] iogen 2023-10-16T08:54:03.570 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-stress 2023-10-16T08:54:04.156 INFO:teuthology.orchestra.run.smithi094.stdout:Building src 2023-10-16T08:54:04.169 INFO:teuthology.orchestra.run.smithi094.stdout: [DEP] 2023-10-16T08:54:07.859 INFO:teuthology.orchestra.run.smithi094.stdout: [DEP] 2023-10-16T08:54:07.937 INFO:teuthology.orchestra.run.smithi094.stdout: [DEP] 2023-10-16T08:54:07.956 INFO:teuthology.orchestra.run.smithi094.stdout: [DEP] 2023-10-16T08:54:08.442 INFO:teuthology.orchestra.run.smithi094.stdout: [DEP] 2023-10-16T08:54:08.499 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dirstress 2023-10-16T08:54:08.934 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fill 2023-10-16T08:54:09.274 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fill2 2023-10-16T08:54:09.712 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] getpagesize 2023-10-16T08:54:10.033 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] holes 2023-10-16T08:54:10.418 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] lstat64 2023-10-16T08:54:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] nametest 2023-10-16T08:54:11.210 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] permname 2023-10-16T08:54:11.622 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] randholes 2023-10-16T08:54:12.057 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] runas 2023-10-16T08:54:12.420 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] truncfile 2023-10-16T08:54:12.809 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] usemem 2023-10-16T08:54:13.153 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] mmapcat 2023-10-16T08:54:13.473 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] append_reader 2023-10-16T08:54:13.802 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] append_writer 2023-10-16T08:54:14.155 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dirperf 2023-10-16T08:54:14.531 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] metaperf 2023-10-16T08:54:14.979 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] devzero 2023-10-16T08:54:15.329 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] feature 2023-10-16T08:54:15.729 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] alloc 2023-10-16T08:54:16.133 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fault 2023-10-16T08:54:16.492 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fstest 2023-10-16T08:54:16.926 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_access_root 2023-10-16T08:54:17.235 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] godown 2023-10-16T08:54:17.596 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] resvtest 2023-10-16T08:54:17.973 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] writemod 2023-10-16T08:54:18.303 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] writev_on_pagefault 2023-10-16T08:54:18.655 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] makeextents 2023-10-16T08:54:19.049 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] itrash 2023-10-16T08:54:19.413 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] rename 2023-10-16T08:54:19.728 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] multi_open_unlink 2023-10-16T08:54:20.079 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] unwritten_sync 2023-10-16T08:54:20.459 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] genhashnames 2023-10-16T08:54:20.832 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_holes 2023-10-16T08:54:21.139 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_writev 2023-10-16T08:54:21.483 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_truncate_cmtime 2023-10-16T08:54:21.814 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dirhash_collide 2023-10-16T08:54:22.181 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_rename_overwrite 2023-10-16T08:54:22.539 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] holetest 2023-10-16T08:54:22.967 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_truncate_self 2023-10-16T08:54:23.286 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] af_unix 2023-10-16T08:54:23.627 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_stale_pmd 2023-10-16T08:54:23.948 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_cow_race 2023-10-16T08:54:24.293 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_fallocate 2023-10-16T08:54:24.628 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fsync-err 2023-10-16T08:54:24.981 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_write_ro 2023-10-16T08:54:25.329 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-16T08:54:25.678 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-16T08:54:26.027 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_ofd_locks 2023-10-16T08:54:26.420 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_collision 2023-10-16T08:54:26.810 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] mmap-write-concurrent 2023-10-16T08:54:27.175 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_get_file_time 2023-10-16T08:54:27.514 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_create_short_dirs 2023-10-16T08:54:27.865 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_create_long_dirs 2023-10-16T08:54:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_enospc 2023-10-16T08:54:28.578 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_writev_overlap 2023-10-16T08:54:28.944 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] checkpoint_journal 2023-10-16T08:54:29.279 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] mmap-rw-fault 2023-10-16T08:54:29.663 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] allocstale 2023-10-16T08:54:30.013 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_cow_memory_failure 2023-10-16T08:54:30.374 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fake-dump-rootino 2023-10-16T08:54:30.714 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dio-buf-fault 2023-10-16T08:54:31.042 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] rewinddir-test 2023-10-16T08:54:31.400 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] xfsctl 2023-10-16T08:54:31.809 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] bstat 2023-10-16T08:54:32.195 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mtab 2023-10-16T08:54:32.570 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] getdevicesize 2023-10-16T08:54:32.902 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] preallo_rw_pattern_reader 2023-10-16T08:54:32.983 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:54:32.990 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:54:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] preallo_rw_pattern_writer 2023-10-16T08:54:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] ftrunc 2023-10-16T08:54:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] trunc 2023-10-16T08:54:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fs_perms 2023-10-16T08:54:34.523 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] testx 2023-10-16T08:54:34.836 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] looptest 2023-10-16T08:54:35.194 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] locktest 2023-10-16T08:54:35.700 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] unwritten_mmap 2023-10-16T08:54:36.049 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] bulkstat_unlink_test 2023-10-16T08:54:36.450 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] deduperace 2023-10-16T08:54:36.817 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] bulkstat_unlink_test_modified 2023-10-16T08:54:37.175 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_dir_offset 2023-10-16T08:54:37.500 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_futimens 2023-10-16T08:54:37.817 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_immutable 2023-10-16T08:54:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] stale_handle 2023-10-16T08:54:39.054 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] pwrite_mmap_blocked 2023-10-16T08:54:39.418 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_dir_offset2 2023-10-16T08:54:39.804 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] seek_sanity_test 2023-10-16T08:54:40.433 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] seek_copy_test 2023-10-16T08:54:40.797 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_readdir_1 2023-10-16T08:54:41.130 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_readdir_2 2023-10-16T08:54:41.472 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fsync-tester 2023-10-16T08:54:41.892 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] nsexec 2023-10-16T08:54:42.258 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] cloner 2023-10-16T08:54:42.620 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] renameat2 2023-10-16T08:54:43.009 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_getcwd 2023-10-16T08:54:43.337 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] e4compact 2023-10-16T08:54:43.723 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] test-nextquota 2023-10-16T08:54:44.079 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] punch-alternating 2023-10-16T08:54:44.443 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-16T08:54:44.774 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] listxattr 2023-10-16T08:54:45.095 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dio-interleaved 2023-10-16T08:54:45.441 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_dir_type 2023-10-16T08:54:45.801 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] dio-invalidate-cache 2023-10-16T08:54:46.193 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] stat_test 2023-10-16T08:54:46.691 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_encrypted_d_revalidate 2023-10-16T08:54:47.058 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] attr_replace_test 2023-10-16T08:54:47.385 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] swapon 2023-10-16T08:54:47.759 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] mkswap 2023-10-16T08:54:48.070 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_attr_corruption 2023-10-16T08:54:48.395 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_open_tmpfiles 2023-10-16T08:54:48.764 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fscrypt-crypt-util 2023-10-16T08:54:49.628 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] bulkstat_null_ocount 2023-10-16T08:54:49.977 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] splice-test 2023-10-16T08:54:50.347 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] chprojid_fail 2023-10-16T08:54:50.708 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] detached_mounts_propagation 2023-10-16T08:54:51.077 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] ext4_resize 2023-10-16T08:54:51.395 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_readdir_3 2023-10-16T08:54:51.787 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] splice2pipe 2023-10-16T08:54:52.131 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] uuid_ioctl 2023-10-16T08:54:52.469 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fiemap-tester 2023-10-16T08:54:52.936 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_stripealign 2023-10-16T08:54:53.281 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] open_by_handle 2023-10-16T08:54:53.700 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] t_mmap_dio 2023-10-16T08:54:54.045 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] xfsfind 2023-10-16T08:54:54.425 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] fssum 2023-10-16T08:54:55.073 INFO:teuthology.orchestra.run.smithi094.stdout:Building log-writes 2023-10-16T08:54:55.087 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] replay-log 2023-10-16T08:54:55.590 INFO:teuthology.orchestra.run.smithi094.stdout:Building perf 2023-10-16T08:54:55.601 INFO:teuthology.orchestra.run.smithi094.stdout:Building aio-dio-regress 2023-10-16T08:54:55.615 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aiocp 2023-10-16T08:54:56.036 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-16T08:54:56.395 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-append-write-read-race 2023-10-16T08:54:56.759 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-cow-race 2023-10-16T08:54:57.123 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-cycle-write 2023-10-16T08:54:57.496 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-eof-race 2023-10-16T08:54:57.842 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-extend-stat 2023-10-16T08:54:58.198 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-fcntl-race 2023-10-16T08:54:58.561 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-hole-filling-race 2023-10-16T08:54:58.924 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-invalidate-failure 2023-10-16T08:54:59.309 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-invalidate-readahead 2023-10-16T08:54:59.652 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aiodio_sparse2 2023-10-16T08:55:00.092 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-subblock-eof-read 2023-10-16T08:55:00.427 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-dio-write-verify 2023-10-16T08:55:00.795 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-16T08:55:01.108 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-16T08:55:01.418 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] aio-last-ref-held-by-io 2023-10-16T08:55:01.777 INFO:teuthology.orchestra.run.smithi094.stdout:Building vfs 2023-10-16T08:55:01.791 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] vfstest 2023-10-16T08:55:03.122 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:55:03.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:55:04.230 INFO:teuthology.orchestra.run.smithi094.stdout: [CC] mount-idmapped 2023-10-16T08:55:04.814 INFO:teuthology.orchestra.run.smithi094.stdout:Building m4 2023-10-16T08:55:04.826 INFO:teuthology.orchestra.run.smithi094.stdout:Building common 2023-10-16T08:55:04.837 INFO:teuthology.orchestra.run.smithi094.stdout:Building tests 2023-10-16T08:55:04.852 INFO:teuthology.orchestra.run.smithi094.stdout:Building btrfs 2023-10-16T08:55:04.868 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/btrfs/group.list 2023-10-16T08:55:05.098 INFO:teuthology.orchestra.run.smithi094.stdout:Building ceph 2023-10-16T08:55:05.113 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ceph/group.list 2023-10-16T08:55:05.170 INFO:teuthology.orchestra.run.smithi094.stdout:Building cifs 2023-10-16T08:55:05.179 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/cifs/group.list 2023-10-16T08:55:05.225 INFO:teuthology.orchestra.run.smithi094.stdout:Building ext4 2023-10-16T08:55:05.240 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ext4/group.list 2023-10-16T08:55:05.395 INFO:teuthology.orchestra.run.smithi094.stdout:Building f2fs 2023-10-16T08:55:05.411 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/f2fs/group.list 2023-10-16T08:55:05.477 INFO:teuthology.orchestra.run.smithi094.stdout:Building generic 2023-10-16T08:55:05.496 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/generic/group.list 2023-10-16T08:55:05.844 INFO:teuthology.orchestra.run.smithi094.stdout:Building nfs 2023-10-16T08:55:05.858 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/nfs/group.list 2023-10-16T08:55:05.913 INFO:teuthology.orchestra.run.smithi094.stdout:Building ocfs2 2023-10-16T08:55:05.927 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ocfs2/group.list 2023-10-16T08:55:05.976 INFO:teuthology.orchestra.run.smithi094.stdout:Building overlay 2023-10-16T08:55:05.990 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/overlay/group.list 2023-10-16T08:55:06.148 INFO:teuthology.orchestra.run.smithi094.stdout:Building perf 2023-10-16T08:55:06.162 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/perf/group.list 2023-10-16T08:55:06.205 INFO:teuthology.orchestra.run.smithi094.stdout:Building selftest 2023-10-16T08:55:06.219 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/selftest/group.list 2023-10-16T08:55:06.265 INFO:teuthology.orchestra.run.smithi094.stdout:Building shared 2023-10-16T08:55:06.278 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/shared/group.list 2023-10-16T08:55:06.342 INFO:teuthology.orchestra.run.smithi094.stdout:Building tmpfs 2023-10-16T08:55:06.356 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/tmpfs/group.list 2023-10-16T08:55:06.404 INFO:teuthology.orchestra.run.smithi094.stdout:Building udf 2023-10-16T08:55:06.418 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/udf/group.list 2023-10-16T08:55:06.460 INFO:teuthology.orchestra.run.smithi094.stdout:Building xfs 2023-10-16T08:55:06.475 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/xfs/group.list 2023-10-16T08:55:06.854 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo make install) 2023-10-16T08:55:06.984 INFO:teuthology.orchestra.run.smithi094.stdout:Building include 2023-10-16T08:55:06.995 INFO:teuthology.orchestra.run.smithi094.stdout:Building lib 2023-10-16T08:55:07.005 INFO:teuthology.orchestra.run.smithi094.stdout:Building ltp 2023-10-16T08:55:07.017 INFO:teuthology.orchestra.run.smithi094.stdout:Building src 2023-10-16T08:55:07.104 INFO:teuthology.orchestra.run.smithi094.stdout:Building log-writes 2023-10-16T08:55:07.114 INFO:teuthology.orchestra.run.smithi094.stdout:Building perf 2023-10-16T08:55:07.125 INFO:teuthology.orchestra.run.smithi094.stdout:Building aio-dio-regress 2023-10-16T08:55:07.136 INFO:teuthology.orchestra.run.smithi094.stdout:Building vfs 2023-10-16T08:55:07.148 INFO:teuthology.orchestra.run.smithi094.stdout:Building m4 2023-10-16T08:55:07.159 INFO:teuthology.orchestra.run.smithi094.stdout:Building common 2023-10-16T08:55:07.170 INFO:teuthology.orchestra.run.smithi094.stdout:Building tests 2023-10-16T08:55:07.185 INFO:teuthology.orchestra.run.smithi094.stdout:Building btrfs 2023-10-16T08:55:07.200 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/btrfs/group.list 2023-10-16T08:55:07.408 INFO:teuthology.orchestra.run.smithi094.stdout:Building ceph 2023-10-16T08:55:07.421 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ceph/group.list 2023-10-16T08:55:07.476 INFO:teuthology.orchestra.run.smithi094.stdout:Building cifs 2023-10-16T08:55:07.490 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/cifs/group.list 2023-10-16T08:55:07.535 INFO:teuthology.orchestra.run.smithi094.stdout:Building ext4 2023-10-16T08:55:07.549 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ext4/group.list 2023-10-16T08:55:07.691 INFO:teuthology.orchestra.run.smithi094.stdout:Building f2fs 2023-10-16T08:55:07.706 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/f2fs/group.list 2023-10-16T08:55:07.771 INFO:teuthology.orchestra.run.smithi094.stdout:Building generic 2023-10-16T08:55:07.790 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/generic/group.list 2023-10-16T08:55:08.155 INFO:teuthology.orchestra.run.smithi094.stdout:Building nfs 2023-10-16T08:55:08.170 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/nfs/group.list 2023-10-16T08:55:08.224 INFO:teuthology.orchestra.run.smithi094.stdout:Building ocfs2 2023-10-16T08:55:08.240 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ocfs2/group.list 2023-10-16T08:55:08.292 INFO:teuthology.orchestra.run.smithi094.stdout:Building overlay 2023-10-16T08:55:08.307 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/overlay/group.list 2023-10-16T08:55:08.455 INFO:teuthology.orchestra.run.smithi094.stdout:Building perf 2023-10-16T08:55:08.470 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/perf/group.list 2023-10-16T08:55:08.510 INFO:teuthology.orchestra.run.smithi094.stdout:Building selftest 2023-10-16T08:55:08.524 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/selftest/group.list 2023-10-16T08:55:08.570 INFO:teuthology.orchestra.run.smithi094.stdout:Building shared 2023-10-16T08:55:08.585 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/shared/group.list 2023-10-16T08:55:08.645 INFO:teuthology.orchestra.run.smithi094.stdout:Building tmpfs 2023-10-16T08:55:08.660 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/tmpfs/group.list 2023-10-16T08:55:08.704 INFO:teuthology.orchestra.run.smithi094.stdout:Building udf 2023-10-16T08:55:08.716 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/udf/group.list 2023-10-16T08:55:08.757 INFO:teuthology.orchestra.run.smithi094.stdout:Building xfs 2023-10-16T08:55:08.774 INFO:teuthology.orchestra.run.smithi094.stdout: [GROUP] /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/xfs/group.list 2023-10-16T08:55:09.132 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-16T08:55:09.135 INFO:teuthology.orchestra.run.smithi094.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T08:55:09.136 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-16T08:55:09.140 INFO:teuthology.orchestra.run.smithi094.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T08:55:09.141 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-16T08:55:09.146 INFO:teuthology.orchestra.run.smithi094.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-16T08:55:09.180 INFO:teuthology.orchestra.run.smithi094.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-16T08:55:09.413 INFO:teuthology.orchestra.run.smithi094.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-16T08:55:09.445 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-16T08:55:09.491 INFO:teuthology.orchestra.run.smithi094.stdout:Building log-writes 2023-10-16T08:55:09.502 INFO:teuthology.orchestra.run.smithi094.stdout:Building perf 2023-10-16T08:55:09.514 INFO:teuthology.orchestra.run.smithi094.stdout:Building aio-dio-regress 2023-10-16T08:55:09.525 INFO:teuthology.orchestra.run.smithi094.stdout:Building vfs 2023-10-16T08:55:09.534 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake -C log-writes install 2023-10-16T08:55:09.537 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-16T08:55:09.571 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-16T08:55:09.601 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake -C perf install 2023-10-16T08:55:09.604 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-16T08:55:09.640 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-16T08:55:09.729 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-16T08:55:09.733 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-16T08:55:09.768 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-10-16T08:55:09.974 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake -C vfs install 2023-10-16T08:55:09.977 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-16T08:55:10.012 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-16T08:55:10.057 INFO:teuthology.orchestra.run.smithi094.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-16T08:55:10.090 INFO:teuthology.orchestra.run.smithi094.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-16T08:55:14.506 INFO:teuthology.orchestra.run.smithi094.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-16T08:55:14.855 INFO:teuthology.orchestra.run.smithi094.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-16T08:55:14.927 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-16T08:55:14.931 INFO:teuthology.orchestra.run.smithi094.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T08:55:14.931 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-16T08:55:14.935 INFO:teuthology.orchestra.run.smithi094.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-16T08:55:14.969 INFO:teuthology.orchestra.run.smithi094.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-16T08:55:15.480 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-16T08:55:15.484 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/btrfs/ install 2023-10-16T08:55:15.491 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-16T08:55:15.525 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-16T08:55:18.712 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-16T08:55:18.749 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 299.out 300.out /var/lib/xfstests/tests/btrfs 2023-10-16T08:55:22.028 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ceph/ install 2023-10-16T08:55:22.032 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-16T08:55:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-16T08:55:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-16T08:55:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-10-16T08:55:22.254 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/cifs/ install 2023-10-16T08:55:22.258 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-16T08:55:22.291 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-16T08:55:22.324 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-16T08:55:22.357 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-16T08:55:22.391 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ext4/ install 2023-10-16T08:55:22.395 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-16T08:55:22.431 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-16T08:55:23.183 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-16T08:55:23.217 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-10-16T08:55:24.007 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/f2fs/ install 2023-10-16T08:55:24.011 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-16T08:55:24.044 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-16T08:55:24.087 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-16T08:55:24.120 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-16T08:55:24.164 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/generic/ install 2023-10-16T08:55:24.174 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-16T08:55:24.207 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-16T08:55:32.708 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-16T08:55:32.742 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out /var/lib/xfstests/tests/generic 2023-10-16T08:55:33.268 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:55:33.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:55:41.134 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/nfs/ install 2023-10-16T08:55:41.139 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-16T08:55:41.173 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-16T08:55:41.207 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-16T08:55:41.240 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-16T08:55:41.273 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/ocfs2/ install 2023-10-16T08:55:41.277 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-16T08:55:41.310 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-16T08:55:41.345 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-16T08:55:41.375 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-16T08:55:41.407 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/overlay/ install 2023-10-16T08:55:41.412 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-16T08:55:41.442 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-16T08:55:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-16T08:55:42.616 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-10-16T08:55:43.675 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/perf/ install 2023-10-16T08:55:43.679 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-16T08:55:43.712 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-16T08:55:43.745 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-16T08:55:43.778 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-16T08:55:43.811 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/selftest/ install 2023-10-16T08:55:43.814 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-16T08:55:43.848 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-16T08:55:43.931 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-16T08:55:43.965 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-10-16T08:55:44.051 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/shared/ install 2023-10-16T08:55:44.054 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-16T08:55:44.088 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-16T08:55:44.139 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-16T08:55:44.172 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-10-16T08:55:44.227 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/tmpfs/ install 2023-10-16T08:55:44.232 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-16T08:55:44.264 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-16T08:55:44.298 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-16T08:55:44.329 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-16T08:55:44.364 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/udf/ install 2023-10-16T08:55:44.368 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-16T08:55:44.401 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-16T08:55:44.435 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-16T08:55:44.469 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-16T08:55:44.502 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.tcp0mkZMHZxfstests-dev/tests/xfs/ install 2023-10-16T08:55:44.512 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-16T08:55:44.546 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-16T08:55:52.500 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-16T08:55:52.536 INFO:teuthology.orchestra.run.smithi094.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-10-16T08:56:00.666 INFO:teuthology.orchestra.run.smithi094.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-16T08:56:00.699 INFO:teuthology.orchestra.run.smithi094.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-16T08:56:00.733 INFO:teuthology.orchestra.run.smithi094.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-16T08:56:00.765 INFO:teuthology.orchestra.run.smithi094.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-16T08:56:00.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T08:56:00.804 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec ls tests/generic) 2023-10-16T08:56:00.862 INFO:teuthology.orchestra.run.smithi094.stdout:001 2023-10-16T08:56:00.862 INFO:teuthology.orchestra.run.smithi094.stdout:001.out 2023-10-16T08:56:00.862 INFO:teuthology.orchestra.run.smithi094.stdout:002 2023-10-16T08:56:00.862 INFO:teuthology.orchestra.run.smithi094.stdout:002.out 2023-10-16T08:56:00.863 INFO:teuthology.orchestra.run.smithi094.stdout:003 2023-10-16T08:56:00.863 INFO:teuthology.orchestra.run.smithi094.stdout:003.out 2023-10-16T08:56:00.863 INFO:teuthology.orchestra.run.smithi094.stdout:004 2023-10-16T08:56:00.863 INFO:teuthology.orchestra.run.smithi094.stdout:004.out 2023-10-16T08:56:00.863 INFO:teuthology.orchestra.run.smithi094.stdout:005 2023-10-16T08:56:00.864 INFO:teuthology.orchestra.run.smithi094.stdout:005.out 2023-10-16T08:56:00.864 INFO:teuthology.orchestra.run.smithi094.stdout:006 2023-10-16T08:56:00.864 INFO:teuthology.orchestra.run.smithi094.stdout:006.out 2023-10-16T08:56:00.864 INFO:teuthology.orchestra.run.smithi094.stdout:007 2023-10-16T08:56:00.864 INFO:teuthology.orchestra.run.smithi094.stdout:007.out 2023-10-16T08:56:00.864 INFO:teuthology.orchestra.run.smithi094.stdout:008 2023-10-16T08:56:00.865 INFO:teuthology.orchestra.run.smithi094.stdout:008.out 2023-10-16T08:56:00.865 INFO:teuthology.orchestra.run.smithi094.stdout:009 2023-10-16T08:56:00.865 INFO:teuthology.orchestra.run.smithi094.stdout:009.out 2023-10-16T08:56:00.865 INFO:teuthology.orchestra.run.smithi094.stdout:010 2023-10-16T08:56:00.865 INFO:teuthology.orchestra.run.smithi094.stdout:010.out 2023-10-16T08:56:00.866 INFO:teuthology.orchestra.run.smithi094.stdout:011 2023-10-16T08:56:00.866 INFO:teuthology.orchestra.run.smithi094.stdout:011.out 2023-10-16T08:56:00.866 INFO:teuthology.orchestra.run.smithi094.stdout:012 2023-10-16T08:56:00.866 INFO:teuthology.orchestra.run.smithi094.stdout:012.out 2023-10-16T08:56:00.866 INFO:teuthology.orchestra.run.smithi094.stdout:013 2023-10-16T08:56:00.867 INFO:teuthology.orchestra.run.smithi094.stdout:013.out 2023-10-16T08:56:00.867 INFO:teuthology.orchestra.run.smithi094.stdout:014 2023-10-16T08:56:00.867 INFO:teuthology.orchestra.run.smithi094.stdout:014.out 2023-10-16T08:56:00.867 INFO:teuthology.orchestra.run.smithi094.stdout:015 2023-10-16T08:56:00.867 INFO:teuthology.orchestra.run.smithi094.stdout:015.out 2023-10-16T08:56:00.867 INFO:teuthology.orchestra.run.smithi094.stdout:016 2023-10-16T08:56:00.868 INFO:teuthology.orchestra.run.smithi094.stdout:016.out 2023-10-16T08:56:00.868 INFO:teuthology.orchestra.run.smithi094.stdout:017 2023-10-16T08:56:00.868 INFO:teuthology.orchestra.run.smithi094.stdout:017.out 2023-10-16T08:56:00.868 INFO:teuthology.orchestra.run.smithi094.stdout:018 2023-10-16T08:56:00.868 INFO:teuthology.orchestra.run.smithi094.stdout:018.out 2023-10-16T08:56:00.869 INFO:teuthology.orchestra.run.smithi094.stdout:019 2023-10-16T08:56:00.869 INFO:teuthology.orchestra.run.smithi094.stdout:019.out 2023-10-16T08:56:00.869 INFO:teuthology.orchestra.run.smithi094.stdout:020 2023-10-16T08:56:00.869 INFO:teuthology.orchestra.run.smithi094.stdout:020.out 2023-10-16T08:56:00.869 INFO:teuthology.orchestra.run.smithi094.stdout:021 2023-10-16T08:56:00.870 INFO:teuthology.orchestra.run.smithi094.stdout:021.out 2023-10-16T08:56:00.870 INFO:teuthology.orchestra.run.smithi094.stdout:022 2023-10-16T08:56:00.870 INFO:teuthology.orchestra.run.smithi094.stdout:022.out 2023-10-16T08:56:00.870 INFO:teuthology.orchestra.run.smithi094.stdout:023 2023-10-16T08:56:00.870 INFO:teuthology.orchestra.run.smithi094.stdout:023.out 2023-10-16T08:56:00.870 INFO:teuthology.orchestra.run.smithi094.stdout:024 2023-10-16T08:56:00.871 INFO:teuthology.orchestra.run.smithi094.stdout:024.out 2023-10-16T08:56:00.871 INFO:teuthology.orchestra.run.smithi094.stdout:025 2023-10-16T08:56:00.871 INFO:teuthology.orchestra.run.smithi094.stdout:025.out 2023-10-16T08:56:00.871 INFO:teuthology.orchestra.run.smithi094.stdout:026 2023-10-16T08:56:00.871 INFO:teuthology.orchestra.run.smithi094.stdout:026.out 2023-10-16T08:56:00.872 INFO:teuthology.orchestra.run.smithi094.stdout:027 2023-10-16T08:56:00.872 INFO:teuthology.orchestra.run.smithi094.stdout:027.out 2023-10-16T08:56:00.872 INFO:teuthology.orchestra.run.smithi094.stdout:028 2023-10-16T08:56:00.872 INFO:teuthology.orchestra.run.smithi094.stdout:028.out 2023-10-16T08:56:00.872 INFO:teuthology.orchestra.run.smithi094.stdout:029 2023-10-16T08:56:00.873 INFO:teuthology.orchestra.run.smithi094.stdout:029.out 2023-10-16T08:56:00.873 INFO:teuthology.orchestra.run.smithi094.stdout:030 2023-10-16T08:56:00.873 INFO:teuthology.orchestra.run.smithi094.stdout:030.out 2023-10-16T08:56:00.873 INFO:teuthology.orchestra.run.smithi094.stdout:031 2023-10-16T08:56:00.873 INFO:teuthology.orchestra.run.smithi094.stdout:031.out 2023-10-16T08:56:00.874 INFO:teuthology.orchestra.run.smithi094.stdout:032 2023-10-16T08:56:00.874 INFO:teuthology.orchestra.run.smithi094.stdout:032.out 2023-10-16T08:56:00.874 INFO:teuthology.orchestra.run.smithi094.stdout:033 2023-10-16T08:56:00.874 INFO:teuthology.orchestra.run.smithi094.stdout:033.out 2023-10-16T08:56:00.874 INFO:teuthology.orchestra.run.smithi094.stdout:034 2023-10-16T08:56:00.874 INFO:teuthology.orchestra.run.smithi094.stdout:034.out 2023-10-16T08:56:00.875 INFO:teuthology.orchestra.run.smithi094.stdout:035 2023-10-16T08:56:00.875 INFO:teuthology.orchestra.run.smithi094.stdout:035.cfg 2023-10-16T08:56:00.875 INFO:teuthology.orchestra.run.smithi094.stdout:035.out.default 2023-10-16T08:56:00.875 INFO:teuthology.orchestra.run.smithi094.stdout:035.out.nfs 2023-10-16T08:56:00.875 INFO:teuthology.orchestra.run.smithi094.stdout:036 2023-10-16T08:56:00.876 INFO:teuthology.orchestra.run.smithi094.stdout:036.out 2023-10-16T08:56:00.876 INFO:teuthology.orchestra.run.smithi094.stdout:037 2023-10-16T08:56:00.876 INFO:teuthology.orchestra.run.smithi094.stdout:037.out 2023-10-16T08:56:00.876 INFO:teuthology.orchestra.run.smithi094.stdout:038 2023-10-16T08:56:00.876 INFO:teuthology.orchestra.run.smithi094.stdout:038.out 2023-10-16T08:56:00.876 INFO:teuthology.orchestra.run.smithi094.stdout:039 2023-10-16T08:56:00.877 INFO:teuthology.orchestra.run.smithi094.stdout:039.out 2023-10-16T08:56:00.877 INFO:teuthology.orchestra.run.smithi094.stdout:040 2023-10-16T08:56:00.877 INFO:teuthology.orchestra.run.smithi094.stdout:040.out 2023-10-16T08:56:00.877 INFO:teuthology.orchestra.run.smithi094.stdout:041 2023-10-16T08:56:00.877 INFO:teuthology.orchestra.run.smithi094.stdout:041.out 2023-10-16T08:56:00.878 INFO:teuthology.orchestra.run.smithi094.stdout:042 2023-10-16T08:56:00.878 INFO:teuthology.orchestra.run.smithi094.stdout:042.out 2023-10-16T08:56:00.878 INFO:teuthology.orchestra.run.smithi094.stdout:043 2023-10-16T08:56:00.878 INFO:teuthology.orchestra.run.smithi094.stdout:043.out 2023-10-16T08:56:00.878 INFO:teuthology.orchestra.run.smithi094.stdout:044 2023-10-16T08:56:00.879 INFO:teuthology.orchestra.run.smithi094.stdout:044.out 2023-10-16T08:56:00.879 INFO:teuthology.orchestra.run.smithi094.stdout:045 2023-10-16T08:56:00.879 INFO:teuthology.orchestra.run.smithi094.stdout:045.out 2023-10-16T08:56:00.879 INFO:teuthology.orchestra.run.smithi094.stdout:046 2023-10-16T08:56:00.879 INFO:teuthology.orchestra.run.smithi094.stdout:046.out 2023-10-16T08:56:00.880 INFO:teuthology.orchestra.run.smithi094.stdout:047 2023-10-16T08:56:00.880 INFO:teuthology.orchestra.run.smithi094.stdout:047.out 2023-10-16T08:56:00.880 INFO:teuthology.orchestra.run.smithi094.stdout:048 2023-10-16T08:56:00.880 INFO:teuthology.orchestra.run.smithi094.stdout:048.out 2023-10-16T08:56:00.880 INFO:teuthology.orchestra.run.smithi094.stdout:049 2023-10-16T08:56:00.880 INFO:teuthology.orchestra.run.smithi094.stdout:049.out 2023-10-16T08:56:00.881 INFO:teuthology.orchestra.run.smithi094.stdout:050 2023-10-16T08:56:00.881 INFO:teuthology.orchestra.run.smithi094.stdout:050.cfg 2023-10-16T08:56:00.881 INFO:teuthology.orchestra.run.smithi094.stdout:050.out.default 2023-10-16T08:56:00.881 INFO:teuthology.orchestra.run.smithi094.stdout:050.out.nojournal 2023-10-16T08:56:00.881 INFO:teuthology.orchestra.run.smithi094.stdout:050.out.xfsquota 2023-10-16T08:56:00.882 INFO:teuthology.orchestra.run.smithi094.stdout:051 2023-10-16T08:56:00.882 INFO:teuthology.orchestra.run.smithi094.stdout:051.out 2023-10-16T08:56:00.882 INFO:teuthology.orchestra.run.smithi094.stdout:052 2023-10-16T08:56:00.882 INFO:teuthology.orchestra.run.smithi094.stdout:052.out 2023-10-16T08:56:00.882 INFO:teuthology.orchestra.run.smithi094.stdout:053 2023-10-16T08:56:00.883 INFO:teuthology.orchestra.run.smithi094.stdout:053.out 2023-10-16T08:56:00.883 INFO:teuthology.orchestra.run.smithi094.stdout:054 2023-10-16T08:56:00.883 INFO:teuthology.orchestra.run.smithi094.stdout:054.out 2023-10-16T08:56:00.883 INFO:teuthology.orchestra.run.smithi094.stdout:055 2023-10-16T08:56:00.883 INFO:teuthology.orchestra.run.smithi094.stdout:055.out 2023-10-16T08:56:00.884 INFO:teuthology.orchestra.run.smithi094.stdout:056 2023-10-16T08:56:00.884 INFO:teuthology.orchestra.run.smithi094.stdout:056.out 2023-10-16T08:56:00.884 INFO:teuthology.orchestra.run.smithi094.stdout:057 2023-10-16T08:56:00.884 INFO:teuthology.orchestra.run.smithi094.stdout:057.out 2023-10-16T08:56:00.884 INFO:teuthology.orchestra.run.smithi094.stdout:058 2023-10-16T08:56:00.885 INFO:teuthology.orchestra.run.smithi094.stdout:058.out 2023-10-16T08:56:00.885 INFO:teuthology.orchestra.run.smithi094.stdout:059 2023-10-16T08:56:00.885 INFO:teuthology.orchestra.run.smithi094.stdout:059.out 2023-10-16T08:56:00.885 INFO:teuthology.orchestra.run.smithi094.stdout:060 2023-10-16T08:56:00.885 INFO:teuthology.orchestra.run.smithi094.stdout:060.out 2023-10-16T08:56:00.886 INFO:teuthology.orchestra.run.smithi094.stdout:061 2023-10-16T08:56:00.886 INFO:teuthology.orchestra.run.smithi094.stdout:061.out 2023-10-16T08:56:00.886 INFO:teuthology.orchestra.run.smithi094.stdout:062 2023-10-16T08:56:00.886 INFO:teuthology.orchestra.run.smithi094.stdout:062.out 2023-10-16T08:56:00.886 INFO:teuthology.orchestra.run.smithi094.stdout:063 2023-10-16T08:56:00.887 INFO:teuthology.orchestra.run.smithi094.stdout:063.out 2023-10-16T08:56:00.887 INFO:teuthology.orchestra.run.smithi094.stdout:064 2023-10-16T08:56:00.887 INFO:teuthology.orchestra.run.smithi094.stdout:064.out 2023-10-16T08:56:00.887 INFO:teuthology.orchestra.run.smithi094.stdout:065 2023-10-16T08:56:00.887 INFO:teuthology.orchestra.run.smithi094.stdout:065.out 2023-10-16T08:56:00.887 INFO:teuthology.orchestra.run.smithi094.stdout:066 2023-10-16T08:56:00.888 INFO:teuthology.orchestra.run.smithi094.stdout:066.out 2023-10-16T08:56:00.888 INFO:teuthology.orchestra.run.smithi094.stdout:067 2023-10-16T08:56:00.888 INFO:teuthology.orchestra.run.smithi094.stdout:067.out 2023-10-16T08:56:00.888 INFO:teuthology.orchestra.run.smithi094.stdout:068 2023-10-16T08:56:00.888 INFO:teuthology.orchestra.run.smithi094.stdout:068.out 2023-10-16T08:56:00.889 INFO:teuthology.orchestra.run.smithi094.stdout:069 2023-10-16T08:56:00.889 INFO:teuthology.orchestra.run.smithi094.stdout:069.out 2023-10-16T08:56:00.889 INFO:teuthology.orchestra.run.smithi094.stdout:070 2023-10-16T08:56:00.889 INFO:teuthology.orchestra.run.smithi094.stdout:070.out 2023-10-16T08:56:00.889 INFO:teuthology.orchestra.run.smithi094.stdout:071 2023-10-16T08:56:00.890 INFO:teuthology.orchestra.run.smithi094.stdout:071.out 2023-10-16T08:56:00.890 INFO:teuthology.orchestra.run.smithi094.stdout:072 2023-10-16T08:56:00.890 INFO:teuthology.orchestra.run.smithi094.stdout:072.out 2023-10-16T08:56:00.890 INFO:teuthology.orchestra.run.smithi094.stdout:073 2023-10-16T08:56:00.890 INFO:teuthology.orchestra.run.smithi094.stdout:073.out 2023-10-16T08:56:00.891 INFO:teuthology.orchestra.run.smithi094.stdout:074 2023-10-16T08:56:00.891 INFO:teuthology.orchestra.run.smithi094.stdout:074.out 2023-10-16T08:56:00.891 INFO:teuthology.orchestra.run.smithi094.stdout:075 2023-10-16T08:56:00.891 INFO:teuthology.orchestra.run.smithi094.stdout:075.out 2023-10-16T08:56:00.891 INFO:teuthology.orchestra.run.smithi094.stdout:076 2023-10-16T08:56:00.892 INFO:teuthology.orchestra.run.smithi094.stdout:076.out 2023-10-16T08:56:00.892 INFO:teuthology.orchestra.run.smithi094.stdout:077 2023-10-16T08:56:00.892 INFO:teuthology.orchestra.run.smithi094.stdout:077.out 2023-10-16T08:56:00.892 INFO:teuthology.orchestra.run.smithi094.stdout:078 2023-10-16T08:56:00.892 INFO:teuthology.orchestra.run.smithi094.stdout:078.out 2023-10-16T08:56:00.893 INFO:teuthology.orchestra.run.smithi094.stdout:079 2023-10-16T08:56:00.893 INFO:teuthology.orchestra.run.smithi094.stdout:079.out 2023-10-16T08:56:00.893 INFO:teuthology.orchestra.run.smithi094.stdout:080 2023-10-16T08:56:00.893 INFO:teuthology.orchestra.run.smithi094.stdout:080.out 2023-10-16T08:56:00.893 INFO:teuthology.orchestra.run.smithi094.stdout:081 2023-10-16T08:56:00.894 INFO:teuthology.orchestra.run.smithi094.stdout:081.out 2023-10-16T08:56:00.894 INFO:teuthology.orchestra.run.smithi094.stdout:082 2023-10-16T08:56:00.894 INFO:teuthology.orchestra.run.smithi094.stdout:082.out 2023-10-16T08:56:00.894 INFO:teuthology.orchestra.run.smithi094.stdout:083 2023-10-16T08:56:00.894 INFO:teuthology.orchestra.run.smithi094.stdout:083.out 2023-10-16T08:56:00.895 INFO:teuthology.orchestra.run.smithi094.stdout:084 2023-10-16T08:56:00.895 INFO:teuthology.orchestra.run.smithi094.stdout:084.out 2023-10-16T08:56:00.895 INFO:teuthology.orchestra.run.smithi094.stdout:085 2023-10-16T08:56:00.895 INFO:teuthology.orchestra.run.smithi094.stdout:085.out 2023-10-16T08:56:00.895 INFO:teuthology.orchestra.run.smithi094.stdout:086 2023-10-16T08:56:00.895 INFO:teuthology.orchestra.run.smithi094.stdout:086.out 2023-10-16T08:56:00.896 INFO:teuthology.orchestra.run.smithi094.stdout:087 2023-10-16T08:56:00.896 INFO:teuthology.orchestra.run.smithi094.stdout:087.out 2023-10-16T08:56:00.896 INFO:teuthology.orchestra.run.smithi094.stdout:088 2023-10-16T08:56:00.896 INFO:teuthology.orchestra.run.smithi094.stdout:088.out 2023-10-16T08:56:00.896 INFO:teuthology.orchestra.run.smithi094.stdout:089 2023-10-16T08:56:00.896 INFO:teuthology.orchestra.run.smithi094.stdout:089.out 2023-10-16T08:56:00.897 INFO:teuthology.orchestra.run.smithi094.stdout:090 2023-10-16T08:56:00.897 INFO:teuthology.orchestra.run.smithi094.stdout:090.out 2023-10-16T08:56:00.897 INFO:teuthology.orchestra.run.smithi094.stdout:091 2023-10-16T08:56:00.897 INFO:teuthology.orchestra.run.smithi094.stdout:091.out 2023-10-16T08:56:00.897 INFO:teuthology.orchestra.run.smithi094.stdout:092 2023-10-16T08:56:00.897 INFO:teuthology.orchestra.run.smithi094.stdout:092.out 2023-10-16T08:56:00.898 INFO:teuthology.orchestra.run.smithi094.stdout:093 2023-10-16T08:56:00.898 INFO:teuthology.orchestra.run.smithi094.stdout:093.out 2023-10-16T08:56:00.898 INFO:teuthology.orchestra.run.smithi094.stdout:094 2023-10-16T08:56:00.898 INFO:teuthology.orchestra.run.smithi094.stdout:094.out 2023-10-16T08:56:00.898 INFO:teuthology.orchestra.run.smithi094.stdout:095 2023-10-16T08:56:00.899 INFO:teuthology.orchestra.run.smithi094.stdout:095.out 2023-10-16T08:56:00.899 INFO:teuthology.orchestra.run.smithi094.stdout:096 2023-10-16T08:56:00.899 INFO:teuthology.orchestra.run.smithi094.stdout:096.out 2023-10-16T08:56:00.899 INFO:teuthology.orchestra.run.smithi094.stdout:097 2023-10-16T08:56:00.899 INFO:teuthology.orchestra.run.smithi094.stdout:097.out 2023-10-16T08:56:00.900 INFO:teuthology.orchestra.run.smithi094.stdout:098 2023-10-16T08:56:00.900 INFO:teuthology.orchestra.run.smithi094.stdout:098.out 2023-10-16T08:56:00.900 INFO:teuthology.orchestra.run.smithi094.stdout:099 2023-10-16T08:56:00.900 INFO:teuthology.orchestra.run.smithi094.stdout:099.out 2023-10-16T08:56:00.900 INFO:teuthology.orchestra.run.smithi094.stdout:100 2023-10-16T08:56:00.900 INFO:teuthology.orchestra.run.smithi094.stdout:100.out 2023-10-16T08:56:00.901 INFO:teuthology.orchestra.run.smithi094.stdout:101 2023-10-16T08:56:00.901 INFO:teuthology.orchestra.run.smithi094.stdout:101.out 2023-10-16T08:56:00.901 INFO:teuthology.orchestra.run.smithi094.stdout:102 2023-10-16T08:56:00.901 INFO:teuthology.orchestra.run.smithi094.stdout:102.out 2023-10-16T08:56:00.901 INFO:teuthology.orchestra.run.smithi094.stdout:103 2023-10-16T08:56:00.902 INFO:teuthology.orchestra.run.smithi094.stdout:103.out 2023-10-16T08:56:00.902 INFO:teuthology.orchestra.run.smithi094.stdout:104 2023-10-16T08:56:00.902 INFO:teuthology.orchestra.run.smithi094.stdout:104.out 2023-10-16T08:56:00.902 INFO:teuthology.orchestra.run.smithi094.stdout:105 2023-10-16T08:56:00.902 INFO:teuthology.orchestra.run.smithi094.stdout:105.out 2023-10-16T08:56:00.903 INFO:teuthology.orchestra.run.smithi094.stdout:106 2023-10-16T08:56:00.903 INFO:teuthology.orchestra.run.smithi094.stdout:106.out 2023-10-16T08:56:00.903 INFO:teuthology.orchestra.run.smithi094.stdout:107 2023-10-16T08:56:00.903 INFO:teuthology.orchestra.run.smithi094.stdout:107.out 2023-10-16T08:56:00.903 INFO:teuthology.orchestra.run.smithi094.stdout:108 2023-10-16T08:56:00.904 INFO:teuthology.orchestra.run.smithi094.stdout:108.out 2023-10-16T08:56:00.904 INFO:teuthology.orchestra.run.smithi094.stdout:109 2023-10-16T08:56:00.904 INFO:teuthology.orchestra.run.smithi094.stdout:109.out 2023-10-16T08:56:00.904 INFO:teuthology.orchestra.run.smithi094.stdout:110 2023-10-16T08:56:00.904 INFO:teuthology.orchestra.run.smithi094.stdout:110.out 2023-10-16T08:56:00.904 INFO:teuthology.orchestra.run.smithi094.stdout:111 2023-10-16T08:56:00.905 INFO:teuthology.orchestra.run.smithi094.stdout:111.out 2023-10-16T08:56:00.905 INFO:teuthology.orchestra.run.smithi094.stdout:112 2023-10-16T08:56:00.905 INFO:teuthology.orchestra.run.smithi094.stdout:112.out 2023-10-16T08:56:00.905 INFO:teuthology.orchestra.run.smithi094.stdout:113 2023-10-16T08:56:00.905 INFO:teuthology.orchestra.run.smithi094.stdout:113.out 2023-10-16T08:56:00.906 INFO:teuthology.orchestra.run.smithi094.stdout:114 2023-10-16T08:56:00.906 INFO:teuthology.orchestra.run.smithi094.stdout:114.out 2023-10-16T08:56:00.906 INFO:teuthology.orchestra.run.smithi094.stdout:115 2023-10-16T08:56:00.906 INFO:teuthology.orchestra.run.smithi094.stdout:115.out 2023-10-16T08:56:00.906 INFO:teuthology.orchestra.run.smithi094.stdout:116 2023-10-16T08:56:00.906 INFO:teuthology.orchestra.run.smithi094.stdout:116.out 2023-10-16T08:56:00.907 INFO:teuthology.orchestra.run.smithi094.stdout:117 2023-10-16T08:56:00.907 INFO:teuthology.orchestra.run.smithi094.stdout:117.out 2023-10-16T08:56:00.907 INFO:teuthology.orchestra.run.smithi094.stdout:118 2023-10-16T08:56:00.907 INFO:teuthology.orchestra.run.smithi094.stdout:118.out 2023-10-16T08:56:00.907 INFO:teuthology.orchestra.run.smithi094.stdout:119 2023-10-16T08:56:00.908 INFO:teuthology.orchestra.run.smithi094.stdout:119.out 2023-10-16T08:56:00.908 INFO:teuthology.orchestra.run.smithi094.stdout:120 2023-10-16T08:56:00.908 INFO:teuthology.orchestra.run.smithi094.stdout:120.out 2023-10-16T08:56:00.908 INFO:teuthology.orchestra.run.smithi094.stdout:121 2023-10-16T08:56:00.908 INFO:teuthology.orchestra.run.smithi094.stdout:121.out 2023-10-16T08:56:00.908 INFO:teuthology.orchestra.run.smithi094.stdout:122 2023-10-16T08:56:00.909 INFO:teuthology.orchestra.run.smithi094.stdout:122.out 2023-10-16T08:56:00.909 INFO:teuthology.orchestra.run.smithi094.stdout:123 2023-10-16T08:56:00.909 INFO:teuthology.orchestra.run.smithi094.stdout:123.out 2023-10-16T08:56:00.909 INFO:teuthology.orchestra.run.smithi094.stdout:124 2023-10-16T08:56:00.909 INFO:teuthology.orchestra.run.smithi094.stdout:124.out 2023-10-16T08:56:00.910 INFO:teuthology.orchestra.run.smithi094.stdout:125 2023-10-16T08:56:00.910 INFO:teuthology.orchestra.run.smithi094.stdout:125.out 2023-10-16T08:56:00.910 INFO:teuthology.orchestra.run.smithi094.stdout:126 2023-10-16T08:56:00.910 INFO:teuthology.orchestra.run.smithi094.stdout:126.out 2023-10-16T08:56:00.910 INFO:teuthology.orchestra.run.smithi094.stdout:127 2023-10-16T08:56:00.911 INFO:teuthology.orchestra.run.smithi094.stdout:127.out 2023-10-16T08:56:00.911 INFO:teuthology.orchestra.run.smithi094.stdout:128 2023-10-16T08:56:00.911 INFO:teuthology.orchestra.run.smithi094.stdout:128.out 2023-10-16T08:56:00.911 INFO:teuthology.orchestra.run.smithi094.stdout:129 2023-10-16T08:56:00.911 INFO:teuthology.orchestra.run.smithi094.stdout:129.out 2023-10-16T08:56:00.912 INFO:teuthology.orchestra.run.smithi094.stdout:130 2023-10-16T08:56:00.912 INFO:teuthology.orchestra.run.smithi094.stdout:130.out 2023-10-16T08:56:00.912 INFO:teuthology.orchestra.run.smithi094.stdout:131 2023-10-16T08:56:00.912 INFO:teuthology.orchestra.run.smithi094.stdout:131.out 2023-10-16T08:56:00.912 INFO:teuthology.orchestra.run.smithi094.stdout:132 2023-10-16T08:56:00.912 INFO:teuthology.orchestra.run.smithi094.stdout:132.out 2023-10-16T08:56:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:133 2023-10-16T08:56:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:133.out 2023-10-16T08:56:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:134 2023-10-16T08:56:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:134.out 2023-10-16T08:56:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:135 2023-10-16T08:56:00.914 INFO:teuthology.orchestra.run.smithi094.stdout:135.out 2023-10-16T08:56:00.914 INFO:teuthology.orchestra.run.smithi094.stdout:136 2023-10-16T08:56:00.914 INFO:teuthology.orchestra.run.smithi094.stdout:136.out 2023-10-16T08:56:00.914 INFO:teuthology.orchestra.run.smithi094.stdout:137 2023-10-16T08:56:00.914 INFO:teuthology.orchestra.run.smithi094.stdout:137.out 2023-10-16T08:56:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:138 2023-10-16T08:56:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:138.out 2023-10-16T08:56:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:139 2023-10-16T08:56:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:139.out 2023-10-16T08:56:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:140 2023-10-16T08:56:00.915 INFO:teuthology.orchestra.run.smithi094.stdout:140.out 2023-10-16T08:56:00.916 INFO:teuthology.orchestra.run.smithi094.stdout:141 2023-10-16T08:56:00.916 INFO:teuthology.orchestra.run.smithi094.stdout:141.out 2023-10-16T08:56:00.916 INFO:teuthology.orchestra.run.smithi094.stdout:142 2023-10-16T08:56:00.916 INFO:teuthology.orchestra.run.smithi094.stdout:142.out 2023-10-16T08:56:00.916 INFO:teuthology.orchestra.run.smithi094.stdout:143 2023-10-16T08:56:00.917 INFO:teuthology.orchestra.run.smithi094.stdout:143.out 2023-10-16T08:56:00.917 INFO:teuthology.orchestra.run.smithi094.stdout:144 2023-10-16T08:56:00.917 INFO:teuthology.orchestra.run.smithi094.stdout:144.out 2023-10-16T08:56:00.917 INFO:teuthology.orchestra.run.smithi094.stdout:145 2023-10-16T08:56:00.917 INFO:teuthology.orchestra.run.smithi094.stdout:145.out 2023-10-16T08:56:00.918 INFO:teuthology.orchestra.run.smithi094.stdout:146 2023-10-16T08:56:00.918 INFO:teuthology.orchestra.run.smithi094.stdout:146.out 2023-10-16T08:56:00.918 INFO:teuthology.orchestra.run.smithi094.stdout:147 2023-10-16T08:56:00.918 INFO:teuthology.orchestra.run.smithi094.stdout:147.out 2023-10-16T08:56:00.918 INFO:teuthology.orchestra.run.smithi094.stdout:148 2023-10-16T08:56:00.919 INFO:teuthology.orchestra.run.smithi094.stdout:148.out 2023-10-16T08:56:00.919 INFO:teuthology.orchestra.run.smithi094.stdout:149 2023-10-16T08:56:00.919 INFO:teuthology.orchestra.run.smithi094.stdout:149.out 2023-10-16T08:56:00.919 INFO:teuthology.orchestra.run.smithi094.stdout:150 2023-10-16T08:56:00.919 INFO:teuthology.orchestra.run.smithi094.stdout:150.out 2023-10-16T08:56:00.919 INFO:teuthology.orchestra.run.smithi094.stdout:151 2023-10-16T08:56:00.920 INFO:teuthology.orchestra.run.smithi094.stdout:151.out 2023-10-16T08:56:00.920 INFO:teuthology.orchestra.run.smithi094.stdout:152 2023-10-16T08:56:00.920 INFO:teuthology.orchestra.run.smithi094.stdout:152.out 2023-10-16T08:56:00.920 INFO:teuthology.orchestra.run.smithi094.stdout:153 2023-10-16T08:56:00.920 INFO:teuthology.orchestra.run.smithi094.stdout:153.out 2023-10-16T08:56:00.920 INFO:teuthology.orchestra.run.smithi094.stdout:154 2023-10-16T08:56:00.921 INFO:teuthology.orchestra.run.smithi094.stdout:154.out 2023-10-16T08:56:00.921 INFO:teuthology.orchestra.run.smithi094.stdout:155 2023-10-16T08:56:00.921 INFO:teuthology.orchestra.run.smithi094.stdout:155.out 2023-10-16T08:56:00.921 INFO:teuthology.orchestra.run.smithi094.stdout:156 2023-10-16T08:56:00.921 INFO:teuthology.orchestra.run.smithi094.stdout:156.out 2023-10-16T08:56:00.922 INFO:teuthology.orchestra.run.smithi094.stdout:157 2023-10-16T08:56:00.922 INFO:teuthology.orchestra.run.smithi094.stdout:157.out 2023-10-16T08:56:00.922 INFO:teuthology.orchestra.run.smithi094.stdout:158 2023-10-16T08:56:00.922 INFO:teuthology.orchestra.run.smithi094.stdout:158.out 2023-10-16T08:56:00.922 INFO:teuthology.orchestra.run.smithi094.stdout:159 2023-10-16T08:56:00.923 INFO:teuthology.orchestra.run.smithi094.stdout:159.out 2023-10-16T08:56:00.923 INFO:teuthology.orchestra.run.smithi094.stdout:160 2023-10-16T08:56:00.923 INFO:teuthology.orchestra.run.smithi094.stdout:160.out 2023-10-16T08:56:00.923 INFO:teuthology.orchestra.run.smithi094.stdout:161 2023-10-16T08:56:00.923 INFO:teuthology.orchestra.run.smithi094.stdout:161.out 2023-10-16T08:56:00.923 INFO:teuthology.orchestra.run.smithi094.stdout:162 2023-10-16T08:56:00.924 INFO:teuthology.orchestra.run.smithi094.stdout:162.out 2023-10-16T08:56:00.924 INFO:teuthology.orchestra.run.smithi094.stdout:163 2023-10-16T08:56:00.924 INFO:teuthology.orchestra.run.smithi094.stdout:163.out 2023-10-16T08:56:00.924 INFO:teuthology.orchestra.run.smithi094.stdout:164 2023-10-16T08:56:00.924 INFO:teuthology.orchestra.run.smithi094.stdout:164.out 2023-10-16T08:56:00.924 INFO:teuthology.orchestra.run.smithi094.stdout:165 2023-10-16T08:56:00.925 INFO:teuthology.orchestra.run.smithi094.stdout:165.out 2023-10-16T08:56:00.925 INFO:teuthology.orchestra.run.smithi094.stdout:166 2023-10-16T08:56:00.925 INFO:teuthology.orchestra.run.smithi094.stdout:166.out 2023-10-16T08:56:00.925 INFO:teuthology.orchestra.run.smithi094.stdout:167 2023-10-16T08:56:00.925 INFO:teuthology.orchestra.run.smithi094.stdout:167.out 2023-10-16T08:56:00.926 INFO:teuthology.orchestra.run.smithi094.stdout:168 2023-10-16T08:56:00.926 INFO:teuthology.orchestra.run.smithi094.stdout:168.out 2023-10-16T08:56:00.926 INFO:teuthology.orchestra.run.smithi094.stdout:169 2023-10-16T08:56:00.926 INFO:teuthology.orchestra.run.smithi094.stdout:169.out 2023-10-16T08:56:00.926 INFO:teuthology.orchestra.run.smithi094.stdout:170 2023-10-16T08:56:00.926 INFO:teuthology.orchestra.run.smithi094.stdout:170.out 2023-10-16T08:56:00.927 INFO:teuthology.orchestra.run.smithi094.stdout:171 2023-10-16T08:56:00.927 INFO:teuthology.orchestra.run.smithi094.stdout:171.out 2023-10-16T08:56:00.927 INFO:teuthology.orchestra.run.smithi094.stdout:172 2023-10-16T08:56:00.927 INFO:teuthology.orchestra.run.smithi094.stdout:172.out 2023-10-16T08:56:00.927 INFO:teuthology.orchestra.run.smithi094.stdout:173 2023-10-16T08:56:00.928 INFO:teuthology.orchestra.run.smithi094.stdout:173.out 2023-10-16T08:56:00.928 INFO:teuthology.orchestra.run.smithi094.stdout:174 2023-10-16T08:56:00.928 INFO:teuthology.orchestra.run.smithi094.stdout:174.out 2023-10-16T08:56:00.928 INFO:teuthology.orchestra.run.smithi094.stdout:175 2023-10-16T08:56:00.928 INFO:teuthology.orchestra.run.smithi094.stdout:175.out 2023-10-16T08:56:00.928 INFO:teuthology.orchestra.run.smithi094.stdout:176 2023-10-16T08:56:00.929 INFO:teuthology.orchestra.run.smithi094.stdout:176.out 2023-10-16T08:56:00.929 INFO:teuthology.orchestra.run.smithi094.stdout:177 2023-10-16T08:56:00.929 INFO:teuthology.orchestra.run.smithi094.stdout:177.out 2023-10-16T08:56:00.929 INFO:teuthology.orchestra.run.smithi094.stdout:178 2023-10-16T08:56:00.929 INFO:teuthology.orchestra.run.smithi094.stdout:178.out 2023-10-16T08:56:00.930 INFO:teuthology.orchestra.run.smithi094.stdout:179 2023-10-16T08:56:00.930 INFO:teuthology.orchestra.run.smithi094.stdout:179.out 2023-10-16T08:56:00.930 INFO:teuthology.orchestra.run.smithi094.stdout:180 2023-10-16T08:56:00.930 INFO:teuthology.orchestra.run.smithi094.stdout:180.out 2023-10-16T08:56:00.930 INFO:teuthology.orchestra.run.smithi094.stdout:181 2023-10-16T08:56:00.930 INFO:teuthology.orchestra.run.smithi094.stdout:181.out 2023-10-16T08:56:00.931 INFO:teuthology.orchestra.run.smithi094.stdout:182 2023-10-16T08:56:00.931 INFO:teuthology.orchestra.run.smithi094.stdout:182.out 2023-10-16T08:56:00.931 INFO:teuthology.orchestra.run.smithi094.stdout:183 2023-10-16T08:56:00.931 INFO:teuthology.orchestra.run.smithi094.stdout:183.out 2023-10-16T08:56:00.931 INFO:teuthology.orchestra.run.smithi094.stdout:184 2023-10-16T08:56:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:184.out 2023-10-16T08:56:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:185 2023-10-16T08:56:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:185.out 2023-10-16T08:56:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:186 2023-10-16T08:56:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:186.out 2023-10-16T08:56:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:187 2023-10-16T08:56:00.933 INFO:teuthology.orchestra.run.smithi094.stdout:187.out 2023-10-16T08:56:00.933 INFO:teuthology.orchestra.run.smithi094.stdout:188 2023-10-16T08:56:00.933 INFO:teuthology.orchestra.run.smithi094.stdout:188.out 2023-10-16T08:56:00.933 INFO:teuthology.orchestra.run.smithi094.stdout:189 2023-10-16T08:56:00.933 INFO:teuthology.orchestra.run.smithi094.stdout:189.out 2023-10-16T08:56:00.933 INFO:teuthology.orchestra.run.smithi094.stdout:190 2023-10-16T08:56:00.934 INFO:teuthology.orchestra.run.smithi094.stdout:190.out 2023-10-16T08:56:00.934 INFO:teuthology.orchestra.run.smithi094.stdout:191 2023-10-16T08:56:00.934 INFO:teuthology.orchestra.run.smithi094.stdout:191.out 2023-10-16T08:56:00.934 INFO:teuthology.orchestra.run.smithi094.stdout:192 2023-10-16T08:56:00.934 INFO:teuthology.orchestra.run.smithi094.stdout:192.out 2023-10-16T08:56:00.935 INFO:teuthology.orchestra.run.smithi094.stdout:193 2023-10-16T08:56:00.935 INFO:teuthology.orchestra.run.smithi094.stdout:193.out 2023-10-16T08:56:00.935 INFO:teuthology.orchestra.run.smithi094.stdout:194 2023-10-16T08:56:00.935 INFO:teuthology.orchestra.run.smithi094.stdout:194.out 2023-10-16T08:56:00.935 INFO:teuthology.orchestra.run.smithi094.stdout:195 2023-10-16T08:56:00.936 INFO:teuthology.orchestra.run.smithi094.stdout:195.out 2023-10-16T08:56:00.936 INFO:teuthology.orchestra.run.smithi094.stdout:196 2023-10-16T08:56:00.936 INFO:teuthology.orchestra.run.smithi094.stdout:196.out 2023-10-16T08:56:00.936 INFO:teuthology.orchestra.run.smithi094.stdout:197 2023-10-16T08:56:00.936 INFO:teuthology.orchestra.run.smithi094.stdout:197.out 2023-10-16T08:56:00.936 INFO:teuthology.orchestra.run.smithi094.stdout:198 2023-10-16T08:56:00.937 INFO:teuthology.orchestra.run.smithi094.stdout:198.out 2023-10-16T08:56:00.937 INFO:teuthology.orchestra.run.smithi094.stdout:199 2023-10-16T08:56:00.937 INFO:teuthology.orchestra.run.smithi094.stdout:199.out 2023-10-16T08:56:00.937 INFO:teuthology.orchestra.run.smithi094.stdout:200 2023-10-16T08:56:00.937 INFO:teuthology.orchestra.run.smithi094.stdout:200.out 2023-10-16T08:56:00.938 INFO:teuthology.orchestra.run.smithi094.stdout:201 2023-10-16T08:56:00.938 INFO:teuthology.orchestra.run.smithi094.stdout:201.out 2023-10-16T08:56:00.938 INFO:teuthology.orchestra.run.smithi094.stdout:202 2023-10-16T08:56:00.938 INFO:teuthology.orchestra.run.smithi094.stdout:202.out 2023-10-16T08:56:00.938 INFO:teuthology.orchestra.run.smithi094.stdout:203 2023-10-16T08:56:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:203.out 2023-10-16T08:56:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:204 2023-10-16T08:56:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:204.out 2023-10-16T08:56:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:205 2023-10-16T08:56:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:205.out 2023-10-16T08:56:00.939 INFO:teuthology.orchestra.run.smithi094.stdout:206 2023-10-16T08:56:00.940 INFO:teuthology.orchestra.run.smithi094.stdout:206.out 2023-10-16T08:56:00.940 INFO:teuthology.orchestra.run.smithi094.stdout:207 2023-10-16T08:56:00.940 INFO:teuthology.orchestra.run.smithi094.stdout:207.out 2023-10-16T08:56:00.940 INFO:teuthology.orchestra.run.smithi094.stdout:208 2023-10-16T08:56:00.940 INFO:teuthology.orchestra.run.smithi094.stdout:208.out 2023-10-16T08:56:00.941 INFO:teuthology.orchestra.run.smithi094.stdout:209 2023-10-16T08:56:00.941 INFO:teuthology.orchestra.run.smithi094.stdout:209.out 2023-10-16T08:56:00.941 INFO:teuthology.orchestra.run.smithi094.stdout:210 2023-10-16T08:56:00.941 INFO:teuthology.orchestra.run.smithi094.stdout:210.out 2023-10-16T08:56:00.941 INFO:teuthology.orchestra.run.smithi094.stdout:211 2023-10-16T08:56:00.941 INFO:teuthology.orchestra.run.smithi094.stdout:211.out 2023-10-16T08:56:00.942 INFO:teuthology.orchestra.run.smithi094.stdout:212 2023-10-16T08:56:00.942 INFO:teuthology.orchestra.run.smithi094.stdout:212.out 2023-10-16T08:56:00.942 INFO:teuthology.orchestra.run.smithi094.stdout:213 2023-10-16T08:56:00.942 INFO:teuthology.orchestra.run.smithi094.stdout:213.out 2023-10-16T08:56:00.942 INFO:teuthology.orchestra.run.smithi094.stdout:214 2023-10-16T08:56:00.943 INFO:teuthology.orchestra.run.smithi094.stdout:214.out 2023-10-16T08:56:00.943 INFO:teuthology.orchestra.run.smithi094.stdout:215 2023-10-16T08:56:00.943 INFO:teuthology.orchestra.run.smithi094.stdout:215.out 2023-10-16T08:56:00.943 INFO:teuthology.orchestra.run.smithi094.stdout:216 2023-10-16T08:56:00.943 INFO:teuthology.orchestra.run.smithi094.stdout:216.out 2023-10-16T08:56:00.944 INFO:teuthology.orchestra.run.smithi094.stdout:217 2023-10-16T08:56:00.944 INFO:teuthology.orchestra.run.smithi094.stdout:217.out 2023-10-16T08:56:00.944 INFO:teuthology.orchestra.run.smithi094.stdout:218 2023-10-16T08:56:00.944 INFO:teuthology.orchestra.run.smithi094.stdout:218.out 2023-10-16T08:56:00.944 INFO:teuthology.orchestra.run.smithi094.stdout:219 2023-10-16T08:56:00.944 INFO:teuthology.orchestra.run.smithi094.stdout:219.out 2023-10-16T08:56:00.945 INFO:teuthology.orchestra.run.smithi094.stdout:220 2023-10-16T08:56:00.945 INFO:teuthology.orchestra.run.smithi094.stdout:220.out 2023-10-16T08:56:00.945 INFO:teuthology.orchestra.run.smithi094.stdout:221 2023-10-16T08:56:00.945 INFO:teuthology.orchestra.run.smithi094.stdout:221.out 2023-10-16T08:56:00.945 INFO:teuthology.orchestra.run.smithi094.stdout:222 2023-10-16T08:56:00.945 INFO:teuthology.orchestra.run.smithi094.stdout:222.out 2023-10-16T08:56:00.946 INFO:teuthology.orchestra.run.smithi094.stdout:223 2023-10-16T08:56:00.946 INFO:teuthology.orchestra.run.smithi094.stdout:223.out 2023-10-16T08:56:00.946 INFO:teuthology.orchestra.run.smithi094.stdout:224 2023-10-16T08:56:00.946 INFO:teuthology.orchestra.run.smithi094.stdout:224.out 2023-10-16T08:56:00.946 INFO:teuthology.orchestra.run.smithi094.stdout:225 2023-10-16T08:56:00.947 INFO:teuthology.orchestra.run.smithi094.stdout:225.out 2023-10-16T08:56:00.947 INFO:teuthology.orchestra.run.smithi094.stdout:226 2023-10-16T08:56:00.947 INFO:teuthology.orchestra.run.smithi094.stdout:226.out 2023-10-16T08:56:00.947 INFO:teuthology.orchestra.run.smithi094.stdout:227 2023-10-16T08:56:00.947 INFO:teuthology.orchestra.run.smithi094.stdout:227.out 2023-10-16T08:56:00.947 INFO:teuthology.orchestra.run.smithi094.stdout:228 2023-10-16T08:56:00.948 INFO:teuthology.orchestra.run.smithi094.stdout:228.out 2023-10-16T08:56:00.948 INFO:teuthology.orchestra.run.smithi094.stdout:229 2023-10-16T08:56:00.948 INFO:teuthology.orchestra.run.smithi094.stdout:229.out 2023-10-16T08:56:00.948 INFO:teuthology.orchestra.run.smithi094.stdout:230 2023-10-16T08:56:00.948 INFO:teuthology.orchestra.run.smithi094.stdout:230.out 2023-10-16T08:56:00.948 INFO:teuthology.orchestra.run.smithi094.stdout:231 2023-10-16T08:56:00.949 INFO:teuthology.orchestra.run.smithi094.stdout:231.out 2023-10-16T08:56:00.949 INFO:teuthology.orchestra.run.smithi094.stdout:232 2023-10-16T08:56:00.949 INFO:teuthology.orchestra.run.smithi094.stdout:232.out 2023-10-16T08:56:00.949 INFO:teuthology.orchestra.run.smithi094.stdout:233 2023-10-16T08:56:00.949 INFO:teuthology.orchestra.run.smithi094.stdout:233.out 2023-10-16T08:56:00.950 INFO:teuthology.orchestra.run.smithi094.stdout:234 2023-10-16T08:56:00.950 INFO:teuthology.orchestra.run.smithi094.stdout:234.out 2023-10-16T08:56:00.950 INFO:teuthology.orchestra.run.smithi094.stdout:235 2023-10-16T08:56:00.950 INFO:teuthology.orchestra.run.smithi094.stdout:235.out 2023-10-16T08:56:00.950 INFO:teuthology.orchestra.run.smithi094.stdout:236 2023-10-16T08:56:00.951 INFO:teuthology.orchestra.run.smithi094.stdout:236.out 2023-10-16T08:56:00.951 INFO:teuthology.orchestra.run.smithi094.stdout:237 2023-10-16T08:56:00.951 INFO:teuthology.orchestra.run.smithi094.stdout:237.out 2023-10-16T08:56:00.951 INFO:teuthology.orchestra.run.smithi094.stdout:238 2023-10-16T08:56:00.951 INFO:teuthology.orchestra.run.smithi094.stdout:238.out 2023-10-16T08:56:00.951 INFO:teuthology.orchestra.run.smithi094.stdout:239 2023-10-16T08:56:00.952 INFO:teuthology.orchestra.run.smithi094.stdout:239.out 2023-10-16T08:56:00.952 INFO:teuthology.orchestra.run.smithi094.stdout:240 2023-10-16T08:56:00.952 INFO:teuthology.orchestra.run.smithi094.stdout:240.out 2023-10-16T08:56:00.952 INFO:teuthology.orchestra.run.smithi094.stdout:241 2023-10-16T08:56:00.952 INFO:teuthology.orchestra.run.smithi094.stdout:241.out 2023-10-16T08:56:00.953 INFO:teuthology.orchestra.run.smithi094.stdout:242 2023-10-16T08:56:00.953 INFO:teuthology.orchestra.run.smithi094.stdout:242.out 2023-10-16T08:56:00.953 INFO:teuthology.orchestra.run.smithi094.stdout:243 2023-10-16T08:56:00.953 INFO:teuthology.orchestra.run.smithi094.stdout:243.out 2023-10-16T08:56:00.953 INFO:teuthology.orchestra.run.smithi094.stdout:244 2023-10-16T08:56:00.953 INFO:teuthology.orchestra.run.smithi094.stdout:244.out 2023-10-16T08:56:00.954 INFO:teuthology.orchestra.run.smithi094.stdout:245 2023-10-16T08:56:00.954 INFO:teuthology.orchestra.run.smithi094.stdout:245.out 2023-10-16T08:56:00.954 INFO:teuthology.orchestra.run.smithi094.stdout:246 2023-10-16T08:56:00.954 INFO:teuthology.orchestra.run.smithi094.stdout:246.out 2023-10-16T08:56:00.954 INFO:teuthology.orchestra.run.smithi094.stdout:247 2023-10-16T08:56:00.955 INFO:teuthology.orchestra.run.smithi094.stdout:247.out 2023-10-16T08:56:00.955 INFO:teuthology.orchestra.run.smithi094.stdout:248 2023-10-16T08:56:00.955 INFO:teuthology.orchestra.run.smithi094.stdout:248.out 2023-10-16T08:56:00.955 INFO:teuthology.orchestra.run.smithi094.stdout:249 2023-10-16T08:56:00.955 INFO:teuthology.orchestra.run.smithi094.stdout:249.out 2023-10-16T08:56:00.955 INFO:teuthology.orchestra.run.smithi094.stdout:250 2023-10-16T08:56:00.956 INFO:teuthology.orchestra.run.smithi094.stdout:250.out 2023-10-16T08:56:00.956 INFO:teuthology.orchestra.run.smithi094.stdout:251 2023-10-16T08:56:00.956 INFO:teuthology.orchestra.run.smithi094.stdout:251.out 2023-10-16T08:56:00.956 INFO:teuthology.orchestra.run.smithi094.stdout:252 2023-10-16T08:56:00.956 INFO:teuthology.orchestra.run.smithi094.stdout:252.out 2023-10-16T08:56:00.957 INFO:teuthology.orchestra.run.smithi094.stdout:253 2023-10-16T08:56:00.957 INFO:teuthology.orchestra.run.smithi094.stdout:253.out 2023-10-16T08:56:00.957 INFO:teuthology.orchestra.run.smithi094.stdout:254 2023-10-16T08:56:00.957 INFO:teuthology.orchestra.run.smithi094.stdout:254.out 2023-10-16T08:56:00.957 INFO:teuthology.orchestra.run.smithi094.stdout:255 2023-10-16T08:56:00.957 INFO:teuthology.orchestra.run.smithi094.stdout:255.out 2023-10-16T08:56:00.958 INFO:teuthology.orchestra.run.smithi094.stdout:256 2023-10-16T08:56:00.958 INFO:teuthology.orchestra.run.smithi094.stdout:256.out 2023-10-16T08:56:00.958 INFO:teuthology.orchestra.run.smithi094.stdout:257 2023-10-16T08:56:00.958 INFO:teuthology.orchestra.run.smithi094.stdout:257.out 2023-10-16T08:56:00.958 INFO:teuthology.orchestra.run.smithi094.stdout:258 2023-10-16T08:56:00.959 INFO:teuthology.orchestra.run.smithi094.stdout:258.out 2023-10-16T08:56:00.959 INFO:teuthology.orchestra.run.smithi094.stdout:259 2023-10-16T08:56:00.959 INFO:teuthology.orchestra.run.smithi094.stdout:259.out 2023-10-16T08:56:00.959 INFO:teuthology.orchestra.run.smithi094.stdout:260 2023-10-16T08:56:00.959 INFO:teuthology.orchestra.run.smithi094.stdout:260.out 2023-10-16T08:56:00.959 INFO:teuthology.orchestra.run.smithi094.stdout:261 2023-10-16T08:56:00.960 INFO:teuthology.orchestra.run.smithi094.stdout:261.out 2023-10-16T08:56:00.960 INFO:teuthology.orchestra.run.smithi094.stdout:262 2023-10-16T08:56:00.960 INFO:teuthology.orchestra.run.smithi094.stdout:262.out 2023-10-16T08:56:00.960 INFO:teuthology.orchestra.run.smithi094.stdout:263 2023-10-16T08:56:00.960 INFO:teuthology.orchestra.run.smithi094.stdout:263.out 2023-10-16T08:56:00.960 INFO:teuthology.orchestra.run.smithi094.stdout:264 2023-10-16T08:56:00.961 INFO:teuthology.orchestra.run.smithi094.stdout:264.out 2023-10-16T08:56:00.961 INFO:teuthology.orchestra.run.smithi094.stdout:265 2023-10-16T08:56:00.961 INFO:teuthology.orchestra.run.smithi094.stdout:265.out 2023-10-16T08:56:00.961 INFO:teuthology.orchestra.run.smithi094.stdout:266 2023-10-16T08:56:00.961 INFO:teuthology.orchestra.run.smithi094.stdout:266.out 2023-10-16T08:56:00.962 INFO:teuthology.orchestra.run.smithi094.stdout:267 2023-10-16T08:56:00.962 INFO:teuthology.orchestra.run.smithi094.stdout:267.out 2023-10-16T08:56:00.962 INFO:teuthology.orchestra.run.smithi094.stdout:268 2023-10-16T08:56:00.962 INFO:teuthology.orchestra.run.smithi094.stdout:268.out 2023-10-16T08:56:00.962 INFO:teuthology.orchestra.run.smithi094.stdout:269 2023-10-16T08:56:00.962 INFO:teuthology.orchestra.run.smithi094.stdout:269.out 2023-10-16T08:56:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:270 2023-10-16T08:56:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:270.out 2023-10-16T08:56:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:271 2023-10-16T08:56:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:271.out 2023-10-16T08:56:00.963 INFO:teuthology.orchestra.run.smithi094.stdout:272 2023-10-16T08:56:00.964 INFO:teuthology.orchestra.run.smithi094.stdout:272.out 2023-10-16T08:56:00.964 INFO:teuthology.orchestra.run.smithi094.stdout:273 2023-10-16T08:56:00.964 INFO:teuthology.orchestra.run.smithi094.stdout:273.out 2023-10-16T08:56:00.964 INFO:teuthology.orchestra.run.smithi094.stdout:274 2023-10-16T08:56:00.964 INFO:teuthology.orchestra.run.smithi094.stdout:274.out 2023-10-16T08:56:00.964 INFO:teuthology.orchestra.run.smithi094.stdout:275 2023-10-16T08:56:00.965 INFO:teuthology.orchestra.run.smithi094.stdout:275.out 2023-10-16T08:56:00.965 INFO:teuthology.orchestra.run.smithi094.stdout:276 2023-10-16T08:56:00.965 INFO:teuthology.orchestra.run.smithi094.stdout:276.out 2023-10-16T08:56:00.965 INFO:teuthology.orchestra.run.smithi094.stdout:277 2023-10-16T08:56:00.965 INFO:teuthology.orchestra.run.smithi094.stdout:277.out 2023-10-16T08:56:00.966 INFO:teuthology.orchestra.run.smithi094.stdout:278 2023-10-16T08:56:00.966 INFO:teuthology.orchestra.run.smithi094.stdout:278.out 2023-10-16T08:56:00.966 INFO:teuthology.orchestra.run.smithi094.stdout:279 2023-10-16T08:56:00.966 INFO:teuthology.orchestra.run.smithi094.stdout:279.out 2023-10-16T08:56:00.966 INFO:teuthology.orchestra.run.smithi094.stdout:280 2023-10-16T08:56:00.966 INFO:teuthology.orchestra.run.smithi094.stdout:280.out 2023-10-16T08:56:00.967 INFO:teuthology.orchestra.run.smithi094.stdout:281 2023-10-16T08:56:00.967 INFO:teuthology.orchestra.run.smithi094.stdout:281.out 2023-10-16T08:56:00.967 INFO:teuthology.orchestra.run.smithi094.stdout:282 2023-10-16T08:56:00.967 INFO:teuthology.orchestra.run.smithi094.stdout:282.out 2023-10-16T08:56:00.967 INFO:teuthology.orchestra.run.smithi094.stdout:283 2023-10-16T08:56:00.968 INFO:teuthology.orchestra.run.smithi094.stdout:283.out 2023-10-16T08:56:00.968 INFO:teuthology.orchestra.run.smithi094.stdout:284 2023-10-16T08:56:00.968 INFO:teuthology.orchestra.run.smithi094.stdout:284.out 2023-10-16T08:56:00.968 INFO:teuthology.orchestra.run.smithi094.stdout:285 2023-10-16T08:56:00.968 INFO:teuthology.orchestra.run.smithi094.stdout:285.out 2023-10-16T08:56:00.968 INFO:teuthology.orchestra.run.smithi094.stdout:286 2023-10-16T08:56:00.969 INFO:teuthology.orchestra.run.smithi094.stdout:286.out 2023-10-16T08:56:00.969 INFO:teuthology.orchestra.run.smithi094.stdout:287 2023-10-16T08:56:00.969 INFO:teuthology.orchestra.run.smithi094.stdout:287.out 2023-10-16T08:56:00.969 INFO:teuthology.orchestra.run.smithi094.stdout:288 2023-10-16T08:56:00.969 INFO:teuthology.orchestra.run.smithi094.stdout:288.out 2023-10-16T08:56:00.969 INFO:teuthology.orchestra.run.smithi094.stdout:289 2023-10-16T08:56:00.970 INFO:teuthology.orchestra.run.smithi094.stdout:289.out 2023-10-16T08:56:00.970 INFO:teuthology.orchestra.run.smithi094.stdout:290 2023-10-16T08:56:00.970 INFO:teuthology.orchestra.run.smithi094.stdout:290.out 2023-10-16T08:56:00.970 INFO:teuthology.orchestra.run.smithi094.stdout:291 2023-10-16T08:56:00.970 INFO:teuthology.orchestra.run.smithi094.stdout:291.out 2023-10-16T08:56:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:292 2023-10-16T08:56:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:292.out 2023-10-16T08:56:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:293 2023-10-16T08:56:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:293.out 2023-10-16T08:56:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:294 2023-10-16T08:56:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:294.out 2023-10-16T08:56:00.972 INFO:teuthology.orchestra.run.smithi094.stdout:295 2023-10-16T08:56:00.972 INFO:teuthology.orchestra.run.smithi094.stdout:295.out 2023-10-16T08:56:00.972 INFO:teuthology.orchestra.run.smithi094.stdout:296 2023-10-16T08:56:00.972 INFO:teuthology.orchestra.run.smithi094.stdout:296.out 2023-10-16T08:56:00.972 INFO:teuthology.orchestra.run.smithi094.stdout:297 2023-10-16T08:56:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:297.out 2023-10-16T08:56:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:298 2023-10-16T08:56:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:298.out 2023-10-16T08:56:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:299 2023-10-16T08:56:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:299.out 2023-10-16T08:56:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:300 2023-10-16T08:56:00.974 INFO:teuthology.orchestra.run.smithi094.stdout:300.out 2023-10-16T08:56:00.974 INFO:teuthology.orchestra.run.smithi094.stdout:301 2023-10-16T08:56:00.974 INFO:teuthology.orchestra.run.smithi094.stdout:301.out 2023-10-16T08:56:00.974 INFO:teuthology.orchestra.run.smithi094.stdout:302 2023-10-16T08:56:00.974 INFO:teuthology.orchestra.run.smithi094.stdout:302.out 2023-10-16T08:56:00.975 INFO:teuthology.orchestra.run.smithi094.stdout:303 2023-10-16T08:56:00.975 INFO:teuthology.orchestra.run.smithi094.stdout:303.out 2023-10-16T08:56:00.975 INFO:teuthology.orchestra.run.smithi094.stdout:304 2023-10-16T08:56:00.975 INFO:teuthology.orchestra.run.smithi094.stdout:304.out 2023-10-16T08:56:00.975 INFO:teuthology.orchestra.run.smithi094.stdout:305 2023-10-16T08:56:00.976 INFO:teuthology.orchestra.run.smithi094.stdout:305.out 2023-10-16T08:56:00.976 INFO:teuthology.orchestra.run.smithi094.stdout:306 2023-10-16T08:56:00.976 INFO:teuthology.orchestra.run.smithi094.stdout:306.out 2023-10-16T08:56:00.976 INFO:teuthology.orchestra.run.smithi094.stdout:307 2023-10-16T08:56:00.976 INFO:teuthology.orchestra.run.smithi094.stdout:307.out 2023-10-16T08:56:00.976 INFO:teuthology.orchestra.run.smithi094.stdout:308 2023-10-16T08:56:00.977 INFO:teuthology.orchestra.run.smithi094.stdout:308.out 2023-10-16T08:56:00.977 INFO:teuthology.orchestra.run.smithi094.stdout:309 2023-10-16T08:56:00.977 INFO:teuthology.orchestra.run.smithi094.stdout:309.out 2023-10-16T08:56:00.977 INFO:teuthology.orchestra.run.smithi094.stdout:310 2023-10-16T08:56:00.977 INFO:teuthology.orchestra.run.smithi094.stdout:310.out 2023-10-16T08:56:00.977 INFO:teuthology.orchestra.run.smithi094.stdout:311 2023-10-16T08:56:00.978 INFO:teuthology.orchestra.run.smithi094.stdout:311.out 2023-10-16T08:56:00.978 INFO:teuthology.orchestra.run.smithi094.stdout:312 2023-10-16T08:56:00.978 INFO:teuthology.orchestra.run.smithi094.stdout:312.out 2023-10-16T08:56:00.978 INFO:teuthology.orchestra.run.smithi094.stdout:313 2023-10-16T08:56:00.978 INFO:teuthology.orchestra.run.smithi094.stdout:313.out 2023-10-16T08:56:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:314 2023-10-16T08:56:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:314.out 2023-10-16T08:56:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:315 2023-10-16T08:56:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:315.out 2023-10-16T08:56:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:316 2023-10-16T08:56:00.979 INFO:teuthology.orchestra.run.smithi094.stdout:316.out 2023-10-16T08:56:00.980 INFO:teuthology.orchestra.run.smithi094.stdout:317 2023-10-16T08:56:00.980 INFO:teuthology.orchestra.run.smithi094.stdout:317.out 2023-10-16T08:56:00.980 INFO:teuthology.orchestra.run.smithi094.stdout:318 2023-10-16T08:56:00.980 INFO:teuthology.orchestra.run.smithi094.stdout:318.out 2023-10-16T08:56:00.980 INFO:teuthology.orchestra.run.smithi094.stdout:319 2023-10-16T08:56:00.980 INFO:teuthology.orchestra.run.smithi094.stdout:319.out 2023-10-16T08:56:00.981 INFO:teuthology.orchestra.run.smithi094.stdout:320 2023-10-16T08:56:00.981 INFO:teuthology.orchestra.run.smithi094.stdout:320.out 2023-10-16T08:56:00.981 INFO:teuthology.orchestra.run.smithi094.stdout:321 2023-10-16T08:56:00.981 INFO:teuthology.orchestra.run.smithi094.stdout:321.out 2023-10-16T08:56:00.981 INFO:teuthology.orchestra.run.smithi094.stdout:322 2023-10-16T08:56:00.982 INFO:teuthology.orchestra.run.smithi094.stdout:322.out 2023-10-16T08:56:00.982 INFO:teuthology.orchestra.run.smithi094.stdout:323 2023-10-16T08:56:00.982 INFO:teuthology.orchestra.run.smithi094.stdout:323.out 2023-10-16T08:56:00.982 INFO:teuthology.orchestra.run.smithi094.stdout:324 2023-10-16T08:56:00.982 INFO:teuthology.orchestra.run.smithi094.stdout:324.out 2023-10-16T08:56:00.982 INFO:teuthology.orchestra.run.smithi094.stdout:325 2023-10-16T08:56:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:325.out 2023-10-16T08:56:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:326 2023-10-16T08:56:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:326.out 2023-10-16T08:56:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:327 2023-10-16T08:56:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:327.out 2023-10-16T08:56:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:328 2023-10-16T08:56:00.984 INFO:teuthology.orchestra.run.smithi094.stdout:328.out 2023-10-16T08:56:00.984 INFO:teuthology.orchestra.run.smithi094.stdout:329 2023-10-16T08:56:00.984 INFO:teuthology.orchestra.run.smithi094.stdout:329.out 2023-10-16T08:56:00.984 INFO:teuthology.orchestra.run.smithi094.stdout:330 2023-10-16T08:56:00.984 INFO:teuthology.orchestra.run.smithi094.stdout:330.out 2023-10-16T08:56:00.985 INFO:teuthology.orchestra.run.smithi094.stdout:331 2023-10-16T08:56:00.985 INFO:teuthology.orchestra.run.smithi094.stdout:331.out 2023-10-16T08:56:00.985 INFO:teuthology.orchestra.run.smithi094.stdout:332 2023-10-16T08:56:00.985 INFO:teuthology.orchestra.run.smithi094.stdout:332.out 2023-10-16T08:56:00.985 INFO:teuthology.orchestra.run.smithi094.stdout:333 2023-10-16T08:56:00.985 INFO:teuthology.orchestra.run.smithi094.stdout:333.out 2023-10-16T08:56:00.986 INFO:teuthology.orchestra.run.smithi094.stdout:334 2023-10-16T08:56:00.986 INFO:teuthology.orchestra.run.smithi094.stdout:334.out 2023-10-16T08:56:00.986 INFO:teuthology.orchestra.run.smithi094.stdout:335 2023-10-16T08:56:00.986 INFO:teuthology.orchestra.run.smithi094.stdout:335.out 2023-10-16T08:56:00.986 INFO:teuthology.orchestra.run.smithi094.stdout:336 2023-10-16T08:56:00.987 INFO:teuthology.orchestra.run.smithi094.stdout:336.out 2023-10-16T08:56:00.987 INFO:teuthology.orchestra.run.smithi094.stdout:337 2023-10-16T08:56:00.987 INFO:teuthology.orchestra.run.smithi094.stdout:337.out 2023-10-16T08:56:00.987 INFO:teuthology.orchestra.run.smithi094.stdout:338 2023-10-16T08:56:00.987 INFO:teuthology.orchestra.run.smithi094.stdout:338.out 2023-10-16T08:56:00.988 INFO:teuthology.orchestra.run.smithi094.stdout:339 2023-10-16T08:56:00.988 INFO:teuthology.orchestra.run.smithi094.stdout:339.out 2023-10-16T08:56:00.988 INFO:teuthology.orchestra.run.smithi094.stdout:340 2023-10-16T08:56:00.988 INFO:teuthology.orchestra.run.smithi094.stdout:340.out 2023-10-16T08:56:00.988 INFO:teuthology.orchestra.run.smithi094.stdout:341 2023-10-16T08:56:00.988 INFO:teuthology.orchestra.run.smithi094.stdout:341.out 2023-10-16T08:56:00.989 INFO:teuthology.orchestra.run.smithi094.stdout:342 2023-10-16T08:56:00.989 INFO:teuthology.orchestra.run.smithi094.stdout:342.out 2023-10-16T08:56:00.989 INFO:teuthology.orchestra.run.smithi094.stdout:343 2023-10-16T08:56:00.989 INFO:teuthology.orchestra.run.smithi094.stdout:343.out 2023-10-16T08:56:00.989 INFO:teuthology.orchestra.run.smithi094.stdout:344 2023-10-16T08:56:00.990 INFO:teuthology.orchestra.run.smithi094.stdout:344.out 2023-10-16T08:56:00.990 INFO:teuthology.orchestra.run.smithi094.stdout:345 2023-10-16T08:56:00.990 INFO:teuthology.orchestra.run.smithi094.stdout:345.out 2023-10-16T08:56:00.990 INFO:teuthology.orchestra.run.smithi094.stdout:346 2023-10-16T08:56:00.990 INFO:teuthology.orchestra.run.smithi094.stdout:346.out 2023-10-16T08:56:00.990 INFO:teuthology.orchestra.run.smithi094.stdout:347 2023-10-16T08:56:00.991 INFO:teuthology.orchestra.run.smithi094.stdout:347.out 2023-10-16T08:56:00.991 INFO:teuthology.orchestra.run.smithi094.stdout:348 2023-10-16T08:56:00.991 INFO:teuthology.orchestra.run.smithi094.stdout:348.out 2023-10-16T08:56:00.991 INFO:teuthology.orchestra.run.smithi094.stdout:349 2023-10-16T08:56:00.991 INFO:teuthology.orchestra.run.smithi094.stdout:349.out 2023-10-16T08:56:00.992 INFO:teuthology.orchestra.run.smithi094.stdout:350 2023-10-16T08:56:00.992 INFO:teuthology.orchestra.run.smithi094.stdout:350.out 2023-10-16T08:56:00.992 INFO:teuthology.orchestra.run.smithi094.stdout:351 2023-10-16T08:56:00.992 INFO:teuthology.orchestra.run.smithi094.stdout:351.out 2023-10-16T08:56:00.992 INFO:teuthology.orchestra.run.smithi094.stdout:352 2023-10-16T08:56:00.992 INFO:teuthology.orchestra.run.smithi094.stdout:352.out 2023-10-16T08:56:00.993 INFO:teuthology.orchestra.run.smithi094.stdout:353 2023-10-16T08:56:00.993 INFO:teuthology.orchestra.run.smithi094.stdout:353.out 2023-10-16T08:56:00.993 INFO:teuthology.orchestra.run.smithi094.stdout:354 2023-10-16T08:56:00.993 INFO:teuthology.orchestra.run.smithi094.stdout:354.out 2023-10-16T08:56:00.993 INFO:teuthology.orchestra.run.smithi094.stdout:355 2023-10-16T08:56:00.994 INFO:teuthology.orchestra.run.smithi094.stdout:355.out 2023-10-16T08:56:00.994 INFO:teuthology.orchestra.run.smithi094.stdout:356 2023-10-16T08:56:00.994 INFO:teuthology.orchestra.run.smithi094.stdout:356.out 2023-10-16T08:56:00.994 INFO:teuthology.orchestra.run.smithi094.stdout:357 2023-10-16T08:56:00.994 INFO:teuthology.orchestra.run.smithi094.stdout:357.out 2023-10-16T08:56:00.994 INFO:teuthology.orchestra.run.smithi094.stdout:358 2023-10-16T08:56:00.995 INFO:teuthology.orchestra.run.smithi094.stdout:358.out 2023-10-16T08:56:00.995 INFO:teuthology.orchestra.run.smithi094.stdout:359 2023-10-16T08:56:00.995 INFO:teuthology.orchestra.run.smithi094.stdout:359.out 2023-10-16T08:56:00.995 INFO:teuthology.orchestra.run.smithi094.stdout:360 2023-10-16T08:56:00.995 INFO:teuthology.orchestra.run.smithi094.stdout:360.out 2023-10-16T08:56:00.996 INFO:teuthology.orchestra.run.smithi094.stdout:361 2023-10-16T08:56:00.996 INFO:teuthology.orchestra.run.smithi094.stdout:361.out 2023-10-16T08:56:00.996 INFO:teuthology.orchestra.run.smithi094.stdout:362 2023-10-16T08:56:00.996 INFO:teuthology.orchestra.run.smithi094.stdout:362.out 2023-10-16T08:56:00.996 INFO:teuthology.orchestra.run.smithi094.stdout:363 2023-10-16T08:56:00.996 INFO:teuthology.orchestra.run.smithi094.stdout:363.out 2023-10-16T08:56:00.997 INFO:teuthology.orchestra.run.smithi094.stdout:364 2023-10-16T08:56:00.997 INFO:teuthology.orchestra.run.smithi094.stdout:364.out 2023-10-16T08:56:00.997 INFO:teuthology.orchestra.run.smithi094.stdout:365 2023-10-16T08:56:00.997 INFO:teuthology.orchestra.run.smithi094.stdout:365.out 2023-10-16T08:56:00.997 INFO:teuthology.orchestra.run.smithi094.stdout:366 2023-10-16T08:56:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:366.out 2023-10-16T08:56:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:367 2023-10-16T08:56:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:367.out 2023-10-16T08:56:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:368 2023-10-16T08:56:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:368.out 2023-10-16T08:56:00.998 INFO:teuthology.orchestra.run.smithi094.stdout:369 2023-10-16T08:56:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:369.out 2023-10-16T08:56:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:370 2023-10-16T08:56:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:370.out 2023-10-16T08:56:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:371 2023-10-16T08:56:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:371.out 2023-10-16T08:56:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:372 2023-10-16T08:56:01.000 INFO:teuthology.orchestra.run.smithi094.stdout:372.out 2023-10-16T08:56:01.000 INFO:teuthology.orchestra.run.smithi094.stdout:373 2023-10-16T08:56:01.000 INFO:teuthology.orchestra.run.smithi094.stdout:373.out 2023-10-16T08:56:01.000 INFO:teuthology.orchestra.run.smithi094.stdout:374 2023-10-16T08:56:01.000 INFO:teuthology.orchestra.run.smithi094.stdout:374.out 2023-10-16T08:56:01.001 INFO:teuthology.orchestra.run.smithi094.stdout:375 2023-10-16T08:56:01.001 INFO:teuthology.orchestra.run.smithi094.stdout:375.out 2023-10-16T08:56:01.001 INFO:teuthology.orchestra.run.smithi094.stdout:376 2023-10-16T08:56:01.001 INFO:teuthology.orchestra.run.smithi094.stdout:376.out 2023-10-16T08:56:01.001 INFO:teuthology.orchestra.run.smithi094.stdout:377 2023-10-16T08:56:01.001 INFO:teuthology.orchestra.run.smithi094.stdout:377.out 2023-10-16T08:56:01.002 INFO:teuthology.orchestra.run.smithi094.stdout:378 2023-10-16T08:56:01.002 INFO:teuthology.orchestra.run.smithi094.stdout:378.out 2023-10-16T08:56:01.002 INFO:teuthology.orchestra.run.smithi094.stdout:379 2023-10-16T08:56:01.002 INFO:teuthology.orchestra.run.smithi094.stdout:379.out 2023-10-16T08:56:01.002 INFO:teuthology.orchestra.run.smithi094.stdout:380 2023-10-16T08:56:01.003 INFO:teuthology.orchestra.run.smithi094.stdout:380.out 2023-10-16T08:56:01.003 INFO:teuthology.orchestra.run.smithi094.stdout:381 2023-10-16T08:56:01.003 INFO:teuthology.orchestra.run.smithi094.stdout:381.out 2023-10-16T08:56:01.003 INFO:teuthology.orchestra.run.smithi094.stdout:382 2023-10-16T08:56:01.003 INFO:teuthology.orchestra.run.smithi094.stdout:382.out 2023-10-16T08:56:01.003 INFO:teuthology.orchestra.run.smithi094.stdout:383 2023-10-16T08:56:01.004 INFO:teuthology.orchestra.run.smithi094.stdout:383.out 2023-10-16T08:56:01.004 INFO:teuthology.orchestra.run.smithi094.stdout:384 2023-10-16T08:56:01.004 INFO:teuthology.orchestra.run.smithi094.stdout:384.out 2023-10-16T08:56:01.004 INFO:teuthology.orchestra.run.smithi094.stdout:385 2023-10-16T08:56:01.004 INFO:teuthology.orchestra.run.smithi094.stdout:385.out 2023-10-16T08:56:01.004 INFO:teuthology.orchestra.run.smithi094.stdout:386 2023-10-16T08:56:01.005 INFO:teuthology.orchestra.run.smithi094.stdout:386.out 2023-10-16T08:56:01.005 INFO:teuthology.orchestra.run.smithi094.stdout:387 2023-10-16T08:56:01.005 INFO:teuthology.orchestra.run.smithi094.stdout:387.out 2023-10-16T08:56:01.005 INFO:teuthology.orchestra.run.smithi094.stdout:388 2023-10-16T08:56:01.005 INFO:teuthology.orchestra.run.smithi094.stdout:388.out 2023-10-16T08:56:01.006 INFO:teuthology.orchestra.run.smithi094.stdout:389 2023-10-16T08:56:01.006 INFO:teuthology.orchestra.run.smithi094.stdout:389.out 2023-10-16T08:56:01.006 INFO:teuthology.orchestra.run.smithi094.stdout:390 2023-10-16T08:56:01.006 INFO:teuthology.orchestra.run.smithi094.stdout:390.out 2023-10-16T08:56:01.006 INFO:teuthology.orchestra.run.smithi094.stdout:391 2023-10-16T08:56:01.006 INFO:teuthology.orchestra.run.smithi094.stdout:391.out 2023-10-16T08:56:01.007 INFO:teuthology.orchestra.run.smithi094.stdout:392 2023-10-16T08:56:01.007 INFO:teuthology.orchestra.run.smithi094.stdout:392.out 2023-10-16T08:56:01.007 INFO:teuthology.orchestra.run.smithi094.stdout:393 2023-10-16T08:56:01.007 INFO:teuthology.orchestra.run.smithi094.stdout:393.out 2023-10-16T08:56:01.007 INFO:teuthology.orchestra.run.smithi094.stdout:394 2023-10-16T08:56:01.008 INFO:teuthology.orchestra.run.smithi094.stdout:394.out 2023-10-16T08:56:01.008 INFO:teuthology.orchestra.run.smithi094.stdout:395 2023-10-16T08:56:01.008 INFO:teuthology.orchestra.run.smithi094.stdout:395.out 2023-10-16T08:56:01.008 INFO:teuthology.orchestra.run.smithi094.stdout:396 2023-10-16T08:56:01.008 INFO:teuthology.orchestra.run.smithi094.stdout:396.out 2023-10-16T08:56:01.009 INFO:teuthology.orchestra.run.smithi094.stdout:397 2023-10-16T08:56:01.009 INFO:teuthology.orchestra.run.smithi094.stdout:397.out 2023-10-16T08:56:01.009 INFO:teuthology.orchestra.run.smithi094.stdout:398 2023-10-16T08:56:01.009 INFO:teuthology.orchestra.run.smithi094.stdout:398.out 2023-10-16T08:56:01.009 INFO:teuthology.orchestra.run.smithi094.stdout:399 2023-10-16T08:56:01.009 INFO:teuthology.orchestra.run.smithi094.stdout:399.out 2023-10-16T08:56:01.010 INFO:teuthology.orchestra.run.smithi094.stdout:400 2023-10-16T08:56:01.010 INFO:teuthology.orchestra.run.smithi094.stdout:400.out 2023-10-16T08:56:01.010 INFO:teuthology.orchestra.run.smithi094.stdout:401 2023-10-16T08:56:01.013 INFO:teuthology.orchestra.run.smithi094.stdout:401.out 2023-10-16T08:56:01.013 INFO:teuthology.orchestra.run.smithi094.stdout:402 2023-10-16T08:56:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:402.out 2023-10-16T08:56:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:403 2023-10-16T08:56:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:403.out 2023-10-16T08:56:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:404 2023-10-16T08:56:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:404.out 2023-10-16T08:56:01.015 INFO:teuthology.orchestra.run.smithi094.stdout:405 2023-10-16T08:56:01.015 INFO:teuthology.orchestra.run.smithi094.stdout:405.out 2023-10-16T08:56:01.015 INFO:teuthology.orchestra.run.smithi094.stdout:406 2023-10-16T08:56:01.015 INFO:teuthology.orchestra.run.smithi094.stdout:406.out 2023-10-16T08:56:01.015 INFO:teuthology.orchestra.run.smithi094.stdout:407 2023-10-16T08:56:01.015 INFO:teuthology.orchestra.run.smithi094.stdout:407.out 2023-10-16T08:56:01.016 INFO:teuthology.orchestra.run.smithi094.stdout:408 2023-10-16T08:56:01.016 INFO:teuthology.orchestra.run.smithi094.stdout:408.out 2023-10-16T08:56:01.016 INFO:teuthology.orchestra.run.smithi094.stdout:409 2023-10-16T08:56:01.016 INFO:teuthology.orchestra.run.smithi094.stdout:409.out 2023-10-16T08:56:01.016 INFO:teuthology.orchestra.run.smithi094.stdout:410 2023-10-16T08:56:01.017 INFO:teuthology.orchestra.run.smithi094.stdout:410.out 2023-10-16T08:56:01.017 INFO:teuthology.orchestra.run.smithi094.stdout:411 2023-10-16T08:56:01.017 INFO:teuthology.orchestra.run.smithi094.stdout:411.out 2023-10-16T08:56:01.017 INFO:teuthology.orchestra.run.smithi094.stdout:412 2023-10-16T08:56:01.017 INFO:teuthology.orchestra.run.smithi094.stdout:412.out 2023-10-16T08:56:01.017 INFO:teuthology.orchestra.run.smithi094.stdout:413 2023-10-16T08:56:01.018 INFO:teuthology.orchestra.run.smithi094.stdout:413.out 2023-10-16T08:56:01.018 INFO:teuthology.orchestra.run.smithi094.stdout:414 2023-10-16T08:56:01.018 INFO:teuthology.orchestra.run.smithi094.stdout:414.out 2023-10-16T08:56:01.018 INFO:teuthology.orchestra.run.smithi094.stdout:415 2023-10-16T08:56:01.018 INFO:teuthology.orchestra.run.smithi094.stdout:415.out 2023-10-16T08:56:01.019 INFO:teuthology.orchestra.run.smithi094.stdout:416 2023-10-16T08:56:01.019 INFO:teuthology.orchestra.run.smithi094.stdout:416.out 2023-10-16T08:56:01.019 INFO:teuthology.orchestra.run.smithi094.stdout:417 2023-10-16T08:56:01.019 INFO:teuthology.orchestra.run.smithi094.stdout:417.out 2023-10-16T08:56:01.019 INFO:teuthology.orchestra.run.smithi094.stdout:418 2023-10-16T08:56:01.020 INFO:teuthology.orchestra.run.smithi094.stdout:418.out 2023-10-16T08:56:01.020 INFO:teuthology.orchestra.run.smithi094.stdout:419 2023-10-16T08:56:01.020 INFO:teuthology.orchestra.run.smithi094.stdout:419.out 2023-10-16T08:56:01.020 INFO:teuthology.orchestra.run.smithi094.stdout:420 2023-10-16T08:56:01.020 INFO:teuthology.orchestra.run.smithi094.stdout:420.out 2023-10-16T08:56:01.020 INFO:teuthology.orchestra.run.smithi094.stdout:421 2023-10-16T08:56:01.021 INFO:teuthology.orchestra.run.smithi094.stdout:421.out 2023-10-16T08:56:01.021 INFO:teuthology.orchestra.run.smithi094.stdout:422 2023-10-16T08:56:01.021 INFO:teuthology.orchestra.run.smithi094.stdout:422.out 2023-10-16T08:56:01.021 INFO:teuthology.orchestra.run.smithi094.stdout:423 2023-10-16T08:56:01.021 INFO:teuthology.orchestra.run.smithi094.stdout:423.out 2023-10-16T08:56:01.022 INFO:teuthology.orchestra.run.smithi094.stdout:424 2023-10-16T08:56:01.022 INFO:teuthology.orchestra.run.smithi094.stdout:424.out 2023-10-16T08:56:01.022 INFO:teuthology.orchestra.run.smithi094.stdout:425 2023-10-16T08:56:01.022 INFO:teuthology.orchestra.run.smithi094.stdout:425.out 2023-10-16T08:56:01.022 INFO:teuthology.orchestra.run.smithi094.stdout:426 2023-10-16T08:56:01.023 INFO:teuthology.orchestra.run.smithi094.stdout:426.out 2023-10-16T08:56:01.023 INFO:teuthology.orchestra.run.smithi094.stdout:427 2023-10-16T08:56:01.023 INFO:teuthology.orchestra.run.smithi094.stdout:427.out 2023-10-16T08:56:01.023 INFO:teuthology.orchestra.run.smithi094.stdout:428 2023-10-16T08:56:01.023 INFO:teuthology.orchestra.run.smithi094.stdout:428.out 2023-10-16T08:56:01.024 INFO:teuthology.orchestra.run.smithi094.stdout:429 2023-10-16T08:56:01.024 INFO:teuthology.orchestra.run.smithi094.stdout:429.out 2023-10-16T08:56:01.024 INFO:teuthology.orchestra.run.smithi094.stdout:430 2023-10-16T08:56:01.024 INFO:teuthology.orchestra.run.smithi094.stdout:430.out 2023-10-16T08:56:01.024 INFO:teuthology.orchestra.run.smithi094.stdout:431 2023-10-16T08:56:01.024 INFO:teuthology.orchestra.run.smithi094.stdout:431.out 2023-10-16T08:56:01.025 INFO:teuthology.orchestra.run.smithi094.stdout:432 2023-10-16T08:56:01.025 INFO:teuthology.orchestra.run.smithi094.stdout:432.out 2023-10-16T08:56:01.025 INFO:teuthology.orchestra.run.smithi094.stdout:433 2023-10-16T08:56:01.025 INFO:teuthology.orchestra.run.smithi094.stdout:433.out 2023-10-16T08:56:01.025 INFO:teuthology.orchestra.run.smithi094.stdout:434 2023-10-16T08:56:01.025 INFO:teuthology.orchestra.run.smithi094.stdout:434.out 2023-10-16T08:56:01.026 INFO:teuthology.orchestra.run.smithi094.stdout:435 2023-10-16T08:56:01.026 INFO:teuthology.orchestra.run.smithi094.stdout:435.out 2023-10-16T08:56:01.026 INFO:teuthology.orchestra.run.smithi094.stdout:436 2023-10-16T08:56:01.026 INFO:teuthology.orchestra.run.smithi094.stdout:436.out 2023-10-16T08:56:01.026 INFO:teuthology.orchestra.run.smithi094.stdout:437 2023-10-16T08:56:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:437.out 2023-10-16T08:56:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:438 2023-10-16T08:56:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:438.out 2023-10-16T08:56:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:439 2023-10-16T08:56:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:439.out 2023-10-16T08:56:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:440 2023-10-16T08:56:01.028 INFO:teuthology.orchestra.run.smithi094.stdout:440.out 2023-10-16T08:56:01.028 INFO:teuthology.orchestra.run.smithi094.stdout:441 2023-10-16T08:56:01.028 INFO:teuthology.orchestra.run.smithi094.stdout:441.out 2023-10-16T08:56:01.028 INFO:teuthology.orchestra.run.smithi094.stdout:442 2023-10-16T08:56:01.028 INFO:teuthology.orchestra.run.smithi094.stdout:442.out 2023-10-16T08:56:01.029 INFO:teuthology.orchestra.run.smithi094.stdout:443 2023-10-16T08:56:01.029 INFO:teuthology.orchestra.run.smithi094.stdout:443.out 2023-10-16T08:56:01.029 INFO:teuthology.orchestra.run.smithi094.stdout:444 2023-10-16T08:56:01.029 INFO:teuthology.orchestra.run.smithi094.stdout:444.out 2023-10-16T08:56:01.029 INFO:teuthology.orchestra.run.smithi094.stdout:445 2023-10-16T08:56:01.030 INFO:teuthology.orchestra.run.smithi094.stdout:445.out 2023-10-16T08:56:01.030 INFO:teuthology.orchestra.run.smithi094.stdout:446 2023-10-16T08:56:01.030 INFO:teuthology.orchestra.run.smithi094.stdout:446.out 2023-10-16T08:56:01.030 INFO:teuthology.orchestra.run.smithi094.stdout:447 2023-10-16T08:56:01.030 INFO:teuthology.orchestra.run.smithi094.stdout:447.out 2023-10-16T08:56:01.030 INFO:teuthology.orchestra.run.smithi094.stdout:448 2023-10-16T08:56:01.031 INFO:teuthology.orchestra.run.smithi094.stdout:448.out 2023-10-16T08:56:01.031 INFO:teuthology.orchestra.run.smithi094.stdout:449 2023-10-16T08:56:01.031 INFO:teuthology.orchestra.run.smithi094.stdout:449.out 2023-10-16T08:56:01.031 INFO:teuthology.orchestra.run.smithi094.stdout:450 2023-10-16T08:56:01.031 INFO:teuthology.orchestra.run.smithi094.stdout:450.out 2023-10-16T08:56:01.032 INFO:teuthology.orchestra.run.smithi094.stdout:451 2023-10-16T08:56:01.032 INFO:teuthology.orchestra.run.smithi094.stdout:451.out 2023-10-16T08:56:01.032 INFO:teuthology.orchestra.run.smithi094.stdout:452 2023-10-16T08:56:01.032 INFO:teuthology.orchestra.run.smithi094.stdout:452.out 2023-10-16T08:56:01.032 INFO:teuthology.orchestra.run.smithi094.stdout:453 2023-10-16T08:56:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:453.out 2023-10-16T08:56:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:454 2023-10-16T08:56:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:454.out 2023-10-16T08:56:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:455 2023-10-16T08:56:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:455.out 2023-10-16T08:56:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:456 2023-10-16T08:56:01.034 INFO:teuthology.orchestra.run.smithi094.stdout:456.out 2023-10-16T08:56:01.034 INFO:teuthology.orchestra.run.smithi094.stdout:457 2023-10-16T08:56:01.034 INFO:teuthology.orchestra.run.smithi094.stdout:457.out 2023-10-16T08:56:01.034 INFO:teuthology.orchestra.run.smithi094.stdout:458 2023-10-16T08:56:01.034 INFO:teuthology.orchestra.run.smithi094.stdout:458.out 2023-10-16T08:56:01.035 INFO:teuthology.orchestra.run.smithi094.stdout:459 2023-10-16T08:56:01.035 INFO:teuthology.orchestra.run.smithi094.stdout:459.out 2023-10-16T08:56:01.035 INFO:teuthology.orchestra.run.smithi094.stdout:460 2023-10-16T08:56:01.035 INFO:teuthology.orchestra.run.smithi094.stdout:460.out 2023-10-16T08:56:01.035 INFO:teuthology.orchestra.run.smithi094.stdout:461 2023-10-16T08:56:01.035 INFO:teuthology.orchestra.run.smithi094.stdout:461.out 2023-10-16T08:56:01.036 INFO:teuthology.orchestra.run.smithi094.stdout:462 2023-10-16T08:56:01.036 INFO:teuthology.orchestra.run.smithi094.stdout:462.out 2023-10-16T08:56:01.036 INFO:teuthology.orchestra.run.smithi094.stdout:463 2023-10-16T08:56:01.036 INFO:teuthology.orchestra.run.smithi094.stdout:463.out 2023-10-16T08:56:01.036 INFO:teuthology.orchestra.run.smithi094.stdout:464 2023-10-16T08:56:01.037 INFO:teuthology.orchestra.run.smithi094.stdout:464.out 2023-10-16T08:56:01.037 INFO:teuthology.orchestra.run.smithi094.stdout:465 2023-10-16T08:56:01.037 INFO:teuthology.orchestra.run.smithi094.stdout:465.out 2023-10-16T08:56:01.037 INFO:teuthology.orchestra.run.smithi094.stdout:466 2023-10-16T08:56:01.037 INFO:teuthology.orchestra.run.smithi094.stdout:466.out 2023-10-16T08:56:01.037 INFO:teuthology.orchestra.run.smithi094.stdout:467 2023-10-16T08:56:01.038 INFO:teuthology.orchestra.run.smithi094.stdout:467.out 2023-10-16T08:56:01.038 INFO:teuthology.orchestra.run.smithi094.stdout:468 2023-10-16T08:56:01.038 INFO:teuthology.orchestra.run.smithi094.stdout:468.out 2023-10-16T08:56:01.038 INFO:teuthology.orchestra.run.smithi094.stdout:469 2023-10-16T08:56:01.038 INFO:teuthology.orchestra.run.smithi094.stdout:469.out 2023-10-16T08:56:01.039 INFO:teuthology.orchestra.run.smithi094.stdout:470 2023-10-16T08:56:01.039 INFO:teuthology.orchestra.run.smithi094.stdout:470.out 2023-10-16T08:56:01.039 INFO:teuthology.orchestra.run.smithi094.stdout:471 2023-10-16T08:56:01.039 INFO:teuthology.orchestra.run.smithi094.stdout:471.out 2023-10-16T08:56:01.039 INFO:teuthology.orchestra.run.smithi094.stdout:472 2023-10-16T08:56:01.039 INFO:teuthology.orchestra.run.smithi094.stdout:472.out 2023-10-16T08:56:01.040 INFO:teuthology.orchestra.run.smithi094.stdout:473 2023-10-16T08:56:01.040 INFO:teuthology.orchestra.run.smithi094.stdout:473.out 2023-10-16T08:56:01.040 INFO:teuthology.orchestra.run.smithi094.stdout:474 2023-10-16T08:56:01.040 INFO:teuthology.orchestra.run.smithi094.stdout:474.out 2023-10-16T08:56:01.040 INFO:teuthology.orchestra.run.smithi094.stdout:475 2023-10-16T08:56:01.040 INFO:teuthology.orchestra.run.smithi094.stdout:475.out 2023-10-16T08:56:01.041 INFO:teuthology.orchestra.run.smithi094.stdout:476 2023-10-16T08:56:01.041 INFO:teuthology.orchestra.run.smithi094.stdout:476.out 2023-10-16T08:56:01.041 INFO:teuthology.orchestra.run.smithi094.stdout:477 2023-10-16T08:56:01.041 INFO:teuthology.orchestra.run.smithi094.stdout:477.out 2023-10-16T08:56:01.041 INFO:teuthology.orchestra.run.smithi094.stdout:478 2023-10-16T08:56:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:478.out 2023-10-16T08:56:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:479 2023-10-16T08:56:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:479.out 2023-10-16T08:56:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:480 2023-10-16T08:56:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:480.out 2023-10-16T08:56:01.042 INFO:teuthology.orchestra.run.smithi094.stdout:481 2023-10-16T08:56:01.043 INFO:teuthology.orchestra.run.smithi094.stdout:481.out 2023-10-16T08:56:01.043 INFO:teuthology.orchestra.run.smithi094.stdout:482 2023-10-16T08:56:01.043 INFO:teuthology.orchestra.run.smithi094.stdout:482.out 2023-10-16T08:56:01.043 INFO:teuthology.orchestra.run.smithi094.stdout:483 2023-10-16T08:56:01.043 INFO:teuthology.orchestra.run.smithi094.stdout:483.out 2023-10-16T08:56:01.044 INFO:teuthology.orchestra.run.smithi094.stdout:484 2023-10-16T08:56:01.044 INFO:teuthology.orchestra.run.smithi094.stdout:484.out 2023-10-16T08:56:01.044 INFO:teuthology.orchestra.run.smithi094.stdout:485 2023-10-16T08:56:01.044 INFO:teuthology.orchestra.run.smithi094.stdout:485.out 2023-10-16T08:56:01.044 INFO:teuthology.orchestra.run.smithi094.stdout:486 2023-10-16T08:56:01.044 INFO:teuthology.orchestra.run.smithi094.stdout:486.out 2023-10-16T08:56:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:487 2023-10-16T08:56:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:487.out 2023-10-16T08:56:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:488 2023-10-16T08:56:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:488.out 2023-10-16T08:56:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:489 2023-10-16T08:56:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:489.out 2023-10-16T08:56:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:490 2023-10-16T08:56:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:490.out 2023-10-16T08:56:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:491 2023-10-16T08:56:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:491.out 2023-10-16T08:56:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:492 2023-10-16T08:56:01.047 INFO:teuthology.orchestra.run.smithi094.stdout:492.out 2023-10-16T08:56:01.047 INFO:teuthology.orchestra.run.smithi094.stdout:493 2023-10-16T08:56:01.047 INFO:teuthology.orchestra.run.smithi094.stdout:493.out 2023-10-16T08:56:01.047 INFO:teuthology.orchestra.run.smithi094.stdout:494 2023-10-16T08:56:01.047 INFO:teuthology.orchestra.run.smithi094.stdout:494.out 2023-10-16T08:56:01.047 INFO:teuthology.orchestra.run.smithi094.stdout:495 2023-10-16T08:56:01.048 INFO:teuthology.orchestra.run.smithi094.stdout:495.out 2023-10-16T08:56:01.048 INFO:teuthology.orchestra.run.smithi094.stdout:496 2023-10-16T08:56:01.048 INFO:teuthology.orchestra.run.smithi094.stdout:496.out 2023-10-16T08:56:01.048 INFO:teuthology.orchestra.run.smithi094.stdout:497 2023-10-16T08:56:01.048 INFO:teuthology.orchestra.run.smithi094.stdout:497.out 2023-10-16T08:56:01.049 INFO:teuthology.orchestra.run.smithi094.stdout:498 2023-10-16T08:56:01.049 INFO:teuthology.orchestra.run.smithi094.stdout:498.out 2023-10-16T08:56:01.049 INFO:teuthology.orchestra.run.smithi094.stdout:499 2023-10-16T08:56:01.049 INFO:teuthology.orchestra.run.smithi094.stdout:499.out 2023-10-16T08:56:01.049 INFO:teuthology.orchestra.run.smithi094.stdout:500 2023-10-16T08:56:01.049 INFO:teuthology.orchestra.run.smithi094.stdout:500.out 2023-10-16T08:56:01.050 INFO:teuthology.orchestra.run.smithi094.stdout:501 2023-10-16T08:56:01.050 INFO:teuthology.orchestra.run.smithi094.stdout:501.out 2023-10-16T08:56:01.050 INFO:teuthology.orchestra.run.smithi094.stdout:502 2023-10-16T08:56:01.050 INFO:teuthology.orchestra.run.smithi094.stdout:502.out 2023-10-16T08:56:01.050 INFO:teuthology.orchestra.run.smithi094.stdout:503 2023-10-16T08:56:01.051 INFO:teuthology.orchestra.run.smithi094.stdout:503.out 2023-10-16T08:56:01.051 INFO:teuthology.orchestra.run.smithi094.stdout:504 2023-10-16T08:56:01.051 INFO:teuthology.orchestra.run.smithi094.stdout:504.out 2023-10-16T08:56:01.051 INFO:teuthology.orchestra.run.smithi094.stdout:505 2023-10-16T08:56:01.051 INFO:teuthology.orchestra.run.smithi094.stdout:505.out 2023-10-16T08:56:01.051 INFO:teuthology.orchestra.run.smithi094.stdout:506 2023-10-16T08:56:01.052 INFO:teuthology.orchestra.run.smithi094.stdout:506.out 2023-10-16T08:56:01.052 INFO:teuthology.orchestra.run.smithi094.stdout:507 2023-10-16T08:56:01.052 INFO:teuthology.orchestra.run.smithi094.stdout:507.out 2023-10-16T08:56:01.052 INFO:teuthology.orchestra.run.smithi094.stdout:508 2023-10-16T08:56:01.052 INFO:teuthology.orchestra.run.smithi094.stdout:508.out 2023-10-16T08:56:01.052 INFO:teuthology.orchestra.run.smithi094.stdout:509 2023-10-16T08:56:01.053 INFO:teuthology.orchestra.run.smithi094.stdout:509.out 2023-10-16T08:56:01.053 INFO:teuthology.orchestra.run.smithi094.stdout:510 2023-10-16T08:56:01.053 INFO:teuthology.orchestra.run.smithi094.stdout:510.out 2023-10-16T08:56:01.053 INFO:teuthology.orchestra.run.smithi094.stdout:511 2023-10-16T08:56:01.053 INFO:teuthology.orchestra.run.smithi094.stdout:511.out 2023-10-16T08:56:01.054 INFO:teuthology.orchestra.run.smithi094.stdout:512 2023-10-16T08:56:01.054 INFO:teuthology.orchestra.run.smithi094.stdout:512.out 2023-10-16T08:56:01.054 INFO:teuthology.orchestra.run.smithi094.stdout:513 2023-10-16T08:56:01.054 INFO:teuthology.orchestra.run.smithi094.stdout:513.out 2023-10-16T08:56:01.054 INFO:teuthology.orchestra.run.smithi094.stdout:514 2023-10-16T08:56:01.054 INFO:teuthology.orchestra.run.smithi094.stdout:514.out 2023-10-16T08:56:01.055 INFO:teuthology.orchestra.run.smithi094.stdout:515 2023-10-16T08:56:01.055 INFO:teuthology.orchestra.run.smithi094.stdout:515.out 2023-10-16T08:56:01.055 INFO:teuthology.orchestra.run.smithi094.stdout:516 2023-10-16T08:56:01.055 INFO:teuthology.orchestra.run.smithi094.stdout:516.out 2023-10-16T08:56:01.055 INFO:teuthology.orchestra.run.smithi094.stdout:517 2023-10-16T08:56:01.056 INFO:teuthology.orchestra.run.smithi094.stdout:517.out 2023-10-16T08:56:01.056 INFO:teuthology.orchestra.run.smithi094.stdout:518 2023-10-16T08:56:01.056 INFO:teuthology.orchestra.run.smithi094.stdout:518.out 2023-10-16T08:56:01.056 INFO:teuthology.orchestra.run.smithi094.stdout:519 2023-10-16T08:56:01.056 INFO:teuthology.orchestra.run.smithi094.stdout:519.out 2023-10-16T08:56:01.056 INFO:teuthology.orchestra.run.smithi094.stdout:520 2023-10-16T08:56:01.057 INFO:teuthology.orchestra.run.smithi094.stdout:520.out 2023-10-16T08:56:01.057 INFO:teuthology.orchestra.run.smithi094.stdout:521 2023-10-16T08:56:01.057 INFO:teuthology.orchestra.run.smithi094.stdout:521.out 2023-10-16T08:56:01.057 INFO:teuthology.orchestra.run.smithi094.stdout:522 2023-10-16T08:56:01.057 INFO:teuthology.orchestra.run.smithi094.stdout:522.out 2023-10-16T08:56:01.057 INFO:teuthology.orchestra.run.smithi094.stdout:523 2023-10-16T08:56:01.058 INFO:teuthology.orchestra.run.smithi094.stdout:523.out 2023-10-16T08:56:01.058 INFO:teuthology.orchestra.run.smithi094.stdout:524 2023-10-16T08:56:01.058 INFO:teuthology.orchestra.run.smithi094.stdout:524.out 2023-10-16T08:56:01.058 INFO:teuthology.orchestra.run.smithi094.stdout:525 2023-10-16T08:56:01.058 INFO:teuthology.orchestra.run.smithi094.stdout:525.out 2023-10-16T08:56:01.059 INFO:teuthology.orchestra.run.smithi094.stdout:526 2023-10-16T08:56:01.059 INFO:teuthology.orchestra.run.smithi094.stdout:526.out 2023-10-16T08:56:01.059 INFO:teuthology.orchestra.run.smithi094.stdout:527 2023-10-16T08:56:01.059 INFO:teuthology.orchestra.run.smithi094.stdout:527.out 2023-10-16T08:56:01.059 INFO:teuthology.orchestra.run.smithi094.stdout:528 2023-10-16T08:56:01.059 INFO:teuthology.orchestra.run.smithi094.stdout:528.out 2023-10-16T08:56:01.060 INFO:teuthology.orchestra.run.smithi094.stdout:529 2023-10-16T08:56:01.060 INFO:teuthology.orchestra.run.smithi094.stdout:529.out 2023-10-16T08:56:01.060 INFO:teuthology.orchestra.run.smithi094.stdout:530 2023-10-16T08:56:01.060 INFO:teuthology.orchestra.run.smithi094.stdout:530.out 2023-10-16T08:56:01.060 INFO:teuthology.orchestra.run.smithi094.stdout:531 2023-10-16T08:56:01.061 INFO:teuthology.orchestra.run.smithi094.stdout:531.out 2023-10-16T08:56:01.061 INFO:teuthology.orchestra.run.smithi094.stdout:532 2023-10-16T08:56:01.061 INFO:teuthology.orchestra.run.smithi094.stdout:532.out 2023-10-16T08:56:01.061 INFO:teuthology.orchestra.run.smithi094.stdout:533 2023-10-16T08:56:01.061 INFO:teuthology.orchestra.run.smithi094.stdout:533.out 2023-10-16T08:56:01.061 INFO:teuthology.orchestra.run.smithi094.stdout:534 2023-10-16T08:56:01.062 INFO:teuthology.orchestra.run.smithi094.stdout:534.out 2023-10-16T08:56:01.062 INFO:teuthology.orchestra.run.smithi094.stdout:535 2023-10-16T08:56:01.062 INFO:teuthology.orchestra.run.smithi094.stdout:535.out 2023-10-16T08:56:01.062 INFO:teuthology.orchestra.run.smithi094.stdout:536 2023-10-16T08:56:01.062 INFO:teuthology.orchestra.run.smithi094.stdout:536.out 2023-10-16T08:56:01.063 INFO:teuthology.orchestra.run.smithi094.stdout:537 2023-10-16T08:56:01.063 INFO:teuthology.orchestra.run.smithi094.stdout:537.out 2023-10-16T08:56:01.063 INFO:teuthology.orchestra.run.smithi094.stdout:538 2023-10-16T08:56:01.063 INFO:teuthology.orchestra.run.smithi094.stdout:538.out 2023-10-16T08:56:01.063 INFO:teuthology.orchestra.run.smithi094.stdout:539 2023-10-16T08:56:01.063 INFO:teuthology.orchestra.run.smithi094.stdout:539.out 2023-10-16T08:56:01.064 INFO:teuthology.orchestra.run.smithi094.stdout:540 2023-10-16T08:56:01.064 INFO:teuthology.orchestra.run.smithi094.stdout:540.out 2023-10-16T08:56:01.064 INFO:teuthology.orchestra.run.smithi094.stdout:541 2023-10-16T08:56:01.064 INFO:teuthology.orchestra.run.smithi094.stdout:541.out 2023-10-16T08:56:01.064 INFO:teuthology.orchestra.run.smithi094.stdout:542 2023-10-16T08:56:01.064 INFO:teuthology.orchestra.run.smithi094.stdout:542.out 2023-10-16T08:56:01.065 INFO:teuthology.orchestra.run.smithi094.stdout:543 2023-10-16T08:56:01.065 INFO:teuthology.orchestra.run.smithi094.stdout:543.out 2023-10-16T08:56:01.065 INFO:teuthology.orchestra.run.smithi094.stdout:544 2023-10-16T08:56:01.065 INFO:teuthology.orchestra.run.smithi094.stdout:544.out 2023-10-16T08:56:01.065 INFO:teuthology.orchestra.run.smithi094.stdout:545 2023-10-16T08:56:01.066 INFO:teuthology.orchestra.run.smithi094.stdout:545.out 2023-10-16T08:56:01.066 INFO:teuthology.orchestra.run.smithi094.stdout:546 2023-10-16T08:56:01.066 INFO:teuthology.orchestra.run.smithi094.stdout:546.out 2023-10-16T08:56:01.066 INFO:teuthology.orchestra.run.smithi094.stdout:547 2023-10-16T08:56:01.066 INFO:teuthology.orchestra.run.smithi094.stdout:547.out 2023-10-16T08:56:01.066 INFO:teuthology.orchestra.run.smithi094.stdout:548 2023-10-16T08:56:01.067 INFO:teuthology.orchestra.run.smithi094.stdout:548.out 2023-10-16T08:56:01.067 INFO:teuthology.orchestra.run.smithi094.stdout:549 2023-10-16T08:56:01.067 INFO:teuthology.orchestra.run.smithi094.stdout:549.out 2023-10-16T08:56:01.067 INFO:teuthology.orchestra.run.smithi094.stdout:550 2023-10-16T08:56:01.067 INFO:teuthology.orchestra.run.smithi094.stdout:550.out 2023-10-16T08:56:01.068 INFO:teuthology.orchestra.run.smithi094.stdout:551 2023-10-16T08:56:01.068 INFO:teuthology.orchestra.run.smithi094.stdout:551.out 2023-10-16T08:56:01.068 INFO:teuthology.orchestra.run.smithi094.stdout:552 2023-10-16T08:56:01.068 INFO:teuthology.orchestra.run.smithi094.stdout:552.out 2023-10-16T08:56:01.068 INFO:teuthology.orchestra.run.smithi094.stdout:553 2023-10-16T08:56:01.068 INFO:teuthology.orchestra.run.smithi094.stdout:553.out 2023-10-16T08:56:01.069 INFO:teuthology.orchestra.run.smithi094.stdout:554 2023-10-16T08:56:01.069 INFO:teuthology.orchestra.run.smithi094.stdout:554.out 2023-10-16T08:56:01.069 INFO:teuthology.orchestra.run.smithi094.stdout:555 2023-10-16T08:56:01.069 INFO:teuthology.orchestra.run.smithi094.stdout:555.out 2023-10-16T08:56:01.069 INFO:teuthology.orchestra.run.smithi094.stdout:556 2023-10-16T08:56:01.070 INFO:teuthology.orchestra.run.smithi094.stdout:556.out 2023-10-16T08:56:01.070 INFO:teuthology.orchestra.run.smithi094.stdout:557 2023-10-16T08:56:01.070 INFO:teuthology.orchestra.run.smithi094.stdout:557.out 2023-10-16T08:56:01.070 INFO:teuthology.orchestra.run.smithi094.stdout:558 2023-10-16T08:56:01.070 INFO:teuthology.orchestra.run.smithi094.stdout:558.out 2023-10-16T08:56:01.070 INFO:teuthology.orchestra.run.smithi094.stdout:559 2023-10-16T08:56:01.071 INFO:teuthology.orchestra.run.smithi094.stdout:559.out 2023-10-16T08:56:01.071 INFO:teuthology.orchestra.run.smithi094.stdout:560 2023-10-16T08:56:01.071 INFO:teuthology.orchestra.run.smithi094.stdout:560.out 2023-10-16T08:56:01.071 INFO:teuthology.orchestra.run.smithi094.stdout:561 2023-10-16T08:56:01.071 INFO:teuthology.orchestra.run.smithi094.stdout:561.out 2023-10-16T08:56:01.072 INFO:teuthology.orchestra.run.smithi094.stdout:562 2023-10-16T08:56:01.072 INFO:teuthology.orchestra.run.smithi094.stdout:562.out 2023-10-16T08:56:01.072 INFO:teuthology.orchestra.run.smithi094.stdout:563 2023-10-16T08:56:01.072 INFO:teuthology.orchestra.run.smithi094.stdout:563.out 2023-10-16T08:56:01.072 INFO:teuthology.orchestra.run.smithi094.stdout:564 2023-10-16T08:56:01.072 INFO:teuthology.orchestra.run.smithi094.stdout:564.out 2023-10-16T08:56:01.073 INFO:teuthology.orchestra.run.smithi094.stdout:565 2023-10-16T08:56:01.073 INFO:teuthology.orchestra.run.smithi094.stdout:565.out 2023-10-16T08:56:01.073 INFO:teuthology.orchestra.run.smithi094.stdout:566 2023-10-16T08:56:01.073 INFO:teuthology.orchestra.run.smithi094.stdout:566.out 2023-10-16T08:56:01.073 INFO:teuthology.orchestra.run.smithi094.stdout:567 2023-10-16T08:56:01.074 INFO:teuthology.orchestra.run.smithi094.stdout:567.out 2023-10-16T08:56:01.074 INFO:teuthology.orchestra.run.smithi094.stdout:568 2023-10-16T08:56:01.074 INFO:teuthology.orchestra.run.smithi094.stdout:568.out 2023-10-16T08:56:01.074 INFO:teuthology.orchestra.run.smithi094.stdout:569 2023-10-16T08:56:01.074 INFO:teuthology.orchestra.run.smithi094.stdout:569.out 2023-10-16T08:56:01.075 INFO:teuthology.orchestra.run.smithi094.stdout:570 2023-10-16T08:56:01.075 INFO:teuthology.orchestra.run.smithi094.stdout:570.out 2023-10-16T08:56:01.075 INFO:teuthology.orchestra.run.smithi094.stdout:571 2023-10-16T08:56:01.075 INFO:teuthology.orchestra.run.smithi094.stdout:571.out 2023-10-16T08:56:01.075 INFO:teuthology.orchestra.run.smithi094.stdout:572 2023-10-16T08:56:01.075 INFO:teuthology.orchestra.run.smithi094.stdout:572.out 2023-10-16T08:56:01.076 INFO:teuthology.orchestra.run.smithi094.stdout:573 2023-10-16T08:56:01.076 INFO:teuthology.orchestra.run.smithi094.stdout:573.out 2023-10-16T08:56:01.076 INFO:teuthology.orchestra.run.smithi094.stdout:574 2023-10-16T08:56:01.076 INFO:teuthology.orchestra.run.smithi094.stdout:574.out 2023-10-16T08:56:01.076 INFO:teuthology.orchestra.run.smithi094.stdout:575 2023-10-16T08:56:01.077 INFO:teuthology.orchestra.run.smithi094.stdout:575.out 2023-10-16T08:56:01.077 INFO:teuthology.orchestra.run.smithi094.stdout:576 2023-10-16T08:56:01.077 INFO:teuthology.orchestra.run.smithi094.stdout:576.out 2023-10-16T08:56:01.077 INFO:teuthology.orchestra.run.smithi094.stdout:577 2023-10-16T08:56:01.077 INFO:teuthology.orchestra.run.smithi094.stdout:577.out 2023-10-16T08:56:01.077 INFO:teuthology.orchestra.run.smithi094.stdout:578 2023-10-16T08:56:01.078 INFO:teuthology.orchestra.run.smithi094.stdout:578.out 2023-10-16T08:56:01.078 INFO:teuthology.orchestra.run.smithi094.stdout:579 2023-10-16T08:56:01.078 INFO:teuthology.orchestra.run.smithi094.stdout:579.out 2023-10-16T08:56:01.078 INFO:teuthology.orchestra.run.smithi094.stdout:580 2023-10-16T08:56:01.078 INFO:teuthology.orchestra.run.smithi094.stdout:580.out 2023-10-16T08:56:01.079 INFO:teuthology.orchestra.run.smithi094.stdout:581 2023-10-16T08:56:01.079 INFO:teuthology.orchestra.run.smithi094.stdout:581.out 2023-10-16T08:56:01.079 INFO:teuthology.orchestra.run.smithi094.stdout:582 2023-10-16T08:56:01.079 INFO:teuthology.orchestra.run.smithi094.stdout:582.out 2023-10-16T08:56:01.079 INFO:teuthology.orchestra.run.smithi094.stdout:583 2023-10-16T08:56:01.079 INFO:teuthology.orchestra.run.smithi094.stdout:583.out 2023-10-16T08:56:01.080 INFO:teuthology.orchestra.run.smithi094.stdout:584 2023-10-16T08:56:01.080 INFO:teuthology.orchestra.run.smithi094.stdout:584.out 2023-10-16T08:56:01.080 INFO:teuthology.orchestra.run.smithi094.stdout:585 2023-10-16T08:56:01.080 INFO:teuthology.orchestra.run.smithi094.stdout:585.out 2023-10-16T08:56:01.080 INFO:teuthology.orchestra.run.smithi094.stdout:586 2023-10-16T08:56:01.081 INFO:teuthology.orchestra.run.smithi094.stdout:586.out 2023-10-16T08:56:01.081 INFO:teuthology.orchestra.run.smithi094.stdout:587 2023-10-16T08:56:01.081 INFO:teuthology.orchestra.run.smithi094.stdout:587.out 2023-10-16T08:56:01.081 INFO:teuthology.orchestra.run.smithi094.stdout:588 2023-10-16T08:56:01.081 INFO:teuthology.orchestra.run.smithi094.stdout:588.out 2023-10-16T08:56:01.082 INFO:teuthology.orchestra.run.smithi094.stdout:589 2023-10-16T08:56:01.082 INFO:teuthology.orchestra.run.smithi094.stdout:589.out 2023-10-16T08:56:01.082 INFO:teuthology.orchestra.run.smithi094.stdout:590 2023-10-16T08:56:01.082 INFO:teuthology.orchestra.run.smithi094.stdout:590.out 2023-10-16T08:56:01.082 INFO:teuthology.orchestra.run.smithi094.stdout:591 2023-10-16T08:56:01.083 INFO:teuthology.orchestra.run.smithi094.stdout:591.out 2023-10-16T08:56:01.083 INFO:teuthology.orchestra.run.smithi094.stdout:592 2023-10-16T08:56:01.083 INFO:teuthology.orchestra.run.smithi094.stdout:592.out 2023-10-16T08:56:01.083 INFO:teuthology.orchestra.run.smithi094.stdout:593 2023-10-16T08:56:01.083 INFO:teuthology.orchestra.run.smithi094.stdout:593.out 2023-10-16T08:56:01.083 INFO:teuthology.orchestra.run.smithi094.stdout:594 2023-10-16T08:56:01.084 INFO:teuthology.orchestra.run.smithi094.stdout:594.out 2023-10-16T08:56:01.084 INFO:teuthology.orchestra.run.smithi094.stdout:595 2023-10-16T08:56:01.084 INFO:teuthology.orchestra.run.smithi094.stdout:595.out 2023-10-16T08:56:01.084 INFO:teuthology.orchestra.run.smithi094.stdout:596 2023-10-16T08:56:01.084 INFO:teuthology.orchestra.run.smithi094.stdout:596.out 2023-10-16T08:56:01.085 INFO:teuthology.orchestra.run.smithi094.stdout:597 2023-10-16T08:56:01.085 INFO:teuthology.orchestra.run.smithi094.stdout:597.out 2023-10-16T08:56:01.085 INFO:teuthology.orchestra.run.smithi094.stdout:598 2023-10-16T08:56:01.085 INFO:teuthology.orchestra.run.smithi094.stdout:598.out 2023-10-16T08:56:01.085 INFO:teuthology.orchestra.run.smithi094.stdout:599 2023-10-16T08:56:01.086 INFO:teuthology.orchestra.run.smithi094.stdout:599.out 2023-10-16T08:56:01.086 INFO:teuthology.orchestra.run.smithi094.stdout:600 2023-10-16T08:56:01.086 INFO:teuthology.orchestra.run.smithi094.stdout:600.out 2023-10-16T08:56:01.086 INFO:teuthology.orchestra.run.smithi094.stdout:601 2023-10-16T08:56:01.086 INFO:teuthology.orchestra.run.smithi094.stdout:601.out 2023-10-16T08:56:01.087 INFO:teuthology.orchestra.run.smithi094.stdout:602 2023-10-16T08:56:01.087 INFO:teuthology.orchestra.run.smithi094.stdout:602.out 2023-10-16T08:56:01.087 INFO:teuthology.orchestra.run.smithi094.stdout:603 2023-10-16T08:56:01.087 INFO:teuthology.orchestra.run.smithi094.stdout:603.out 2023-10-16T08:56:01.087 INFO:teuthology.orchestra.run.smithi094.stdout:604 2023-10-16T08:56:01.087 INFO:teuthology.orchestra.run.smithi094.stdout:604.out 2023-10-16T08:56:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:605 2023-10-16T08:56:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:605.out 2023-10-16T08:56:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:606 2023-10-16T08:56:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:606.out 2023-10-16T08:56:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:607 2023-10-16T08:56:01.089 INFO:teuthology.orchestra.run.smithi094.stdout:607.out 2023-10-16T08:56:01.089 INFO:teuthology.orchestra.run.smithi094.stdout:608 2023-10-16T08:56:01.089 INFO:teuthology.orchestra.run.smithi094.stdout:608.out 2023-10-16T08:56:01.089 INFO:teuthology.orchestra.run.smithi094.stdout:609 2023-10-16T08:56:01.089 INFO:teuthology.orchestra.run.smithi094.stdout:609.out 2023-10-16T08:56:01.089 INFO:teuthology.orchestra.run.smithi094.stdout:610 2023-10-16T08:56:01.090 INFO:teuthology.orchestra.run.smithi094.stdout:610.out 2023-10-16T08:56:01.090 INFO:teuthology.orchestra.run.smithi094.stdout:611 2023-10-16T08:56:01.090 INFO:teuthology.orchestra.run.smithi094.stdout:611.out 2023-10-16T08:56:01.090 INFO:teuthology.orchestra.run.smithi094.stdout:612 2023-10-16T08:56:01.090 INFO:teuthology.orchestra.run.smithi094.stdout:612.out 2023-10-16T08:56:01.091 INFO:teuthology.orchestra.run.smithi094.stdout:613 2023-10-16T08:56:01.091 INFO:teuthology.orchestra.run.smithi094.stdout:613.out 2023-10-16T08:56:01.091 INFO:teuthology.orchestra.run.smithi094.stdout:614 2023-10-16T08:56:01.091 INFO:teuthology.orchestra.run.smithi094.stdout:614.out 2023-10-16T08:56:01.091 INFO:teuthology.orchestra.run.smithi094.stdout:615 2023-10-16T08:56:01.092 INFO:teuthology.orchestra.run.smithi094.stdout:615.out 2023-10-16T08:56:01.092 INFO:teuthology.orchestra.run.smithi094.stdout:616 2023-10-16T08:56:01.092 INFO:teuthology.orchestra.run.smithi094.stdout:616.out 2023-10-16T08:56:01.092 INFO:teuthology.orchestra.run.smithi094.stdout:617 2023-10-16T08:56:01.092 INFO:teuthology.orchestra.run.smithi094.stdout:617.out 2023-10-16T08:56:01.092 INFO:teuthology.orchestra.run.smithi094.stdout:618 2023-10-16T08:56:01.093 INFO:teuthology.orchestra.run.smithi094.stdout:618.out 2023-10-16T08:56:01.093 INFO:teuthology.orchestra.run.smithi094.stdout:619 2023-10-16T08:56:01.093 INFO:teuthology.orchestra.run.smithi094.stdout:619.out 2023-10-16T08:56:01.093 INFO:teuthology.orchestra.run.smithi094.stdout:620 2023-10-16T08:56:01.093 INFO:teuthology.orchestra.run.smithi094.stdout:620.out 2023-10-16T08:56:01.093 INFO:teuthology.orchestra.run.smithi094.stdout:621 2023-10-16T08:56:01.094 INFO:teuthology.orchestra.run.smithi094.stdout:621.out 2023-10-16T08:56:01.094 INFO:teuthology.orchestra.run.smithi094.stdout:622 2023-10-16T08:56:01.094 INFO:teuthology.orchestra.run.smithi094.stdout:622.out 2023-10-16T08:56:01.094 INFO:teuthology.orchestra.run.smithi094.stdout:623 2023-10-16T08:56:01.094 INFO:teuthology.orchestra.run.smithi094.stdout:623.out 2023-10-16T08:56:01.095 INFO:teuthology.orchestra.run.smithi094.stdout:624 2023-10-16T08:56:01.095 INFO:teuthology.orchestra.run.smithi094.stdout:624.out 2023-10-16T08:56:01.095 INFO:teuthology.orchestra.run.smithi094.stdout:625 2023-10-16T08:56:01.095 INFO:teuthology.orchestra.run.smithi094.stdout:625.out 2023-10-16T08:56:01.095 INFO:teuthology.orchestra.run.smithi094.stdout:626 2023-10-16T08:56:01.096 INFO:teuthology.orchestra.run.smithi094.stdout:626.out 2023-10-16T08:56:01.096 INFO:teuthology.orchestra.run.smithi094.stdout:627 2023-10-16T08:56:01.096 INFO:teuthology.orchestra.run.smithi094.stdout:627.out 2023-10-16T08:56:01.096 INFO:teuthology.orchestra.run.smithi094.stdout:628 2023-10-16T08:56:01.096 INFO:teuthology.orchestra.run.smithi094.stdout:628.out 2023-10-16T08:56:01.096 INFO:teuthology.orchestra.run.smithi094.stdout:629 2023-10-16T08:56:01.097 INFO:teuthology.orchestra.run.smithi094.stdout:629.out 2023-10-16T08:56:01.097 INFO:teuthology.orchestra.run.smithi094.stdout:630 2023-10-16T08:56:01.097 INFO:teuthology.orchestra.run.smithi094.stdout:630.out 2023-10-16T08:56:01.097 INFO:teuthology.orchestra.run.smithi094.stdout:631 2023-10-16T08:56:01.097 INFO:teuthology.orchestra.run.smithi094.stdout:631.out 2023-10-16T08:56:01.098 INFO:teuthology.orchestra.run.smithi094.stdout:632 2023-10-16T08:56:01.098 INFO:teuthology.orchestra.run.smithi094.stdout:632.out 2023-10-16T08:56:01.098 INFO:teuthology.orchestra.run.smithi094.stdout:633 2023-10-16T08:56:01.098 INFO:teuthology.orchestra.run.smithi094.stdout:633.out 2023-10-16T08:56:01.098 INFO:teuthology.orchestra.run.smithi094.stdout:634 2023-10-16T08:56:01.098 INFO:teuthology.orchestra.run.smithi094.stdout:634.out 2023-10-16T08:56:01.099 INFO:teuthology.orchestra.run.smithi094.stdout:635 2023-10-16T08:56:01.099 INFO:teuthology.orchestra.run.smithi094.stdout:635.out 2023-10-16T08:56:01.099 INFO:teuthology.orchestra.run.smithi094.stdout:636 2023-10-16T08:56:01.099 INFO:teuthology.orchestra.run.smithi094.stdout:636.out 2023-10-16T08:56:01.099 INFO:teuthology.orchestra.run.smithi094.stdout:637 2023-10-16T08:56:01.100 INFO:teuthology.orchestra.run.smithi094.stdout:637.out 2023-10-16T08:56:01.100 INFO:teuthology.orchestra.run.smithi094.stdout:638 2023-10-16T08:56:01.100 INFO:teuthology.orchestra.run.smithi094.stdout:638.out 2023-10-16T08:56:01.100 INFO:teuthology.orchestra.run.smithi094.stdout:639 2023-10-16T08:56:01.100 INFO:teuthology.orchestra.run.smithi094.stdout:639.out 2023-10-16T08:56:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:640 2023-10-16T08:56:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:640.out 2023-10-16T08:56:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:641 2023-10-16T08:56:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:641.out 2023-10-16T08:56:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:642 2023-10-16T08:56:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:642.out 2023-10-16T08:56:01.102 INFO:teuthology.orchestra.run.smithi094.stdout:643 2023-10-16T08:56:01.102 INFO:teuthology.orchestra.run.smithi094.stdout:643.out 2023-10-16T08:56:01.102 INFO:teuthology.orchestra.run.smithi094.stdout:644 2023-10-16T08:56:01.102 INFO:teuthology.orchestra.run.smithi094.stdout:644.out 2023-10-16T08:56:01.102 INFO:teuthology.orchestra.run.smithi094.stdout:645 2023-10-16T08:56:01.103 INFO:teuthology.orchestra.run.smithi094.stdout:645.out 2023-10-16T08:56:01.103 INFO:teuthology.orchestra.run.smithi094.stdout:646 2023-10-16T08:56:01.103 INFO:teuthology.orchestra.run.smithi094.stdout:646.out 2023-10-16T08:56:01.103 INFO:teuthology.orchestra.run.smithi094.stdout:647 2023-10-16T08:56:01.103 INFO:teuthology.orchestra.run.smithi094.stdout:647.out 2023-10-16T08:56:01.104 INFO:teuthology.orchestra.run.smithi094.stdout:648 2023-10-16T08:56:01.104 INFO:teuthology.orchestra.run.smithi094.stdout:648.out 2023-10-16T08:56:01.104 INFO:teuthology.orchestra.run.smithi094.stdout:649 2023-10-16T08:56:01.104 INFO:teuthology.orchestra.run.smithi094.stdout:649.out 2023-10-16T08:56:01.104 INFO:teuthology.orchestra.run.smithi094.stdout:650 2023-10-16T08:56:01.104 INFO:teuthology.orchestra.run.smithi094.stdout:650.out 2023-10-16T08:56:01.105 INFO:teuthology.orchestra.run.smithi094.stdout:651 2023-10-16T08:56:01.105 INFO:teuthology.orchestra.run.smithi094.stdout:651.out 2023-10-16T08:56:01.105 INFO:teuthology.orchestra.run.smithi094.stdout:652 2023-10-16T08:56:01.105 INFO:teuthology.orchestra.run.smithi094.stdout:652.out 2023-10-16T08:56:01.105 INFO:teuthology.orchestra.run.smithi094.stdout:653 2023-10-16T08:56:01.105 INFO:teuthology.orchestra.run.smithi094.stdout:653.out 2023-10-16T08:56:01.106 INFO:teuthology.orchestra.run.smithi094.stdout:654 2023-10-16T08:56:01.106 INFO:teuthology.orchestra.run.smithi094.stdout:654.out 2023-10-16T08:56:01.106 INFO:teuthology.orchestra.run.smithi094.stdout:655 2023-10-16T08:56:01.106 INFO:teuthology.orchestra.run.smithi094.stdout:655.out 2023-10-16T08:56:01.106 INFO:teuthology.orchestra.run.smithi094.stdout:656 2023-10-16T08:56:01.107 INFO:teuthology.orchestra.run.smithi094.stdout:656.out 2023-10-16T08:56:01.107 INFO:teuthology.orchestra.run.smithi094.stdout:657 2023-10-16T08:56:01.107 INFO:teuthology.orchestra.run.smithi094.stdout:657.out 2023-10-16T08:56:01.107 INFO:teuthology.orchestra.run.smithi094.stdout:658 2023-10-16T08:56:01.107 INFO:teuthology.orchestra.run.smithi094.stdout:658.out 2023-10-16T08:56:01.107 INFO:teuthology.orchestra.run.smithi094.stdout:659 2023-10-16T08:56:01.108 INFO:teuthology.orchestra.run.smithi094.stdout:659.out 2023-10-16T08:56:01.108 INFO:teuthology.orchestra.run.smithi094.stdout:660 2023-10-16T08:56:01.108 INFO:teuthology.orchestra.run.smithi094.stdout:660.out 2023-10-16T08:56:01.108 INFO:teuthology.orchestra.run.smithi094.stdout:661 2023-10-16T08:56:01.108 INFO:teuthology.orchestra.run.smithi094.stdout:661.out 2023-10-16T08:56:01.109 INFO:teuthology.orchestra.run.smithi094.stdout:662 2023-10-16T08:56:01.109 INFO:teuthology.orchestra.run.smithi094.stdout:662.out 2023-10-16T08:56:01.109 INFO:teuthology.orchestra.run.smithi094.stdout:663 2023-10-16T08:56:01.109 INFO:teuthology.orchestra.run.smithi094.stdout:663.out 2023-10-16T08:56:01.109 INFO:teuthology.orchestra.run.smithi094.stdout:664 2023-10-16T08:56:01.109 INFO:teuthology.orchestra.run.smithi094.stdout:664.out 2023-10-16T08:56:01.110 INFO:teuthology.orchestra.run.smithi094.stdout:665 2023-10-16T08:56:01.110 INFO:teuthology.orchestra.run.smithi094.stdout:665.out 2023-10-16T08:56:01.110 INFO:teuthology.orchestra.run.smithi094.stdout:666 2023-10-16T08:56:01.110 INFO:teuthology.orchestra.run.smithi094.stdout:666.out 2023-10-16T08:56:01.110 INFO:teuthology.orchestra.run.smithi094.stdout:667 2023-10-16T08:56:01.110 INFO:teuthology.orchestra.run.smithi094.stdout:667.out 2023-10-16T08:56:01.111 INFO:teuthology.orchestra.run.smithi094.stdout:668 2023-10-16T08:56:01.111 INFO:teuthology.orchestra.run.smithi094.stdout:668.out 2023-10-16T08:56:01.111 INFO:teuthology.orchestra.run.smithi094.stdout:669 2023-10-16T08:56:01.111 INFO:teuthology.orchestra.run.smithi094.stdout:669.out 2023-10-16T08:56:01.111 INFO:teuthology.orchestra.run.smithi094.stdout:670 2023-10-16T08:56:01.112 INFO:teuthology.orchestra.run.smithi094.stdout:670.out 2023-10-16T08:56:01.112 INFO:teuthology.orchestra.run.smithi094.stdout:671 2023-10-16T08:56:01.112 INFO:teuthology.orchestra.run.smithi094.stdout:671.out 2023-10-16T08:56:01.112 INFO:teuthology.orchestra.run.smithi094.stdout:672 2023-10-16T08:56:01.112 INFO:teuthology.orchestra.run.smithi094.stdout:672.out 2023-10-16T08:56:01.112 INFO:teuthology.orchestra.run.smithi094.stdout:673 2023-10-16T08:56:01.113 INFO:teuthology.orchestra.run.smithi094.stdout:673.out 2023-10-16T08:56:01.113 INFO:teuthology.orchestra.run.smithi094.stdout:674 2023-10-16T08:56:01.113 INFO:teuthology.orchestra.run.smithi094.stdout:674.out 2023-10-16T08:56:01.113 INFO:teuthology.orchestra.run.smithi094.stdout:675 2023-10-16T08:56:01.113 INFO:teuthology.orchestra.run.smithi094.stdout:675.out 2023-10-16T08:56:01.114 INFO:teuthology.orchestra.run.smithi094.stdout:676 2023-10-16T08:56:01.114 INFO:teuthology.orchestra.run.smithi094.stdout:676.out 2023-10-16T08:56:01.114 INFO:teuthology.orchestra.run.smithi094.stdout:677 2023-10-16T08:56:01.114 INFO:teuthology.orchestra.run.smithi094.stdout:677.out 2023-10-16T08:56:01.114 INFO:teuthology.orchestra.run.smithi094.stdout:678 2023-10-16T08:56:01.114 INFO:teuthology.orchestra.run.smithi094.stdout:678.out 2023-10-16T08:56:01.115 INFO:teuthology.orchestra.run.smithi094.stdout:679 2023-10-16T08:56:01.115 INFO:teuthology.orchestra.run.smithi094.stdout:679.out 2023-10-16T08:56:01.115 INFO:teuthology.orchestra.run.smithi094.stdout:680 2023-10-16T08:56:01.115 INFO:teuthology.orchestra.run.smithi094.stdout:680.out 2023-10-16T08:56:01.115 INFO:teuthology.orchestra.run.smithi094.stdout:681 2023-10-16T08:56:01.116 INFO:teuthology.orchestra.run.smithi094.stdout:681.out 2023-10-16T08:56:01.116 INFO:teuthology.orchestra.run.smithi094.stdout:682 2023-10-16T08:56:01.116 INFO:teuthology.orchestra.run.smithi094.stdout:682.out 2023-10-16T08:56:01.116 INFO:teuthology.orchestra.run.smithi094.stdout:683 2023-10-16T08:56:01.116 INFO:teuthology.orchestra.run.smithi094.stdout:683.out 2023-10-16T08:56:01.116 INFO:teuthology.orchestra.run.smithi094.stdout:684 2023-10-16T08:56:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:684.out 2023-10-16T08:56:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:685 2023-10-16T08:56:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:685.out 2023-10-16T08:56:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:686 2023-10-16T08:56:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:686.out 2023-10-16T08:56:01.117 INFO:teuthology.orchestra.run.smithi094.stdout:687 2023-10-16T08:56:01.118 INFO:teuthology.orchestra.run.smithi094.stdout:687.out 2023-10-16T08:56:01.118 INFO:teuthology.orchestra.run.smithi094.stdout:688 2023-10-16T08:56:01.118 INFO:teuthology.orchestra.run.smithi094.stdout:688.out 2023-10-16T08:56:01.118 INFO:teuthology.orchestra.run.smithi094.stdout:689 2023-10-16T08:56:01.118 INFO:teuthology.orchestra.run.smithi094.stdout:689.out 2023-10-16T08:56:01.119 INFO:teuthology.orchestra.run.smithi094.stdout:690 2023-10-16T08:56:01.119 INFO:teuthology.orchestra.run.smithi094.stdout:690.out 2023-10-16T08:56:01.119 INFO:teuthology.orchestra.run.smithi094.stdout:691 2023-10-16T08:56:01.119 INFO:teuthology.orchestra.run.smithi094.stdout:691.out 2023-10-16T08:56:01.119 INFO:teuthology.orchestra.run.smithi094.stdout:692 2023-10-16T08:56:01.119 INFO:teuthology.orchestra.run.smithi094.stdout:692.out 2023-10-16T08:56:01.120 INFO:teuthology.orchestra.run.smithi094.stdout:693 2023-10-16T08:56:01.120 INFO:teuthology.orchestra.run.smithi094.stdout:693.out 2023-10-16T08:56:01.120 INFO:teuthology.orchestra.run.smithi094.stdout:694 2023-10-16T08:56:01.120 INFO:teuthology.orchestra.run.smithi094.stdout:694.out 2023-10-16T08:56:01.120 INFO:teuthology.orchestra.run.smithi094.stdout:695 2023-10-16T08:56:01.121 INFO:teuthology.orchestra.run.smithi094.stdout:695.out 2023-10-16T08:56:01.121 INFO:teuthology.orchestra.run.smithi094.stdout:696 2023-10-16T08:56:01.121 INFO:teuthology.orchestra.run.smithi094.stdout:696.out 2023-10-16T08:56:01.121 INFO:teuthology.orchestra.run.smithi094.stdout:697 2023-10-16T08:56:01.121 INFO:teuthology.orchestra.run.smithi094.stdout:697.out 2023-10-16T08:56:01.121 INFO:teuthology.orchestra.run.smithi094.stdout:698 2023-10-16T08:56:01.122 INFO:teuthology.orchestra.run.smithi094.stdout:698.out 2023-10-16T08:56:01.122 INFO:teuthology.orchestra.run.smithi094.stdout:699 2023-10-16T08:56:01.122 INFO:teuthology.orchestra.run.smithi094.stdout:699.out 2023-10-16T08:56:01.122 INFO:teuthology.orchestra.run.smithi094.stdout:700 2023-10-16T08:56:01.122 INFO:teuthology.orchestra.run.smithi094.stdout:700.out 2023-10-16T08:56:01.123 INFO:teuthology.orchestra.run.smithi094.stdout:701 2023-10-16T08:56:01.123 INFO:teuthology.orchestra.run.smithi094.stdout:701.out 2023-10-16T08:56:01.123 INFO:teuthology.orchestra.run.smithi094.stdout:702 2023-10-16T08:56:01.123 INFO:teuthology.orchestra.run.smithi094.stdout:702.out 2023-10-16T08:56:01.123 INFO:teuthology.orchestra.run.smithi094.stdout:703 2023-10-16T08:56:01.123 INFO:teuthology.orchestra.run.smithi094.stdout:703.out 2023-10-16T08:56:01.124 INFO:teuthology.orchestra.run.smithi094.stdout:704 2023-10-16T08:56:01.124 INFO:teuthology.orchestra.run.smithi094.stdout:704.out 2023-10-16T08:56:01.124 INFO:teuthology.orchestra.run.smithi094.stdout:705 2023-10-16T08:56:01.124 INFO:teuthology.orchestra.run.smithi094.stdout:705.out 2023-10-16T08:56:01.124 INFO:teuthology.orchestra.run.smithi094.stdout:706 2023-10-16T08:56:01.124 INFO:teuthology.orchestra.run.smithi094.stdout:706.out 2023-10-16T08:56:01.125 INFO:teuthology.orchestra.run.smithi094.stdout:707 2023-10-16T08:56:01.125 INFO:teuthology.orchestra.run.smithi094.stdout:707.out 2023-10-16T08:56:01.125 INFO:teuthology.orchestra.run.smithi094.stdout:708 2023-10-16T08:56:01.125 INFO:teuthology.orchestra.run.smithi094.stdout:708.out 2023-10-16T08:56:01.125 INFO:teuthology.orchestra.run.smithi094.stdout:709 2023-10-16T08:56:01.126 INFO:teuthology.orchestra.run.smithi094.stdout:709.out 2023-10-16T08:56:01.126 INFO:teuthology.orchestra.run.smithi094.stdout:710 2023-10-16T08:56:01.126 INFO:teuthology.orchestra.run.smithi094.stdout:710.out 2023-10-16T08:56:01.126 INFO:teuthology.orchestra.run.smithi094.stdout:711 2023-10-16T08:56:01.126 INFO:teuthology.orchestra.run.smithi094.stdout:711.out 2023-10-16T08:56:01.126 INFO:teuthology.orchestra.run.smithi094.stdout:712 2023-10-16T08:56:01.127 INFO:teuthology.orchestra.run.smithi094.stdout:712.out 2023-10-16T08:56:01.127 INFO:teuthology.orchestra.run.smithi094.stdout:713 2023-10-16T08:56:01.127 INFO:teuthology.orchestra.run.smithi094.stdout:713.out 2023-10-16T08:56:01.127 INFO:teuthology.orchestra.run.smithi094.stdout:714 2023-10-16T08:56:01.127 INFO:teuthology.orchestra.run.smithi094.stdout:714.out 2023-10-16T08:56:01.128 INFO:teuthology.orchestra.run.smithi094.stdout:715 2023-10-16T08:56:01.128 INFO:teuthology.orchestra.run.smithi094.stdout:715.out 2023-10-16T08:56:01.128 INFO:teuthology.orchestra.run.smithi094.stdout:716 2023-10-16T08:56:01.128 INFO:teuthology.orchestra.run.smithi094.stdout:716.out 2023-10-16T08:56:01.128 INFO:teuthology.orchestra.run.smithi094.stdout:717 2023-10-16T08:56:01.128 INFO:teuthology.orchestra.run.smithi094.stdout:717.out 2023-10-16T08:56:01.129 INFO:teuthology.orchestra.run.smithi094.stdout:718 2023-10-16T08:56:01.129 INFO:teuthology.orchestra.run.smithi094.stdout:718.out 2023-10-16T08:56:01.129 INFO:teuthology.orchestra.run.smithi094.stdout:719 2023-10-16T08:56:01.129 INFO:teuthology.orchestra.run.smithi094.stdout:719.out 2023-10-16T08:56:01.129 INFO:teuthology.orchestra.run.smithi094.stdout:720 2023-10-16T08:56:01.129 INFO:teuthology.orchestra.run.smithi094.stdout:720.out 2023-10-16T08:56:01.130 INFO:teuthology.orchestra.run.smithi094.stdout:721 2023-10-16T08:56:01.130 INFO:teuthology.orchestra.run.smithi094.stdout:721.out 2023-10-16T08:56:01.130 INFO:teuthology.orchestra.run.smithi094.stdout:722 2023-10-16T08:56:01.130 INFO:teuthology.orchestra.run.smithi094.stdout:722.out 2023-10-16T08:56:01.130 INFO:teuthology.orchestra.run.smithi094.stdout:723 2023-10-16T08:56:01.131 INFO:teuthology.orchestra.run.smithi094.stdout:723.out 2023-10-16T08:56:01.131 INFO:teuthology.orchestra.run.smithi094.stdout:724 2023-10-16T08:56:01.131 INFO:teuthology.orchestra.run.smithi094.stdout:724.out 2023-10-16T08:56:01.131 INFO:teuthology.orchestra.run.smithi094.stdout:725 2023-10-16T08:56:01.131 INFO:teuthology.orchestra.run.smithi094.stdout:725.out 2023-10-16T08:56:01.131 INFO:teuthology.orchestra.run.smithi094.stdout:726 2023-10-16T08:56:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:726.out 2023-10-16T08:56:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:727 2023-10-16T08:56:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:727.out 2023-10-16T08:56:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:728 2023-10-16T08:56:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:728.out 2023-10-16T08:56:01.133 INFO:teuthology.orchestra.run.smithi094.stdout:729 2023-10-16T08:56:01.133 INFO:teuthology.orchestra.run.smithi094.stdout:729.out 2023-10-16T08:56:01.133 INFO:teuthology.orchestra.run.smithi094.stdout:730 2023-10-16T08:56:01.133 INFO:teuthology.orchestra.run.smithi094.stdout:730.out 2023-10-16T08:56:01.133 INFO:teuthology.orchestra.run.smithi094.stdout:731 2023-10-16T08:56:01.133 INFO:teuthology.orchestra.run.smithi094.stdout:731.out 2023-10-16T08:56:01.134 INFO:teuthology.orchestra.run.smithi094.stdout:group.list 2023-10-16T08:56:01.134 INFO:teuthology.orchestra.run.smithi094.stdout:Makefile 2023-10-16T08:56:01.135 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-10-16T08:56:01.664 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:56:01.679 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:56:01.679 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:03.423 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:56:03.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:56:10.018 INFO:teuthology.orchestra.run.smithi094.stdout:generic/001 9s 2023-10-16T08:56:10.035 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/001 2023-10-16T08:56:10.036 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:56:10.047 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:10.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[102278]: fuse finished with error 0 and tester_r 0 2023-10-16T08:56:10.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:56:10.081 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-10-16T08:56:10.606 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:56:10.620 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:56:10.620 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:11.606 INFO:teuthology.orchestra.run.smithi094.stdout:generic/002 1s 2023-10-16T08:56:11.621 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/002 2023-10-16T08:56:11.621 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:56:11.629 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:11.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:56:11.658 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-10-16T08:56:12.164 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:56:12.177 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:56:12.177 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:12.615 INFO:teuthology.orchestra.run.smithi094.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T08:56:12.629 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/003 2023-10-16T08:56:12.629 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/003 2023-10-16T08:56:12.629 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:56:12.640 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:12.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:56:12.674 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-10-16T08:56:13.212 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:56:13.225 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:56:13.225 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:13.641 INFO:teuthology.orchestra.run.smithi094.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-16T08:56:13.651 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/004 2023-10-16T08:56:13.652 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/004 2023-10-16T08:56:13.652 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:56:13.659 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:13.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:56:13.686 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-10-16T08:56:14.224 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:56:14.239 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:56:14.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:16.156 INFO:teuthology.orchestra.run.smithi094.stdout:generic/005 2s 2023-10-16T08:56:16.173 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/005 2023-10-16T08:56:16.173 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:56:16.181 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:16.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:56:16.217 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-10-16T08:56:16.720 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:56:16.732 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:56:16.732 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:56:33.855 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:56:33.864 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:57:04.009 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:57:04.014 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:57:21.322 INFO:teuthology.orchestra.run.smithi094.stdout:generic/006 65s 2023-10-16T08:57:21.337 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/006 2023-10-16T08:57:21.337 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:57:21.344 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:57:21.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:57:21.370 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-10-16T08:57:21.876 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:57:21.889 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:57:21.890 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:57:34.155 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:57:34.166 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:58:04.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:58:04.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:58:34.616 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:58:34.626 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:59:05.411 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:59:05.422 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:59:35.576 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:59:35.583 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T08:59:47.248 INFO:teuthology.orchestra.run.smithi094.stdout:generic/007 146s 2023-10-16T08:59:47.264 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/007 2023-10-16T08:59:47.264 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:59:47.273 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:47.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:59:47.315 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-10-16T08:59:47.810 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:59:47.822 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:59:47.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:51.739 INFO:teuthology.orchestra.run.smithi094.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T08:59:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/008 2023-10-16T08:59:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/008 2023-10-16T08:59:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:59:51.757 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:51.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:59:51.790 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-10-16T08:59:52.304 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:59:52.316 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:59:52.316 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:55.454 INFO:teuthology.orchestra.run.smithi094.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T08:59:55.465 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/009 2023-10-16T08:59:55.465 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/009 2023-10-16T08:59:55.465 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:59:55.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:55.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:59:55.502 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-10-16T08:59:56.049 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:59:56.063 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:59:56.063 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:56.470 INFO:teuthology.orchestra.run.smithi094.stdout:generic/010 [not run] /tmp/tmp.tcp0mkZMHZxfstests-dev/src/dbtest not built 2023-10-16T08:59:56.484 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/010 2023-10-16T08:59:56.484 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/010 2023-10-16T08:59:56.484 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T08:59:56.493 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T08:59:56.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T08:59:56.523 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-10-16T08:59:57.057 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T08:59:57.071 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T08:59:57.071 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:00:05.717 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:00:05.726 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:00:35.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:00:35.873 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:00:48.582 INFO:teuthology.orchestra.run.smithi094.stdout:generic/011 51s 2023-10-16T09:00:48.599 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/011 2023-10-16T09:00:48.599 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:00:48.607 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:00:48.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:00:48.659 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-10-16T09:00:49.183 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:00:49.195 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:00:49.195 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:00:52.251 INFO:teuthology.orchestra.run.smithi094.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:00:52.262 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/012 2023-10-16T09:00:52.263 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/012 2023-10-16T09:00:52.263 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:00:52.271 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:00:52.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:00:52.319 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-10-16T09:00:52.795 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:00:52.809 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:00:52.809 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:01:07.150 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:01:07.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:01:37.305 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:01:37.314 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:02:08.025 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:02:08.033 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:02:38.556 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:02:38.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:02:57.483 INFO:teuthology.orchestra.run.smithi094.stdout:generic/013 125s 2023-10-16T09:02:58.613 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/013 2023-10-16T09:02:58.614 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:02:58.623 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:02:58.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:02:58.656 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-10-16T09:02:59.211 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:02:59.228 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:02:59.228 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:03:08.706 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:03:08.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:03:38.852 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:03:38.860 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:03:38.988 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T09:03:38.986+0000 7f1c38ac4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148763) UID: 0 2023-10-16T09:03:38.989 INFO:tasks.ceph.mds.c.smithi094.stderr:2023-10-16T09:03:38.988+0000 7fa7d2cdd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148763) UID: 0 2023-10-16T09:06:57.115 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:06:57.121 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:07:27.573 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:07:27.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:07:45.114 INFO:teuthology.orchestra.run.smithi094.stdout:generic/014 286s 2023-10-16T09:07:45.140 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/014 2023-10-16T09:07:45.140 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:07:45.149 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:45.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:07:45.189 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-10-16T09:07:45.918 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:07:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:07:45.933 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:46.351 INFO:teuthology.orchestra.run.smithi094.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:07:46.361 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/015 2023-10-16T09:07:46.362 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/015 2023-10-16T09:07:46.362 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:07:46.373 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:46.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:07:46.406 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-10-16T09:07:46.998 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:07:47.014 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:07:47.015 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:49.484 INFO:teuthology.orchestra.run.smithi094.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:07:49.495 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/016 2023-10-16T09:07:49.495 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/016 2023-10-16T09:07:49.496 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:07:49.503 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:49.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:07:49.556 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-10-16T09:07:50.295 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:07:50.311 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:07:50.311 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:50.711 INFO:teuthology.orchestra.run.smithi094.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:07:50.724 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/017 2023-10-16T09:07:50.724 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/017 2023-10-16T09:07:50.725 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:07:50.736 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:50.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:07:50.768 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-10-16T09:07:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:07:51.398 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:07:51.398 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:52.078 INFO:teuthology.orchestra.run.smithi094.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:07:52.092 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/018 2023-10-16T09:07:52.093 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/018 2023-10-16T09:07:52.093 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:07:52.102 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:52.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:07:52.136 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-10-16T09:07:52.723 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:07:52.733 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:07:52.733 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:53.651 INFO:teuthology.orchestra.run.smithi094.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:07:53.665 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/019 2023-10-16T09:07:53.666 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/019 2023-10-16T09:07:53.666 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:07:53.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:53.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:07:53.707 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-10-16T09:07:54.282 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:07:54.299 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:07:54.300 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:07:57.725 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:07:57.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:08:11.239 INFO:teuthology.orchestra.run.smithi094.stdout:generic/020 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/020.out.bad) 2023-10-16T09:08:11.248 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/020.out 2023-10-16 08:53:19.549273749 +0000 2023-10-16T09:08:11.248 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/020.out.bad 2023-10-16 09:08:11.233298718 +0000 2023-10-16T09:08:11.249 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -47,9 +47,13 @@ 2023-10-16T09:08:11.249 INFO:teuthology.orchestra.run.smithi094.stdout: user.snrub="fish2\012" 2023-10-16T09:08:11.249 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:11.249 INFO:teuthology.orchestra.run.smithi094.stdout: *** really long value 2023-10-16T09:08:11.250 INFO:teuthology.orchestra.run.smithi094.stdout: -0000000 00 2023-10-16T09:08:11.250 INFO:teuthology.orchestra.run.smithi094.stdout: -* 2023-10-16T09:08:11.250 INFO:teuthology.orchestra.run.smithi094.stdout: -ATTRSIZE 2023-10-16T09:08:11.250 INFO:teuthology.orchestra.run.smithi094.stdout: +attr_set: No space left on device 2023-10-16T09:08:11.250 INFO:teuthology.orchestra.run.smithi094.stdout: +Could not set "long_attr" for 2023-10-16T09:08:11.251 INFO:teuthology.orchestra.run.smithi094.stdout: +attr_get: No data available 2023-10-16T09:08:11.251 INFO:teuthology.orchestra.run.smithi094.stdout: +Could not get "long_attr" for 2023-10-16T09:08:11.251 INFO:teuthology.orchestra.run.smithi094.stdout: +0000000 2023-10-16T09:08:11.251 INFO:teuthology.orchestra.run.smithi094.stdout: +attr_remove: No data available 2023-10-16T09:08:11.252 INFO:teuthology.orchestra.run.smithi094.stdout: +Could not remove "long_attr" for 2023-10-16T09:08:11.252 INFO:teuthology.orchestra.run.smithi094.stdout: *** set/get/remove really long names (expect failure) 2023-10-16T09:08:11.252 INFO:teuthology.orchestra.run.smithi094.stdout: attr_set: Invalid argument 2023-10-16T09:08:11.252 INFO:teuthology.orchestra.run.smithi094.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-10-16T09:08:11.257 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/020 2023-10-16T09:08:11.258 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/020 2023-10-16T09:08:11.258 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T09:08:11.269 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:11.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T09:08:11.330 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T09:08:11.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T09:08:11.331 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-10-16T09:08:12.072 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:12.087 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:12.088 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:14.672 INFO:teuthology.orchestra.run.smithi094.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:08:14.683 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/021 2023-10-16T09:08:14.684 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/021 2023-10-16T09:08:14.684 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:14.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:14.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:14.722 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-10-16T09:08:15.494 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:15.514 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:15.515 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:18.056 INFO:teuthology.orchestra.run.smithi094.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:08:18.069 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/022 2023-10-16T09:08:18.069 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/022 2023-10-16T09:08:18.069 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:18.079 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:18.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:18.113 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-10-16T09:08:18.881 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:18.895 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:18.895 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:21.904 INFO:teuthology.orchestra.run.smithi094.stdout:generic/023 3s 2023-10-16T09:08:22.344 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/023 2023-10-16T09:08:22.344 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:22.358 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:22.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:22.402 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-10-16T09:08:23.060 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:23.071 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:23.072 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:23.545 INFO:teuthology.orchestra.run.smithi094.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-16T09:08:23.559 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/024 2023-10-16T09:08:23.559 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/024 2023-10-16T09:08:23.559 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:23.568 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:23.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:23.616 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-10-16T09:08:24.345 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:24.359 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:24.360 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:24.828 INFO:teuthology.orchestra.run.smithi094.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-16T09:08:24.842 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/025 2023-10-16T09:08:24.842 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/025 2023-10-16T09:08:24.843 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:24.853 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:24.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:24.897 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-10-16T09:08:25.645 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:25.661 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:25.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:26.138 INFO:teuthology.orchestra.run.smithi094.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T09:08:26.153 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/026 2023-10-16T09:08:26.153 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/026 2023-10-16T09:08:26.153 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:26.163 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:26.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:26.197 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-10-16T09:08:26.798 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:26.812 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:26.813 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:27.195 INFO:teuthology.orchestra.run.smithi094.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:27.208 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/027 2023-10-16T09:08:27.208 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/027 2023-10-16T09:08:27.208 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:27.218 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:27.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:27.248 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-10-16T09:08:27.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:08:27.890 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:08:27.899 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:27.920 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:27.920 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:33.369 INFO:teuthology.orchestra.run.smithi094.stdout:generic/028 6s 2023-10-16T09:08:33.389 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/028 2023-10-16T09:08:33.389 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:33.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:33.431 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-10-16T09:08:34.019 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:34.034 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:34.427 INFO:teuthology.orchestra.run.smithi094.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:34.437 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/029 2023-10-16T09:08:34.437 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/029 2023-10-16T09:08:34.438 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:34.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:34.472 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-10-16T09:08:35.074 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:35.089 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:35.089 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:35.486 INFO:teuthology.orchestra.run.smithi094.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:35.498 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/030 2023-10-16T09:08:35.498 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/030 2023-10-16T09:08:35.499 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:35.507 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:35.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:35.542 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-10-16T09:08:36.103 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:36.117 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:36.117 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:36.514 INFO:teuthology.orchestra.run.smithi094.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:36.525 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/031 2023-10-16T09:08:36.525 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/031 2023-10-16T09:08:36.525 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:36.534 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:36.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:36.566 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-10-16T09:08:37.147 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:37.162 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:37.163 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:37.549 INFO:teuthology.orchestra.run.smithi094.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:37.561 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/032 2023-10-16T09:08:37.561 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/032 2023-10-16T09:08:37.562 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:37.572 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:37.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:37.602 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-10-16T09:08:38.205 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:38.221 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:38.221 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:38.611 INFO:teuthology.orchestra.run.smithi094.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:38.624 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/033 2023-10-16T09:08:38.624 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/033 2023-10-16T09:08:38.625 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:38.635 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:38.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:38.668 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-10-16T09:08:39.266 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:39.281 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:39.281 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:39.727 INFO:teuthology.orchestra.run.smithi094.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:39.738 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/034 2023-10-16T09:08:39.739 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/034 2023-10-16T09:08:39.739 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:39.749 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:39.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:39.782 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-10-16T09:08:40.355 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:40.372 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:40.373 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:40.943 INFO:teuthology.orchestra.run.smithi094.stdout:generic/035 0s 2023-10-16T09:08:40.958 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/035 2023-10-16T09:08:40.959 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:40.969 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:41.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:41.010 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-10-16T09:08:41.739 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:41.754 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:41.754 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:52.354 INFO:teuthology.orchestra.run.smithi094.stdout:generic/036 11s 2023-10-16T09:08:52.374 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/036 2023-10-16T09:08:52.374 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:52.384 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:52.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:52.440 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-10-16T09:08:53.161 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:53.180 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:53.180 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:53.559 INFO:teuthology.orchestra.run.smithi094.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:53.570 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/037 2023-10-16T09:08:53.570 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/037 2023-10-16T09:08:53.570 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:53.580 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:53.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:53.614 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-10-16T09:08:54.199 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:54.213 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:54.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:54.625 INFO:teuthology.orchestra.run.smithi094.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:54.639 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/038 2023-10-16T09:08:54.639 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/038 2023-10-16T09:08:54.639 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:54.647 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:54.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:54.679 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-10-16T09:08:55.279 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:55.297 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:55.298 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:55.706 INFO:teuthology.orchestra.run.smithi094.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:55.720 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/039 2023-10-16T09:08:55.721 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/039 2023-10-16T09:08:55.721 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:55.729 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:55.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:55.766 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-10-16T09:08:56.362 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:56.378 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:56.378 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:56.813 INFO:teuthology.orchestra.run.smithi094.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:56.822 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/040 2023-10-16T09:08:56.822 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/040 2023-10-16T09:08:56.823 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:56.832 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:56.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:56.864 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-10-16T09:08:57.457 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:57.473 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:57.473 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:57.874 INFO:teuthology.orchestra.run.smithi094.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:57.886 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/041 2023-10-16T09:08:57.886 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/041 2023-10-16T09:08:57.886 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:57.893 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:57.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:57.925 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-10-16T09:08:58.432 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:58.446 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:58.447 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:58.850 INFO:teuthology.orchestra.run.smithi094.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:58.865 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/042 2023-10-16T09:08:58.866 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/042 2023-10-16T09:08:58.866 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:58.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:58.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:08:58.906 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-10-16T09:08:59.460 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:08:59.468 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:08:59.518 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:08:59.537 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:08:59.538 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:08:59.955 INFO:teuthology.orchestra.run.smithi094.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:08:59.967 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/043 2023-10-16T09:08:59.967 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/043 2023-10-16T09:08:59.968 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:08:59.977 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:00.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:00.008 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-10-16T09:09:00.619 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:00.635 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:00.636 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:01.033 INFO:teuthology.orchestra.run.smithi094.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/044 2023-10-16T09:09:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/044 2023-10-16T09:09:01.046 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:01.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:01.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:01.089 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-10-16T09:09:01.694 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:01.708 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:01.708 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:02.081 INFO:teuthology.orchestra.run.smithi094.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:02.092 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/045 2023-10-16T09:09:02.093 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/045 2023-10-16T09:09:02.093 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:02.107 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:02.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:02.138 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-10-16T09:09:02.722 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:02.735 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:02.736 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:03.124 INFO:teuthology.orchestra.run.smithi094.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:03.133 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/046 2023-10-16T09:09:03.133 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/046 2023-10-16T09:09:03.133 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:03.140 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:03.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:03.172 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-10-16T09:09:03.775 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:03.792 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:03.792 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:04.211 INFO:teuthology.orchestra.run.smithi094.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:04.221 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/047 2023-10-16T09:09:04.221 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/047 2023-10-16T09:09:04.222 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:04.231 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:04.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:04.263 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-10-16T09:09:04.862 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:04.877 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:04.878 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:05.298 INFO:teuthology.orchestra.run.smithi094.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:05.310 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/048 2023-10-16T09:09:05.310 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/048 2023-10-16T09:09:05.311 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:05.320 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:05.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:05.351 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-10-16T09:09:05.948 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:05.965 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:05.965 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:06.349 INFO:teuthology.orchestra.run.smithi094.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:06.361 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/049 2023-10-16T09:09:06.361 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/049 2023-10-16T09:09:06.361 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:06.370 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:06.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:06.404 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-10-16T09:09:06.975 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:06.991 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:06.992 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:07.746 INFO:teuthology.orchestra.run.smithi094.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:07.760 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/050 2023-10-16T09:09:07.760 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/050 2023-10-16T09:09:07.760 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:07.769 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:07.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:07.800 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-10-16T09:09:08.401 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:08.413 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:08.413 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:08.819 INFO:teuthology.orchestra.run.smithi094.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:08.832 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/051 2023-10-16T09:09:08.832 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/051 2023-10-16T09:09:08.832 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:08.839 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:08.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:08.873 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-10-16T09:09:09.465 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:09.481 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:09.481 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:09.907 INFO:teuthology.orchestra.run.smithi094.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:09.920 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/052 2023-10-16T09:09:09.920 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/052 2023-10-16T09:09:09.920 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:09.930 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:09.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:09.966 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-10-16T09:09:10.556 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:10.573 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:10.573 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:10.987 INFO:teuthology.orchestra.run.smithi094.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:11.003 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/053 2023-10-16T09:09:11.004 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/053 2023-10-16T09:09:11.004 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:11.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:11.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:11.046 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-10-16T09:09:11.652 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:11.666 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:11.667 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:12.060 INFO:teuthology.orchestra.run.smithi094.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:12.069 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/054 2023-10-16T09:09:12.069 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/054 2023-10-16T09:09:12.070 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:12.080 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:12.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:12.115 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-10-16T09:09:12.692 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:12.709 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:12.709 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:13.369 INFO:teuthology.orchestra.run.smithi094.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:13.381 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/055 2023-10-16T09:09:13.382 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/055 2023-10-16T09:09:13.382 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:13.390 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:13.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:13.426 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-10-16T09:09:14.012 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:14.028 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:14.028 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:14.468 INFO:teuthology.orchestra.run.smithi094.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:14.480 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/056 2023-10-16T09:09:14.481 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/056 2023-10-16T09:09:14.481 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:14.487 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:14.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:14.516 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-10-16T09:09:15.122 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:15.135 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:15.136 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:15.555 INFO:teuthology.orchestra.run.smithi094.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:15.569 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/057 2023-10-16T09:09:15.569 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/057 2023-10-16T09:09:15.569 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:15.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:15.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:15.609 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-10-16T09:09:16.191 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:16.204 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:16.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:18.803 INFO:teuthology.orchestra.run.smithi094.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:09:18.815 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/058 2023-10-16T09:09:18.815 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/058 2023-10-16T09:09:18.815 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:18.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:18.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:18.864 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-10-16T09:09:19.614 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:19.628 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:19.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:20.068 INFO:teuthology.orchestra.run.smithi094.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:20.080 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/059 2023-10-16T09:09:20.080 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/059 2023-10-16T09:09:20.080 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:20.089 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:20.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:20.119 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-10-16T09:09:20.709 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:20.723 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:20.724 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:23.582 INFO:teuthology.orchestra.run.smithi094.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:09:23.595 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/060 2023-10-16T09:09:23.595 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/060 2023-10-16T09:09:23.595 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:23.604 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:23.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:23.643 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-10-16T09:09:24.292 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:24.304 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:24.304 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:28.517 INFO:teuthology.orchestra.run.smithi094.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:09:28.530 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/061 2023-10-16T09:09:28.530 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/061 2023-10-16T09:09:28.531 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:28.540 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:28.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:28.588 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-10-16T09:09:29.256 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:29.269 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:29.269 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:29.681 INFO:teuthology.orchestra.run.smithi094.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:29.694 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/062 2023-10-16T09:09:29.694 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/062 2023-10-16T09:09:29.694 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:29.705 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:29.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:29.743 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-10-16T09:09:30.278 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:30.291 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:30.291 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:30.660 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:09:30.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:09:33.665 INFO:teuthology.orchestra.run.smithi094.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T09:09:33.678 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/063 2023-10-16T09:09:33.678 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/063 2023-10-16T09:09:33.679 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:33.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:33.736 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-10-16T09:09:34.406 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:34.418 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:34.830 INFO:teuthology.orchestra.run.smithi094.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:34.840 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/064 2023-10-16T09:09:34.840 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/064 2023-10-16T09:09:34.841 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:34.848 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:34.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:34.880 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-10-16T09:09:35.418 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:35.430 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:35.430 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:35.886 INFO:teuthology.orchestra.run.smithi094.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:35.897 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/065 2023-10-16T09:09:35.897 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/065 2023-10-16T09:09:35.898 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:35.907 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:35.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:35.934 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-10-16T09:09:36.498 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:36.513 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:36.513 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:36.982 INFO:teuthology.orchestra.run.smithi094.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:36.995 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/066 2023-10-16T09:09:36.996 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/066 2023-10-16T09:09:36.996 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:37.005 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:37.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:37.035 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-10-16T09:09:37.551 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:37.563 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:37.563 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:38.026 INFO:teuthology.orchestra.run.smithi094.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:38.039 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/067 2023-10-16T09:09:38.039 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/067 2023-10-16T09:09:38.039 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:38.048 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:38.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:38.077 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-10-16T09:09:38.608 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:38.620 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:38.621 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:39.808 INFO:teuthology.orchestra.run.smithi094.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:39.823 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/068 2023-10-16T09:09:39.824 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/068 2023-10-16T09:09:39.824 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:39.835 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:39.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:39.868 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-10-16T09:09:40.393 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:40.407 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:40.408 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:40.822 INFO:teuthology.orchestra.run.smithi094.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:09:40.833 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/069 2023-10-16T09:09:40.834 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/069 2023-10-16T09:09:40.834 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:09:40.843 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:09:40.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:09:40.873 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-10-16T09:09:41.406 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:09:41.418 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:09:41.418 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:10:00.799 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:10:00.811 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:10:30.964 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:10:30.974 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:11:01.120 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:11:01.130 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:11:31.266 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:11:31.276 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:12:01.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:12:01.413 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:12:02.161 INFO:teuthology.orchestra.run.smithi094.stdout:generic/070 141s 2023-10-16T09:12:02.178 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/070 2023-10-16T09:12:02.178 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:12:02.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:02.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:12:02.221 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-10-16T09:12:02.994 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:12:03.010 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:12:03.010 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:03.406 INFO:teuthology.orchestra.run.smithi094.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:12:03.418 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/071 2023-10-16T09:12:03.418 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/071 2023-10-16T09:12:03.418 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:12:03.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:03.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:12:03.461 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-10-16T09:12:04.049 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:12:04.061 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:12:04.062 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:06.536 INFO:teuthology.orchestra.run.smithi094.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-16T09:12:06.547 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/072 2023-10-16T09:12:06.547 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/072 2023-10-16T09:12:06.547 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:12:06.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:06.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:12:06.590 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-10-16T09:12:07.167 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:12:07.183 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:12:07.183 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:07.605 INFO:teuthology.orchestra.run.smithi094.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:12:07.620 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/073 2023-10-16T09:12:07.621 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/073 2023-10-16T09:12:07.621 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:12:07.631 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:07.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:12:07.663 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-10-16T09:12:08.240 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:12:08.256 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:12:31.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:12:31.693 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:13:01.841 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:13:01.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:13:33.075 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:13:33.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:14:05.002 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:14:05.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:14:37.921 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:14:37.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:15:09.617 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:15:09.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:15:42.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:15:42.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:16:14.981 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:16:14.987 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:16:46.579 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:16:46.587 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:17:19.723 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:17:19.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:17:49.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:17:49.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:17:50.074 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T09:17:50.071+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94387) UID: 0 2023-10-16T09:17:50.075 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T09:17:50.072+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94387) UID: 0 2023-10-16T09:17:50.075 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T09:17:50.072+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94387) UID: 0 2023-10-16T09:17:50.076 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T09:17:50.073+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94387) UID: 0 2023-10-16T09:22:21.246 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:22:21.256 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:22:21.415 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T09:22:21.414+0000 7fc213daf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178636) UID: 0 2023-10-16T09:22:21.416 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T09:22:21.414+0000 7f2e5cfee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178636) UID: 0 2023-10-16T09:22:21.417 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T09:22:21.414+0000 7f8fb1ec1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178636) UID: 0 2023-10-16T09:22:21.417 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T09:22:21.414+0000 7fb0a8aed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178636) UID: 0 2023-10-16T09:22:21.524 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T09:22:21.523+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94461) UID: 0 2023-10-16T09:22:21.525 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T09:22:21.523+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94461) UID: 0 2023-10-16T09:22:21.525 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T09:22:21.523+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94461) UID: 0 2023-10-16T09:22:21.525 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T09:22:21.523+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94461) UID: 0 2023-10-16T09:27:25.837 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:27:25.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:27:26.059 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T09:27:26.057+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94527) UID: 0 2023-10-16T09:27:26.061 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T09:27:26.057+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94527) UID: 0 2023-10-16T09:27:26.061 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T09:27:26.057+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94527) UID: 0 2023-10-16T09:27:26.062 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T09:27:26.057+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94527) UID: 0 2023-10-16T09:27:26.846 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T09:27:26.844+0000 7f8fb1ec1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178803) UID: 0 2023-10-16T09:27:26.847 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T09:27:26.844+0000 7fb0a8aed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178803) UID: 0 2023-10-16T09:27:26.847 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T09:27:26.844+0000 7fc213daf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178803) UID: 0 2023-10-16T09:27:26.848 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T09:27:26.845+0000 7f2e5cfee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178803) UID: 0 2023-10-16T09:33:02.359 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:33:02.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:33:02.581 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T09:33:02.580+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94638) UID: 0 2023-10-16T09:33:02.582 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T09:33:02.580+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94638) UID: 0 2023-10-16T09:33:02.582 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T09:33:02.579+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94638) UID: 0 2023-10-16T09:33:02.583 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T09:33:02.580+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94638) UID: 0 2023-10-16T09:33:05.235 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T09:33:05.234+0000 7f8fb1ec1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179004) UID: 0 2023-10-16T09:33:05.235 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T09:33:05.234+0000 7fb0a8aed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179004) UID: 0 2023-10-16T09:33:05.236 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T09:33:05.234+0000 7f2e5cfee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179004) UID: 0 2023-10-16T09:33:05.236 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T09:33:05.234+0000 7fc213daf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179004) UID: 0 2023-10-16T09:43:14.492 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:43:14.507 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:43:14.702 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T09:43:14.701+0000 7fb0a8aed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179280) UID: 0 2023-10-16T09:43:14.703 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T09:43:14.700+0000 7f8fb1ec1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179280) UID: 0 2023-10-16T09:43:14.704 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T09:43:14.702+0000 7f2e5cfee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179280) UID: 0 2023-10-16T09:43:14.704 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T09:43:14.701+0000 7fc213daf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179280) UID: 0 2023-10-16T09:43:14.769 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T09:43:14.767+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94891) UID: 0 2023-10-16T09:43:14.769 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T09:43:14.767+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94891) UID: 0 2023-10-16T09:43:14.770 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T09:43:14.768+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94891) UID: 0 2023-10-16T09:43:14.771 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T09:43:14.769+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94891) UID: 0 2023-10-16T09:45:30.414 INFO:teuthology.orchestra.run.smithi094.stdout:generic/074 2002s 2023-10-16T09:45:30.444 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/074 2023-10-16T09:45:30.445 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:45:30.454 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:45:30.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:45:30.488 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-10-16T09:45:31.797 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:45:31.808 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:45:31.808 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:06.181 INFO:teuthology.orchestra.run.smithi094.stdout:generic/075 95s 2023-10-16T09:47:06.193 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/075 2023-10-16T09:47:06.194 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:06.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:06.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:06.235 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-10-16T09:47:06.953 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:06.965 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:06.965 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:07.333 INFO:teuthology.orchestra.run.smithi094.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:07.342 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/076 2023-10-16T09:47:07.342 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/076 2023-10-16T09:47:07.342 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:07.349 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:07.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:07.372 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-10-16T09:47:07.838 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:07.849 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:07.850 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:09.132 INFO:teuthology.orchestra.run.smithi094.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:09.145 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/077 2023-10-16T09:47:09.146 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/077 2023-10-16T09:47:09.146 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:09.158 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:09.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:09.188 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-10-16T09:47:09.691 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:09.704 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:09.705 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:10.168 INFO:teuthology.orchestra.run.smithi094.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-16T09:47:10.178 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/078 2023-10-16T09:47:10.178 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/078 2023-10-16T09:47:10.178 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:10.186 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:10.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:10.226 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-10-16T09:47:10.934 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:10.945 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:10.945 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:11.409 INFO:teuthology.orchestra.run.smithi094.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-16T09:47:11.422 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/079 2023-10-16T09:47:11.423 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/079 2023-10-16T09:47:11.423 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:11.433 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:11.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:11.462 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-10-16T09:47:11.946 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:11.959 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:11.959 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:14.433 INFO:teuthology.orchestra.run.smithi094.stdout:generic/080 3s 2023-10-16T09:47:14.461 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/080 2023-10-16T09:47:14.461 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:14.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:14.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:14.503 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-10-16T09:47:15.032 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:15.044 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:15.044 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:15.425 INFO:teuthology.orchestra.run.smithi094.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:15.434 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/081 2023-10-16T09:47:15.434 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/081 2023-10-16T09:47:15.434 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:15.441 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:15.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:15.468 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-10-16T09:47:15.961 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:15.974 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:15.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:16.327 INFO:teuthology.orchestra.run.smithi094.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:16.337 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/082 2023-10-16T09:47:16.337 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/082 2023-10-16T09:47:16.337 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:16.344 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:16.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:16.370 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-10-16T09:47:16.834 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:16.845 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:16.846 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:17.206 INFO:teuthology.orchestra.run.smithi094.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:17.216 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/083 2023-10-16T09:47:17.216 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/083 2023-10-16T09:47:17.216 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:17.223 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:17.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:17.247 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-10-16T09:47:17.726 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:17.738 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:17.738 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:18.102 INFO:teuthology.orchestra.run.smithi094.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:18.113 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/084 2023-10-16T09:47:18.113 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/084 2023-10-16T09:47:18.114 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:18.121 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:18.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:18.147 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-10-16T09:47:18.655 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:18.668 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:18.668 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:19.278 INFO:teuthology.orchestra.run.smithi094.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T09:47:19.293 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/085 2023-10-16T09:47:19.293 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/085 2023-10-16T09:47:19.293 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:19.305 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:19.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:19.339 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-10-16T09:47:19.844 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:19.857 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:19.857 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:36.816 INFO:teuthology.orchestra.run.smithi094.stdout:generic/086 17s 2023-10-16T09:47:36.934 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/086 2023-10-16T09:47:36.935 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:36.948 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:37.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:37.173 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-10-16T09:47:40.098 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:40.109 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:40.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:41.263 INFO:teuthology.orchestra.run.smithi094.stdout:generic/087 1s 2023-10-16T09:47:41.279 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/087 2023-10-16T09:47:41.279 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:41.287 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:41.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:41.331 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-10-16T09:47:42.043 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:42.054 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:42.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:42.606 INFO:teuthology.orchestra.run.smithi094.stdout:generic/088 0s 2023-10-16T09:47:42.623 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/088 2023-10-16T09:47:42.623 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T09:47:42.631 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:47:42.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T09:47:42.658 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-10-16T09:47:43.365 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T09:47:43.376 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T09:47:43.376 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T09:51:54.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:51:54.469 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:52:25.841 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:52:25.852 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:52:25.965 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T09:52:25.963+0000 7f1c38ac4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187205) UID: 0 2023-10-16T09:52:25.965 INFO:tasks.ceph.mds.c.smithi094.stderr:2023-10-16T09:52:25.963+0000 7fa7d2cdd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187205) UID: 0 2023-10-16T09:55:41.061 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:55:41.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:56:11.203 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:56:11.211 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:56:41.335 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:56:41.343 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:57:11.472 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:57:11.482 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:57:42.443 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:57:42.453 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:58:12.600 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:58:12.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T09:58:12.718 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T09:58:12.716+0000 7f1c38ac4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187529) UID: 0 2023-10-16T09:58:12.719 INFO:tasks.ceph.mds.c.smithi094.stderr:2023-10-16T09:58:12.716+0000 7fa7d2cdd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187529) UID: 0 2023-10-16T10:00:59.977 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:00:59.983 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:01:00.068 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T10:01:00.067+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95130) UID: 0 2023-10-16T10:01:00.068 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T10:01:00.067+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95130) UID: 0 2023-10-16T10:01:00.069 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T10:01:00.067+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95130) UID: 0 2023-10-16T10:01:00.069 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T10:01:00.067+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95130) UID: 0 2023-10-16T10:03:56.671 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:03:56.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:04:26.815 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:04:26.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:04:58.030 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:04:58.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:04:58.140 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T10:04:58.139+0000 7f1c38ac4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187641) UID: 0 2023-10-16T10:04:58.141 INFO:tasks.ceph.mds.c.smithi094.stderr:2023-10-16T10:04:58.139+0000 7fa7d2cdd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187641) UID: 0 2023-10-16T10:07:45.610 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:07:45.616 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:08:16.112 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:08:16.121 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:08:46.384 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:08:46.402 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:09:16.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:09:16.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:09:47.519 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:09:47.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:10:17.666 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:10:17.678 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:10:47.822 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:10:47.831 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:11:17.969 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:11:17.982 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:11:48.125 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:11:48.135 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:12:18.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:12:18.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:12:48.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:12:48.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:12:48.528 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T10:12:48.526+0000 7f1c38ac4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189860) UID: 0 2023-10-16T10:12:48.528 INFO:tasks.ceph.mds.c.smithi094.stderr:2023-10-16T10:12:48.526+0000 7fa7d2cdd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189860) UID: 0 2023-10-16T10:15:38.792 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:15:38.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:16:08.938 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:16:08.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:16:39.089 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:16:39.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:16:45.327 INFO:teuthology.orchestra.run.smithi094.stdout:generic/089 1742s 2023-10-16T10:16:45.390 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/089 2023-10-16T10:16:45.391 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:16:45.402 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:16:45.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:16:45.460 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-10-16T10:16:46.394 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:16:46.409 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:16:46.409 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:16:47.062 INFO:teuthology.orchestra.run.smithi094.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:16:47.074 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/090 2023-10-16T10:16:47.074 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/090 2023-10-16T10:16:47.074 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:16:47.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:16:47.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:16:47.114 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-10-16T10:16:47.679 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:16:47.693 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:16:47.694 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:17:09.246 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:17:09.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:17:39.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:17:39.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:18:09.531 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:18:09.543 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:18:39.672 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:18:39.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:19:09.854 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:19:09.864 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:19:39.996 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:19:40.007 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:20:10.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:20:10.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:20:40.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:20:40.326 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:21:10.456 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:21:10.466 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:21:40.853 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:21:40.864 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:22:10.993 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:22:11.004 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:22:41.132 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:22:41.142 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:22:45.766 INFO:teuthology.orchestra.run.smithi094.stdout:generic/091 358s 2023-10-16T10:22:45.784 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/091 2023-10-16T10:22:45.784 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:45.793 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:45.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:45.822 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-10-16T10:22:46.530 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:46.543 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:46.543 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:47.078 INFO:teuthology.orchestra.run.smithi094.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T10:22:47.093 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/092 2023-10-16T10:22:47.093 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/092 2023-10-16T10:22:47.094 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:47.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:47.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:47.143 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-10-16T10:22:47.802 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:47.814 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:47.814 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:49.408 INFO:teuthology.orchestra.run.smithi094.stdout:generic/093 2s 2023-10-16T10:22:49.423 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/093 2023-10-16T10:22:49.423 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:49.432 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:49.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:49.468 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-10-16T10:22:50.154 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:50.165 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:50.165 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:50.560 INFO:teuthology.orchestra.run.smithi094.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:22:50.573 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/094 2023-10-16T10:22:50.573 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/094 2023-10-16T10:22:50.575 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:50.585 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:50.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:50.617 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-10-16T10:22:51.149 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:51.162 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:51.162 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:51.560 INFO:teuthology.orchestra.run.smithi094.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:22:51.573 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/095 2023-10-16T10:22:51.574 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/095 2023-10-16T10:22:51.574 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:51.584 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:51.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:51.615 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-10-16T10:22:52.153 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:52.166 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:52.166 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:52.607 INFO:teuthology.orchestra.run.smithi094.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:22:52.619 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/096 2023-10-16T10:22:52.619 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/096 2023-10-16T10:22:52.619 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:52.629 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:52.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:52.661 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-10-16T10:22:53.192 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:53.206 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:53.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:54.411 INFO:teuthology.orchestra.run.smithi094.stdout:generic/097 1s 2023-10-16T10:22:54.425 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/097 2023-10-16T10:22:54.425 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:54.432 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:54.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:54.453 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-10-16T10:22:54.968 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:54.979 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:54.979 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:55.367 INFO:teuthology.orchestra.run.smithi094.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:22:55.380 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/098 2023-10-16T10:22:55.380 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/098 2023-10-16T10:22:55.380 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:55.389 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:55.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:55.422 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-10-16T10:22:55.970 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:55.984 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:55.984 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:56.534 INFO:teuthology.orchestra.run.smithi094.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T10:22:56.547 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/099 2023-10-16T10:22:56.548 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/099 2023-10-16T10:22:56.548 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:22:56.556 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:22:56.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:22:56.592 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-10-16T10:22:57.131 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:22:57.142 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:22:57.143 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:23:11.263 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:23:11.269 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:23:41.393 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:23:41.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:24:11.533 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:24:11.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:24:41.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:24:41.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:24:50.070 INFO:teuthology.orchestra.run.smithi094.stdout:generic/100 112s 2023-10-16T10:24:50.094 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/100 2023-10-16T10:24:50.094 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:50.107 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:50.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:50.177 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-10-16T10:24:50.911 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:50.922 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:50.922 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:51.315 INFO:teuthology.orchestra.run.smithi094.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/101 2023-10-16T10:24:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/101 2023-10-16T10:24:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:51.342 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:51.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:51.376 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-10-16T10:24:51.903 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:51.915 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:51.915 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:52.348 INFO:teuthology.orchestra.run.smithi094.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:52.362 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/102 2023-10-16T10:24:52.362 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/102 2023-10-16T10:24:52.363 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:52.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:52.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:52.409 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-10-16T10:24:52.958 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:52.971 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:52.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:53.384 INFO:teuthology.orchestra.run.smithi094.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:53.396 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/103 2023-10-16T10:24:53.396 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/103 2023-10-16T10:24:53.396 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:53.404 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:53.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:53.434 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-10-16T10:24:53.979 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:53.994 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:53.994 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:54.422 INFO:teuthology.orchestra.run.smithi094.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:54.434 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/104 2023-10-16T10:24:54.434 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/104 2023-10-16T10:24:54.435 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:54.446 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:54.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:54.484 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-10-16T10:24:55.034 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:55.047 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:55.047 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:55.466 INFO:teuthology.orchestra.run.smithi094.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:55.480 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/105 2023-10-16T10:24:55.481 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/105 2023-10-16T10:24:55.481 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:55.493 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:55.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:55.523 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-10-16T10:24:56.079 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:56.091 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:56.091 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:56.525 INFO:teuthology.orchestra.run.smithi094.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:56.537 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/106 2023-10-16T10:24:56.537 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/106 2023-10-16T10:24:56.537 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:56.546 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:56.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:56.575 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-10-16T10:24:57.122 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:57.136 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:57.136 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:57.590 INFO:teuthology.orchestra.run.smithi094.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:57.603 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/107 2023-10-16T10:24:57.603 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/107 2023-10-16T10:24:57.603 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:57.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:57.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:57.640 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-10-16T10:24:58.185 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:58.196 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:58.197 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:58.862 INFO:teuthology.orchestra.run.smithi094.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:58.875 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/108 2023-10-16T10:24:58.876 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/108 2023-10-16T10:24:58.876 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:58.886 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:58.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:58.921 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-10-16T10:24:59.502 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:24:59.516 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:24:59.516 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:59.921 INFO:teuthology.orchestra.run.smithi094.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:24:59.932 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/109 2023-10-16T10:24:59.932 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/109 2023-10-16T10:24:59.932 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:24:59.941 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:24:59.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:24:59.970 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-10-16T10:25:00.533 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:25:00.546 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:25:00.546 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:25:01.088 INFO:teuthology.orchestra.run.smithi094.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T10:25:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/110 2023-10-16T10:25:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/110 2023-10-16T10:25:01.101 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:25:01.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:25:01.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:25:01.146 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-10-16T10:25:01.843 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:25:01.856 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:25:01.856 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:25:02.385 INFO:teuthology.orchestra.run.smithi094.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T10:25:02.399 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/111 2023-10-16T10:25:02.400 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/111 2023-10-16T10:25:02.400 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:25:02.411 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:25:02.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:25:02.444 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-10-16T10:25:03.107 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:25:03.117 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:25:03.117 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:25:11.818 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:25:11.828 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:25:41.959 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:25:41.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:26:12.314 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:26:12.323 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:26:42.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:26:42.641 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:27:07.186 INFO:teuthology.orchestra.run.smithi094.stdout:generic/112 124s 2023-10-16T10:27:07.209 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/112 2023-10-16T10:27:07.210 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:27:07.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:27:07.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:27:07.268 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-10-16T10:27:07.970 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:27:07.982 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:27:07.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:27:12.767 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:27:12.775 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:27:43.125 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:27:43.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:27:43.244 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T10:27:43.243+0000 7f8fb1ec1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 215211) UID: 0 2023-10-16T10:27:43.245 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T10:27:43.243+0000 7fc213daf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 215211) UID: 0 2023-10-16T10:27:43.246 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T10:27:43.243+0000 7fb0a8aed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 215211) UID: 0 2023-10-16T10:27:43.246 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T10:27:43.243+0000 7f2e5cfee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 215211) UID: 0 2023-10-16T10:28:00.134 INFO:teuthology.orchestra.run.smithi094.stdout:generic/113 51s 2023-10-16T10:28:00.161 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/113 2023-10-16T10:28:00.162 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:00.176 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:00.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:00.212 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-10-16T10:28:00.991 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:01.002 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:01.002 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:01.535 INFO:teuthology.orchestra.run.smithi094.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-10-16T10:28:01.546 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/114 2023-10-16T10:28:01.547 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/114 2023-10-16T10:28:01.547 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:01.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:01.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:01.584 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-10-16T10:28:02.078 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:02.090 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:02.090 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:02.556 INFO:teuthology.orchestra.run.smithi094.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T10:28:02.567 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/115 2023-10-16T10:28:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/115 2023-10-16T10:28:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:02.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:02.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:02.604 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-10-16T10:28:03.342 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:03.353 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:03.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:03.838 INFO:teuthology.orchestra.run.smithi094.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T10:28:03.849 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/116 2023-10-16T10:28:03.850 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/116 2023-10-16T10:28:03.850 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:03.859 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:03.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:03.886 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-10-16T10:28:04.590 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:04.602 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:04.602 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:04.956 INFO:teuthology.orchestra.run.smithi094.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:28:04.968 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/117 2023-10-16T10:28:04.968 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/117 2023-10-16T10:28:04.968 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:04.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:05.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:05.001 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-10-16T10:28:05.510 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:05.522 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:05.522 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:05.971 INFO:teuthology.orchestra.run.smithi094.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T10:28:05.980 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/118 2023-10-16T10:28:05.980 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/118 2023-10-16T10:28:05.980 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:05.987 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:06.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:06.012 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-10-16T10:28:06.734 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:06.745 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:06.746 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:07.201 INFO:teuthology.orchestra.run.smithi094.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T10:28:07.212 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/119 2023-10-16T10:28:07.213 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/119 2023-10-16T10:28:07.213 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:07.221 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:07.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:07.249 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-10-16T10:28:07.973 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:07.983 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:07.984 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:08.356 INFO:teuthology.orchestra.run.smithi094.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:28:08.366 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/120 2023-10-16T10:28:08.366 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/120 2023-10-16T10:28:08.366 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:08.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:08.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:08.399 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-10-16T10:28:08.894 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:08.904 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:08.905 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:09.431 INFO:teuthology.orchestra.run.smithi094.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T10:28:09.441 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/121 2023-10-16T10:28:09.441 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/121 2023-10-16T10:28:09.441 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:09.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:09.475 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-10-16T10:28:10.189 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:10.202 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:10.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:10.669 INFO:teuthology.orchestra.run.smithi094.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T10:28:10.678 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/122 2023-10-16T10:28:10.678 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/122 2023-10-16T10:28:10.678 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:10.685 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:10.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:10.712 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-10-16T10:28:11.392 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:11.403 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:11.404 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:12.719 INFO:teuthology.orchestra.run.smithi094.stdout:generic/123 1s 2023-10-16T10:28:12.732 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/123 2023-10-16T10:28:12.732 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:12.738 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:12.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:12.763 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-10-16T10:28:13.537 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:13.548 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:13.548 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:13.895 INFO:teuthology.orchestra.run.smithi094.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T10:28:13.903 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/124 2023-10-16T10:28:13.904 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/124 2023-10-16T10:28:13.904 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:28:13.910 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:28:13.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:28:13.935 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-10-16T10:28:14.433 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:28:14.445 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:28:14.445 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:29:16.441 INFO:teuthology.orchestra.run.smithi094.stdout:generic/125 62s 2023-10-16T10:29:16.472 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/125 2023-10-16T10:29:16.472 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T10:29:16.481 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:29:16.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T10:29:16.530 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-10-16T10:29:17.212 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:29:17.223 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:29:17.223 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:29:18.788 INFO:teuthology.orchestra.run.smithi094.stdout:generic/126 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/126.out.bad) 2023-10-16T10:29:18.794 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/126.out 2023-10-16 08:53:19.565273479 +0000 2023-10-16T10:29:18.795 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/126.out.bad 2023-10-16 10:29:18.783821706 +0000 2023-10-16T10:29:18.795 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,7 +1,7 @@ 2023-10-16T10:29:18.795 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 126 2023-10-16T10:29:18.795 INFO:teuthology.orchestra.run.smithi094.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-10-16T10:29:18.795 INFO:teuthology.orchestra.run.smithi094.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-10-16T10:29:18.795 INFO:teuthology.orchestra.run.smithi094.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-10-16T10:29:18.796 INFO:teuthology.orchestra.run.smithi094.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-10-16T10:29:18.796 INFO:teuthology.orchestra.run.smithi094.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-10-16T10:29:18.796 INFO:teuthology.orchestra.run.smithi094.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-10-16T10:29:18.796 INFO:teuthology.orchestra.run.smithi094.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-10-16T10:29:18.797 INFO:teuthology.orchestra.run.smithi094.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-10-16T10:29:18.797 INFO:teuthology.orchestra.run.smithi094.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-10-16T10:29:18.801 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/126 2023-10-16T10:29:18.801 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/126 2023-10-16T10:29:18.802 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T10:29:18.810 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:29:18.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T10:29:18.835 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T10:29:18.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T10:29:18.837 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-10-16T10:29:20.415 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T10:29:20.429 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T10:29:20.430 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T10:30:59.831 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:30:59.841 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:31:30.069 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:31:30.079 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:32:00.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:32:00.215 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:32:30.361 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:32:30.371 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:33:00.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:33:00.526 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:33:30.663 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:33:30.674 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:34:00.810 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:34:00.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:34:30.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:34:30.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:35:01.339 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:35:01.350 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:35:31.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:35:31.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:36:01.708 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:36:01.719 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:36:31.865 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:36:31.876 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:37:02.021 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:37:02.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:37:32.259 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:37:32.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:38:02.407 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:38:02.416 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:38:32.738 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:38:32.748 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:39:02.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:39:02.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:39:33.023 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:39:33.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:40:03.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:40:03.416 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:40:33.569 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:40:33.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:41:03.707 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:41:03.719 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:41:33.845 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:41:33.989 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:42:04.109 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:42:04.119 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:42:34.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:42:34.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:43:04.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:43:04.415 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:43:34.544 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:43:34.554 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:44:04.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:44:04.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:44:34.846 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:44:34.856 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:45:05.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:45:05.013 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:45:35.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:45:35.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:46:05.446 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:46:05.456 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:46:35.593 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:46:35.605 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:47:05.742 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:47:05.751 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:47:35.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:47:35.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:48:06.153 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:48:06.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:48:36.291 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:48:36.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:49:06.480 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:49:06.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:49:36.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:49:36.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:50:07.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:50:07.010 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:50:37.146 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:50:37.155 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:51:07.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:51:07.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:51:37.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:51:37.546 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:52:07.691 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:52:07.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:52:37.851 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:52:37.864 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:53:07.985 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:53:07.998 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:53:38.168 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:53:38.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:54:08.331 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:54:08.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:54:38.504 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:54:38.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:55:08.651 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:55:08.661 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:55:39.049 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:55:39.059 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:56:09.187 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:56:09.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:56:39.386 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:56:39.396 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:57:09.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:57:09.530 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:57:39.663 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:57:39.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:58:09.802 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:58:09.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:58:39.941 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:58:39.951 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:59:10.083 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:59:10.093 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:59:40.222 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T10:59:40.235 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:00:10.381 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:00:10.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:00:40.533 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:00:40.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:01:10.786 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:01:10.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:01:40.926 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:01:40.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:02:11.084 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:02:11.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:02:41.231 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:02:41.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:03:11.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:03:11.386 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:03:41.616 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:03:41.626 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:04:11.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:04:11.764 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:04:41.893 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:04:41.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:05:12.042 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:05:12.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:05:42.189 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:05:42.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:06:12.325 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:06:12.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:06:42.465 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:06:42.475 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:07:12.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:07:12.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:07:42.769 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:07:42.780 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:08:12.909 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:08:12.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:08:43.054 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:08:43.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:09:13.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:09:13.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:09:43.434 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:09:43.444 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:10:05.665 INFO:teuthology.orchestra.run.smithi094.stdout:generic/127 2445s 2023-10-16T11:10:05.683 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/127 2023-10-16T11:10:05.683 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:10:05.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:05.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:10:05.736 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-10-16T11:10:06.451 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:10:06.463 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:10:06.463 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:06.892 INFO:teuthology.orchestra.run.smithi094.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:10:06.903 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/128 2023-10-16T11:10:06.903 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/128 2023-10-16T11:10:06.904 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:10:06.912 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:06.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:10:06.944 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-10-16T11:10:07.485 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:10:07.497 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:10:07.498 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:07.885 INFO:teuthology.orchestra.run.smithi094.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:10:07.894 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/129 2023-10-16T11:10:07.895 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/129 2023-10-16T11:10:07.895 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:10:07.903 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:07.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:10:07.933 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-10-16T11:10:08.504 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:10:08.519 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:10:08.519 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:08.929 INFO:teuthology.orchestra.run.smithi094.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:10:08.943 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/130 2023-10-16T11:10:08.943 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/130 2023-10-16T11:10:08.944 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:10:08.954 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:08.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:10:08.990 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-10-16T11:10:09.529 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:10:09.542 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:10:09.543 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:11.498 INFO:teuthology.orchestra.run.smithi094.stdout:generic/131 2s 2023-10-16T11:10:11.515 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/131 2023-10-16T11:10:11.516 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:10:11.524 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:11.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:10:11.554 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-10-16T11:10:12.238 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:10:12.251 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:10:12.251 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:12.647 INFO:teuthology.orchestra.run.smithi094.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:10:12.660 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/132 2023-10-16T11:10:12.660 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/132 2023-10-16T11:10:12.660 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:10:12.671 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:12.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:10:12.703 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-10-16T11:10:13.266 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:10:13.278 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:10:13.278 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:10:13.579 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:10:13.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:10:44.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:10:44.016 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:11:14.173 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:11:14.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:11:44.312 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:11:44.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:12:14.468 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:12:14.482 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:12:44.928 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:12:44.938 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:12:45.045 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T11:12:45.044+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97482) UID: 0 2023-10-16T11:12:45.046 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T11:12:45.044+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97482) UID: 0 2023-10-16T11:12:45.046 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T11:12:45.044+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97482) UID: 0 2023-10-16T11:12:45.046 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T11:12:45.044+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97482) UID: 0 2023-10-16T11:15:42.398 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:15:42.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:16:12.542 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:16:12.552 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:16:42.689 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:16:42.701 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:17:12.845 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:17:12.855 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:17:42.985 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:17:42.996 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:18:13.130 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:18:13.140 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:18:43.295 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:18:43.307 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:19:13.452 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:19:13.463 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:19:43.599 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:19:43.609 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:20:13.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:20:13.768 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:20:43.783 INFO:teuthology.orchestra.run.smithi094.stdout:generic/133 630s 2023-10-16T11:20:43.806 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/133 2023-10-16T11:20:43.806 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:43.818 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:43.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:43.863 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-10-16T11:20:43.901 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:20:43.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:20:44.651 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:44.662 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:44.662 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:45.162 INFO:teuthology.orchestra.run.smithi094.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:45.175 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/134 2023-10-16T11:20:45.177 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/134 2023-10-16T11:20:45.177 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:45.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:45.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:45.239 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-10-16T11:20:45.889 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:45.901 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:45.902 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:46.349 INFO:teuthology.orchestra.run.smithi094.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:20:46.363 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/135 2023-10-16T11:20:46.363 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/135 2023-10-16T11:20:46.364 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:46.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:46.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:46.407 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-10-16T11:20:46.938 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:46.952 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:46.953 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:47.528 INFO:teuthology.orchestra.run.smithi094.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:47.541 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/136 2023-10-16T11:20:47.541 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/136 2023-10-16T11:20:47.541 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:47.550 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:47.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:47.588 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-10-16T11:20:48.299 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:48.311 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:48.311 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:48.786 INFO:teuthology.orchestra.run.smithi094.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:48.796 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/137 2023-10-16T11:20:48.796 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/137 2023-10-16T11:20:48.797 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:48.805 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:48.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:48.851 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-10-16T11:20:49.532 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:49.545 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:49.545 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:50.038 INFO:teuthology.orchestra.run.smithi094.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:50.049 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/138 2023-10-16T11:20:50.049 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/138 2023-10-16T11:20:50.050 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:50.059 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:50.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:50.120 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-10-16T11:20:50.778 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:50.791 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:50.791 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:51.310 INFO:teuthology.orchestra.run.smithi094.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/139 2023-10-16T11:20:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/139 2023-10-16T11:20:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:51.330 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:51.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:51.376 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-10-16T11:20:52.053 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:52.065 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:52.066 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:52.638 INFO:teuthology.orchestra.run.smithi094.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:52.649 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/140 2023-10-16T11:20:52.650 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/140 2023-10-16T11:20:52.650 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:52.659 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:52.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:52.703 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-10-16T11:20:53.387 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:53.399 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:53.399 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:53.810 INFO:teuthology.orchestra.run.smithi094.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:20:53.820 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/141 2023-10-16T11:20:53.820 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/141 2023-10-16T11:20:53.821 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:53.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:53.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:53.862 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-10-16T11:20:54.392 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:54.406 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:54.406 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:54.920 INFO:teuthology.orchestra.run.smithi094.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:54.932 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/142 2023-10-16T11:20:54.932 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/142 2023-10-16T11:20:54.932 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:54.942 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:55.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:55.007 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-10-16T11:20:55.679 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:55.692 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:55.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:56.191 INFO:teuthology.orchestra.run.smithi094.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:56.203 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/143 2023-10-16T11:20:56.204 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/143 2023-10-16T11:20:56.204 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:56.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:56.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:56.264 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-10-16T11:20:56.918 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:56.930 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:56.930 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:57.423 INFO:teuthology.orchestra.run.smithi094.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:57.434 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/144 2023-10-16T11:20:57.434 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/144 2023-10-16T11:20:57.435 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:57.443 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:57.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:57.489 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-10-16T11:20:58.150 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:58.161 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:58.161 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:58.641 INFO:teuthology.orchestra.run.smithi094.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:58.654 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/145 2023-10-16T11:20:58.655 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/145 2023-10-16T11:20:58.655 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:58.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:58.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:58.706 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-10-16T11:20:59.373 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:20:59.385 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:20:59.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:59.914 INFO:teuthology.orchestra.run.smithi094.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:20:59.925 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/146 2023-10-16T11:20:59.926 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/146 2023-10-16T11:20:59.926 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:20:59.934 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:20:59.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:20:59.963 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-10-16T11:21:00.617 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:00.627 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:00.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:01.142 INFO:teuthology.orchestra.run.smithi094.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:01.153 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/147 2023-10-16T11:21:01.153 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/147 2023-10-16T11:21:01.153 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:01.161 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:01.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:01.203 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-10-16T11:21:01.900 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:01.911 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:01.912 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:02.485 INFO:teuthology.orchestra.run.smithi094.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/148 2023-10-16T11:21:02.496 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/148 2023-10-16T11:21:02.497 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:02.507 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:02.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:02.544 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-10-16T11:21:03.224 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:03.235 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:03.235 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:03.759 INFO:teuthology.orchestra.run.smithi094.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:03.771 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/149 2023-10-16T11:21:03.771 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/149 2023-10-16T11:21:03.771 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:03.780 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:03.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:03.829 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-10-16T11:21:04.496 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:04.507 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:04.507 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:05.006 INFO:teuthology.orchestra.run.smithi094.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:05.020 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/150 2023-10-16T11:21:05.020 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/150 2023-10-16T11:21:05.020 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:05.031 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:05.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:05.077 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-10-16T11:21:05.736 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:05.747 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:05.747 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:06.269 INFO:teuthology.orchestra.run.smithi094.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:06.279 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/151 2023-10-16T11:21:06.280 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/151 2023-10-16T11:21:06.280 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:06.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:06.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:06.323 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-10-16T11:21:06.995 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:07.007 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:07.007 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:07.487 INFO:teuthology.orchestra.run.smithi094.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:07.497 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/152 2023-10-16T11:21:07.497 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/152 2023-10-16T11:21:07.497 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:07.505 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:07.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:07.538 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-10-16T11:21:08.197 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:08.208 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:08.208 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:08.676 INFO:teuthology.orchestra.run.smithi094.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:08.687 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/153 2023-10-16T11:21:08.687 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/153 2023-10-16T11:21:08.687 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:08.695 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:08.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:08.729 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-10-16T11:21:09.405 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:09.417 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:09.417 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:09.973 INFO:teuthology.orchestra.run.smithi094.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:09.985 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/154 2023-10-16T11:21:09.985 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/154 2023-10-16T11:21:09.985 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:09.994 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:10.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:10.045 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-10-16T11:21:10.706 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:10.717 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:10.718 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:11.247 INFO:teuthology.orchestra.run.smithi094.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:11.258 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/155 2023-10-16T11:21:11.258 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/155 2023-10-16T11:21:11.258 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:11.267 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:11.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:11.309 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-10-16T11:21:11.985 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:11.997 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:11.997 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:12.528 INFO:teuthology.orchestra.run.smithi094.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:12.539 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/156 2023-10-16T11:21:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/156 2023-10-16T11:21:12.540 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:12.548 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:12.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:12.590 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-10-16T11:21:13.266 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:13.278 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:13.278 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:13.791 INFO:teuthology.orchestra.run.smithi094.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:13.805 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/157 2023-10-16T11:21:13.805 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/157 2023-10-16T11:21:13.805 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:13.817 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:13.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:13.860 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-10-16T11:21:14.124 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:21:14.137 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:21:14.565 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:14.576 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:14.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:15.197 INFO:teuthology.orchestra.run.smithi094.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:15.209 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/158 2023-10-16T11:21:15.209 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/158 2023-10-16T11:21:15.209 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:15.219 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:15.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:15.261 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-10-16T11:21:15.951 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:15.965 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:15.965 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:16.469 INFO:teuthology.orchestra.run.smithi094.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-10-16T11:21:16.479 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/159 2023-10-16T11:21:16.479 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/159 2023-10-16T11:21:16.479 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:16.487 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:16.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:16.514 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-10-16T11:21:17.033 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:17.044 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:17.044 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:17.591 INFO:teuthology.orchestra.run.smithi094.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-10-16T11:21:17.603 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/160 2023-10-16T11:21:17.604 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/160 2023-10-16T11:21:17.604 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:17.614 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:17.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:17.643 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-10-16T11:21:18.185 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:18.198 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:18.198 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:18.603 INFO:teuthology.orchestra.run.smithi094.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:18.613 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/161 2023-10-16T11:21:18.614 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/161 2023-10-16T11:21:18.614 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:18.622 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:18.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:18.648 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-10-16T11:21:19.176 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:19.189 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:19.190 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:19.614 INFO:teuthology.orchestra.run.smithi094.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:19.625 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/162 2023-10-16T11:21:19.625 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/162 2023-10-16T11:21:19.626 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:19.635 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:19.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:19.666 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-10-16T11:21:20.223 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:20.236 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:20.236 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:20.647 INFO:teuthology.orchestra.run.smithi094.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:20.659 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/163 2023-10-16T11:21:20.659 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/163 2023-10-16T11:21:20.659 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:20.669 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:20.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:20.702 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-10-16T11:21:21.252 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:21.264 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:21.264 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:21.666 INFO:teuthology.orchestra.run.smithi094.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:21.679 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/164 2023-10-16T11:21:21.679 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/164 2023-10-16T11:21:21.680 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:21.692 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:21.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:21.726 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-10-16T11:21:22.261 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:22.274 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:22.275 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:22.682 INFO:teuthology.orchestra.run.smithi094.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:22.694 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/165 2023-10-16T11:21:22.694 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/165 2023-10-16T11:21:22.694 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:22.703 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:22.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:22.732 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-10-16T11:21:23.266 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:23.278 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:23.279 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:23.708 INFO:teuthology.orchestra.run.smithi094.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:23.718 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/166 2023-10-16T11:21:23.719 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/166 2023-10-16T11:21:23.719 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:23.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:23.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:23.756 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-10-16T11:21:24.321 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:24.334 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:24.334 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:24.756 INFO:teuthology.orchestra.run.smithi094.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:24.768 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/167 2023-10-16T11:21:24.768 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/167 2023-10-16T11:21:24.768 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:24.777 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:24.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:24.807 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-10-16T11:21:25.345 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:25.358 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:25.358 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:25.808 INFO:teuthology.orchestra.run.smithi094.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:25.820 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/168 2023-10-16T11:21:25.820 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/168 2023-10-16T11:21:25.820 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:25.829 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:25.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:25.860 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-10-16T11:21:26.386 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:26.399 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:26.400 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:26.821 INFO:teuthology.orchestra.run.smithi094.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:26.833 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/169 2023-10-16T11:21:26.833 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/169 2023-10-16T11:21:26.833 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:26.843 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:26.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:26.873 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-10-16T11:21:27.427 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:27.440 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:27.441 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:27.862 INFO:teuthology.orchestra.run.smithi094.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:27.874 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/170 2023-10-16T11:21:27.875 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/170 2023-10-16T11:21:27.875 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:27.886 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:27.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:27.917 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-10-16T11:21:28.456 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:28.469 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:28.469 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:28.893 INFO:teuthology.orchestra.run.smithi094.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:28.904 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/171 2023-10-16T11:21:28.905 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/171 2023-10-16T11:21:28.905 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:28.913 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:28.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:28.947 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-10-16T11:21:29.497 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:29.510 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:29.510 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:29.946 INFO:teuthology.orchestra.run.smithi094.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:29.959 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/172 2023-10-16T11:21:29.959 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/172 2023-10-16T11:21:29.959 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:29.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:30.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:30.010 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-10-16T11:21:30.568 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:30.582 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:30.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:31.004 INFO:teuthology.orchestra.run.smithi094.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:31.015 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/173 2023-10-16T11:21:31.015 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/173 2023-10-16T11:21:31.015 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:31.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:31.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:31.058 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-10-16T11:21:31.617 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:31.632 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:31.632 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:32.053 INFO:teuthology.orchestra.run.smithi094.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:32.062 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/174 2023-10-16T11:21:32.062 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/174 2023-10-16T11:21:32.062 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:32.071 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:32.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:32.100 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-10-16T11:21:32.642 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:32.655 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:32.655 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:33.078 INFO:teuthology.orchestra.run.smithi094.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:33.091 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/175 2023-10-16T11:21:33.091 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/175 2023-10-16T11:21:33.091 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:33.104 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:33.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:33.135 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-10-16T11:21:33.677 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:33.689 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:34.121 INFO:teuthology.orchestra.run.smithi094.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:34.132 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/176 2023-10-16T11:21:34.132 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/176 2023-10-16T11:21:34.132 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:34.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:34.167 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-10-16T11:21:34.722 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:34.735 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:34.735 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:35.228 INFO:teuthology.orchestra.run.smithi094.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:35.240 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/177 2023-10-16T11:21:35.241 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/177 2023-10-16T11:21:35.241 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:35.250 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:35.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:35.281 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-10-16T11:21:35.836 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:35.850 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:35.851 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:36.422 INFO:teuthology.orchestra.run.smithi094.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:36.433 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/178 2023-10-16T11:21:36.433 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/178 2023-10-16T11:21:36.433 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:36.441 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:36.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:36.470 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-10-16T11:21:37.168 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:37.179 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:37.180 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:37.724 INFO:teuthology.orchestra.run.smithi094.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:37.740 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/179 2023-10-16T11:21:37.741 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/179 2023-10-16T11:21:37.741 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:37.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:37.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:37.803 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-10-16T11:21:38.475 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:38.542 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:38.542 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:39.000 INFO:teuthology.orchestra.run.smithi094.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:39.013 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/180 2023-10-16T11:21:39.014 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/180 2023-10-16T11:21:39.014 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:39.020 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:39.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:39.048 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-10-16T11:21:39.714 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:39.725 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:39.726 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:40.221 INFO:teuthology.orchestra.run.smithi094.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:40.230 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/181 2023-10-16T11:21:40.230 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/181 2023-10-16T11:21:40.231 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:40.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:40.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:40.271 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-10-16T11:21:41.068 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:41.081 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:41.081 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:41.628 INFO:teuthology.orchestra.run.smithi094.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T11:21:41.640 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/182 2023-10-16T11:21:41.640 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/182 2023-10-16T11:21:41.640 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:41.653 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:41.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:41.703 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-10-16T11:21:42.373 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:42.385 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:42.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:42.777 INFO:teuthology.orchestra.run.smithi094.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:42.791 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/183 2023-10-16T11:21:42.792 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/183 2023-10-16T11:21:42.792 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:42.804 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:42.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:42.838 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-10-16T11:21:43.410 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:43.424 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:43.425 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:44.013 INFO:teuthology.orchestra.run.smithi094.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/184.out.bad) 2023-10-16T11:21:44.020 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/184.out 2023-10-16 08:53:19.575273311 +0000 2023-10-16T11:21:44.021 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/184.out.bad 2023-10-16 11:21:44.008868741 +0000 2023-10-16T11:21:44.021 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1 +1,2 @@ 2023-10-16T11:21:44.021 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 184 2023-10-16T11:21:44.021 INFO:teuthology.orchestra.run.smithi094.stdout: +/tmp/tmp.tcp0mkZMHZxfstests-dev/tests/generic/184: line 23: /tmp/tmp.VH3pOVWuu6test/null: Permission denied 2023-10-16T11:21:44.028 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/184 2023-10-16T11:21:44.028 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/184 2023-10-16T11:21:44.029 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:21:44.037 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:44.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:21:44.067 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:21:44.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:21:44.068 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-10-16T11:21:44.325 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:21:44.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:21:44.585 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:44.598 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:44.598 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:44.989 INFO:teuthology.orchestra.run.smithi094.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/185 2023-10-16T11:21:45.000 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/185 2023-10-16T11:21:45.001 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:45.009 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:45.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:45.037 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-10-16T11:21:45.587 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:45.600 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:45.600 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:46.009 INFO:teuthology.orchestra.run.smithi094.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:46.022 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/186 2023-10-16T11:21:46.022 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/186 2023-10-16T11:21:46.022 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:46.033 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:46.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:46.067 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-10-16T11:21:46.631 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:46.643 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:46.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:47.046 INFO:teuthology.orchestra.run.smithi094.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:47.060 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/187 2023-10-16T11:21:47.061 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/187 2023-10-16T11:21:47.061 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:47.072 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:47.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:47.108 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-10-16T11:21:47.661 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:47.674 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:47.674 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:48.113 INFO:teuthology.orchestra.run.smithi094.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:48.123 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/188 2023-10-16T11:21:48.123 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/188 2023-10-16T11:21:48.124 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:48.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:48.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:48.164 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-10-16T11:21:48.712 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:48.725 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:48.725 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:49.144 INFO:teuthology.orchestra.run.smithi094.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:49.156 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/189 2023-10-16T11:21:49.156 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/189 2023-10-16T11:21:49.157 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:49.167 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:49.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:49.201 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-10-16T11:21:49.747 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:49.759 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:49.760 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:50.183 INFO:teuthology.orchestra.run.smithi094.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:50.195 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/190 2023-10-16T11:21:50.195 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/190 2023-10-16T11:21:50.195 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:50.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:50.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:50.234 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-10-16T11:21:50.799 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:50.812 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:50.812 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:51.242 INFO:teuthology.orchestra.run.smithi094.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/191 2023-10-16T11:21:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/191 2023-10-16T11:21:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:51.261 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:51.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:51.290 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-10-16T11:21:51.826 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:51.838 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:51.839 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:52.276 INFO:teuthology.orchestra.run.smithi094.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-10-16T11:21:52.289 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/192 2023-10-16T11:21:52.289 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/192 2023-10-16T11:21:52.289 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:52.301 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:52.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:52.334 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-10-16T11:21:52.874 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:52.887 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:52.888 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:55.426 INFO:teuthology.orchestra.run.smithi094.stdout:generic/193 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/193.out.bad) 2023-10-16T11:21:55.434 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/193.out 2023-10-16 08:53:19.576273295 +0000 2023-10-16T11:21:55.434 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/193.out.bad 2023-10-16 11:21:55.406670230 +0000 2023-10-16T11:21:55.435 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -24,7 +24,6 @@ 2023-10-16T11:21:55.435 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:55.435 INFO:teuthology.orchestra.run.smithi094.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-10-16T11:21:55.435 INFO:teuthology.orchestra.run.smithi094.stdout: user: chmod a+r on root owned file (should fail) 2023-10-16T11:21:55.435 INFO:teuthology.orchestra.run.smithi094.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-10-16T11:21:55.436 INFO:teuthology.orchestra.run.smithi094.stdout: check that the sgid bit is cleared 2023-10-16T11:21:55.436 INFO:teuthology.orchestra.run.smithi094.stdout: -rw-rw-rw- 2023-10-16T11:21:55.436 INFO:teuthology.orchestra.run.smithi094.stdout: check that suid bit is not cleared 2023-10-16T11:21:55.442 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/193 2023-10-16T11:21:55.443 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/193 2023-10-16T11:21:55.443 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:21:55.452 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:55.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:21:55.486 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:21:55.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:21:55.487 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-10-16T11:21:56.184 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:56.195 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:56.196 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:56.539 INFO:teuthology.orchestra.run.smithi094.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:56.548 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/194 2023-10-16T11:21:56.549 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/194 2023-10-16T11:21:56.549 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:56.560 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:56.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:56.583 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-10-16T11:21:57.081 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:57.094 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:57.094 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:57.532 INFO:teuthology.orchestra.run.smithi094.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:57.543 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/195 2023-10-16T11:21:57.543 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/195 2023-10-16T11:21:57.543 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:57.551 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:57.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:57.577 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-10-16T11:21:58.109 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:58.121 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:58.121 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:58.541 INFO:teuthology.orchestra.run.smithi094.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:58.554 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/196 2023-10-16T11:21:58.554 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/196 2023-10-16T11:21:58.555 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:58.566 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:58.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:58.596 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-10-16T11:21:59.134 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:21:59.148 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:21:59.148 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:59.560 INFO:teuthology.orchestra.run.smithi094.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:21:59.569 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/197 2023-10-16T11:21:59.570 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/197 2023-10-16T11:21:59.570 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:21:59.577 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:21:59.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:21:59.602 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-10-16T11:22:00.141 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:00.153 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:00.153 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:02.220 INFO:teuthology.orchestra.run.smithi094.stdout:generic/198 2s 2023-10-16T11:22:02.238 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/198 2023-10-16T11:22:02.238 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:02.247 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:02.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:02.279 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-10-16T11:22:02.991 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:03.003 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:03.004 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:03.339 INFO:teuthology.orchestra.run.smithi094.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:03.349 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/199 2023-10-16T11:22:03.349 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/199 2023-10-16T11:22:03.349 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:03.357 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:03.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:03.385 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-10-16T11:22:03.942 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:03.955 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:03.955 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:04.388 INFO:teuthology.orchestra.run.smithi094.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:04.398 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/200 2023-10-16T11:22:04.398 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/200 2023-10-16T11:22:04.398 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:04.406 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:04.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:04.432 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-10-16T11:22:04.986 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:04.999 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:04.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:05.404 INFO:teuthology.orchestra.run.smithi094.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:05.414 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/201 2023-10-16T11:22:05.415 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/201 2023-10-16T11:22:05.415 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:05.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:05.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:05.451 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-10-16T11:22:05.978 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:05.992 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:05.992 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:06.395 INFO:teuthology.orchestra.run.smithi094.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:06.406 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/202 2023-10-16T11:22:06.406 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/202 2023-10-16T11:22:06.406 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:06.415 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:06.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:06.444 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-10-16T11:22:06.971 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:06.983 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:06.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:07.410 INFO:teuthology.orchestra.run.smithi094.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:07.424 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/203 2023-10-16T11:22:07.424 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/203 2023-10-16T11:22:07.424 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:07.436 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:07.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:07.467 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-10-16T11:22:08.002 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:08.016 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:08.016 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:08.772 INFO:teuthology.orchestra.run.smithi094.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:08.785 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/204 2023-10-16T11:22:08.785 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/204 2023-10-16T11:22:08.785 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:08.796 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:08.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:08.831 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-10-16T11:22:09.395 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:09.407 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:09.407 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:09.808 INFO:teuthology.orchestra.run.smithi094.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:09.821 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/205 2023-10-16T11:22:09.822 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/205 2023-10-16T11:22:09.822 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:09.834 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:09.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:09.866 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-10-16T11:22:10.427 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:10.442 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:10.442 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:10.854 INFO:teuthology.orchestra.run.smithi094.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:22:10.866 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/206 2023-10-16T11:22:10.866 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/206 2023-10-16T11:22:10.867 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:10.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:10.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:10.906 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-10-16T11:22:11.458 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:11.472 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:11.472 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:14.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:22:14.477 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:22:44.623 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:22:44.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:22:58.359 INFO:teuthology.orchestra.run.smithi094.stdout:generic/207 47s 2023-10-16T11:22:58.382 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/207 2023-10-16T11:22:58.382 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:22:58.392 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:22:58.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:22:58.431 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-10-16T11:22:59.099 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:22:59.110 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:22:59.110 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:23:14.820 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:23:14.831 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:23:44.970 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:23:44.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:24:15.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:24:15.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:24:45.352 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:24:45.363 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:25:15.500 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:25:15.509 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:25:45.631 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:25:45.641 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:26:15.771 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:26:15.780 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:26:19.827 INFO:teuthology.orchestra.run.smithi094.stdout:generic/208 200s 2023-10-16T11:26:19.847 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/208 2023-10-16T11:26:19.847 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:26:19.856 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:19.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:26:19.911 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-10-16T11:26:20.582 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:20.593 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:20.593 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:45.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:26:45.923 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:26:47.688 INFO:teuthology.orchestra.run.smithi094.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/209.out.bad) 2023-10-16T11:26:47.709 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/209.out 2023-10-16 08:53:19.579273244 +0000 2023-10-16T11:26:47.709 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/209.out.bad 2023-10-16 11:26:47.677577140 +0000 2023-10-16T11:26:47.709 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,2 +1,2 @@ 2023-10-16T11:26:47.710 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 209 2023-10-16T11:26:47.710 INFO:teuthology.orchestra.run.smithi094.stdout: -test ran for 30 seconds without error 2023-10-16T11:26:47.710 INFO:teuthology.orchestra.run.smithi094.stdout: +reader found old byte at pos 4096 2023-10-16T11:26:47.710 INFO:teuthology.orchestra.run.smithi094.stdout: \ No newline at end of file 2023-10-16T11:26:47.727 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/209 2023-10-16T11:26:47.727 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/209 2023-10-16T11:26:47.727 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:26:47.741 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:47.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:26:47.779 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:26:47.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:26:47.780 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-10-16T11:26:48.370 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:48.384 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:48.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:49.053 INFO:teuthology.orchestra.run.smithi094.stdout:generic/210 1s 2023-10-16T11:26:49.070 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/210 2023-10-16T11:26:49.070 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:26:49.081 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:49.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:26:49.129 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-10-16T11:26:49.795 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:49.807 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:49.807 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:50.834 INFO:teuthology.orchestra.run.smithi094.stdout:generic/211 1s 2023-10-16T11:26:50.849 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/211 2023-10-16T11:26:50.849 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:26:50.856 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:50.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:26:50.882 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-10-16T11:26:51.397 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:51.408 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:52.004 INFO:teuthology.orchestra.run.smithi094.stdout:generic/212 0s 2023-10-16T11:26:52.021 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/212 2023-10-16T11:26:52.022 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:26:52.030 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:52.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:26:52.060 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-10-16T11:26:52.617 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:52.632 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:52.633 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:53.440 INFO:teuthology.orchestra.run.smithi094.stdout:generic/213 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/213.out.bad) 2023-10-16T11:26:53.446 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/213.out 2023-10-16 08:53:19.579273244 +0000 2023-10-16T11:26:53.446 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/213.out.bad 2023-10-16 11:26:53.435476751 +0000 2023-10-16T11:26:53.447 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,4 +1,3 @@ 2023-10-16T11:26:53.447 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 213 2023-10-16T11:26:53.447 INFO:teuthology.orchestra.run.smithi094.stdout: We should get: fallocate: No space left on device 2023-10-16T11:26:53.447 INFO:teuthology.orchestra.run.smithi094.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-10-16T11:26:53.447 INFO:teuthology.orchestra.run.smithi094.stdout: -fallocate: No space left on device 2023-10-16T11:26:53.452 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/213 2023-10-16T11:26:53.452 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/213 2023-10-16T11:26:53.453 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:26:53.459 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:53.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:26:53.508 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:26:53.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:26:53.509 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-10-16T11:26:54.268 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:54.284 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:54.285 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:55.282 INFO:teuthology.orchestra.run.smithi094.stdout:generic/214 1s 2023-10-16T11:26:55.299 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/214 2023-10-16T11:26:55.300 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:26:55.307 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:26:55.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:26:55.345 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-10-16T11:26:56.118 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:26:56.133 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:26:56.133 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:00.202 INFO:teuthology.orchestra.run.smithi094.stdout:generic/215 4s 2023-10-16T11:27:00.222 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/215 2023-10-16T11:27:00.224 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:00.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:00.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:00.266 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-10-16T11:27:00.828 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:00.845 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:00.845 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:01.210 INFO:teuthology.orchestra.run.smithi094.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:01.221 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/216 2023-10-16T11:27:01.221 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/216 2023-10-16T11:27:01.222 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:01.231 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:01.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:01.258 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-10-16T11:27:01.839 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:01.858 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:01.858 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:02.255 INFO:teuthology.orchestra.run.smithi094.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:02.266 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/217 2023-10-16T11:27:02.266 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/217 2023-10-16T11:27:02.267 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:02.275 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:02.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:02.311 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-10-16T11:27:02.882 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:02.895 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:02.896 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:03.286 INFO:teuthology.orchestra.run.smithi094.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:03.298 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/218 2023-10-16T11:27:03.299 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/218 2023-10-16T11:27:03.299 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:03.307 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:03.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:03.340 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-10-16T11:27:03.994 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:04.006 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:04.007 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:04.398 INFO:teuthology.orchestra.run.smithi094.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:04.409 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/219 2023-10-16T11:27:04.410 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/219 2023-10-16T11:27:04.410 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:04.417 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:04.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:04.450 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-10-16T11:27:05.042 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:05.055 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:05.055 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:05.440 INFO:teuthology.orchestra.run.smithi094.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:05.455 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/220 2023-10-16T11:27:05.456 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/220 2023-10-16T11:27:05.456 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:05.465 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:05.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:05.499 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-10-16T11:27:06.077 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:06.094 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:06.095 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:07.597 INFO:teuthology.orchestra.run.smithi094.stdout:generic/221 1s 2023-10-16T11:27:07.615 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/221 2023-10-16T11:27:07.615 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:07.625 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:07.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:07.665 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-10-16T11:27:08.243 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:08.260 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:08.260 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:08.655 INFO:teuthology.orchestra.run.smithi094.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:08.666 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/222 2023-10-16T11:27:08.666 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/222 2023-10-16T11:27:08.667 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:08.679 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:08.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:08.710 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-10-16T11:27:09.293 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:09.308 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:09.308 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:09.693 INFO:teuthology.orchestra.run.smithi094.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:09.712 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/223 2023-10-16T11:27:09.712 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/223 2023-10-16T11:27:09.712 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:09.721 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:09.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:09.754 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-10-16T11:27:10.338 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:10.353 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:10.353 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:11.080 INFO:teuthology.orchestra.run.smithi094.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:11.093 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/224 2023-10-16T11:27:11.093 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/224 2023-10-16T11:27:11.093 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:11.102 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:11.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:11.132 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-10-16T11:27:11.718 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:11.733 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:11.733 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:12.130 INFO:teuthology.orchestra.run.smithi094.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:12.142 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/225 2023-10-16T11:27:12.143 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/225 2023-10-16T11:27:12.143 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:12.154 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:12.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:12.190 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-10-16T11:27:12.760 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:12.776 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:12.776 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:13.178 INFO:teuthology.orchestra.run.smithi094.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:13.190 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/226 2023-10-16T11:27:13.190 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/226 2023-10-16T11:27:13.190 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:13.198 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:13.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:13.228 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-10-16T11:27:13.823 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:13.837 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:13.838 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:14.236 INFO:teuthology.orchestra.run.smithi094.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:14.246 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/227 2023-10-16T11:27:14.246 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/227 2023-10-16T11:27:14.246 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:14.253 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:14.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:14.286 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-10-16T11:27:14.884 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:14.901 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:14.901 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:15.553 INFO:teuthology.orchestra.run.smithi094.stdout:generic/228 1s 2023-10-16T11:27:15.578 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/228 2023-10-16T11:27:15.578 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:15.589 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:15.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:15.646 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-10-16T11:27:16.160 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:27:16.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:27:16.406 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:16.422 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:16.423 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:16.808 INFO:teuthology.orchestra.run.smithi094.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:16.820 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/229 2023-10-16T11:27:16.820 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/229 2023-10-16T11:27:16.821 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:16.830 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:16.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:16.860 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-10-16T11:27:17.449 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:17.468 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:17.469 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:17.855 INFO:teuthology.orchestra.run.smithi094.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:17.870 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/230 2023-10-16T11:27:17.870 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/230 2023-10-16T11:27:17.870 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:17.881 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:17.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:17.919 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-10-16T11:27:18.524 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:18.540 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:18.541 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:18.968 INFO:teuthology.orchestra.run.smithi094.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:18.979 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/231 2023-10-16T11:27:18.980 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/231 2023-10-16T11:27:18.980 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:18.990 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:19.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:19.023 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-10-16T11:27:19.595 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:19.611 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:19.611 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:20.022 INFO:teuthology.orchestra.run.smithi094.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:20.038 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/232 2023-10-16T11:27:20.038 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/232 2023-10-16T11:27:20.038 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:20.047 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:20.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:20.079 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-10-16T11:27:20.659 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:20.675 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:20.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:21.077 INFO:teuthology.orchestra.run.smithi094.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:21.091 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/233 2023-10-16T11:27:21.091 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/233 2023-10-16T11:27:21.091 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:21.100 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:21.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:21.135 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-10-16T11:27:21.720 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:21.736 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:21.737 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/234 2023-10-16T11:27:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/234 2023-10-16T11:27:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:22.170 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:22.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:22.203 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-10-16T11:27:22.817 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:22.831 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:22.831 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:23.231 INFO:teuthology.orchestra.run.smithi094.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:23.243 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/235 2023-10-16T11:27:23.243 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/235 2023-10-16T11:27:23.244 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:23.304 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:23.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:23.358 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-10-16T11:27:23.963 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:23.978 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:23.979 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:25.585 INFO:teuthology.orchestra.run.smithi094.stdout:generic/236 1s 2023-10-16T11:27:25.605 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/236 2023-10-16T11:27:25.605 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:25.615 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:25.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:25.652 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-10-16T11:27:26.420 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:26.437 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:26.438 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:26.957 INFO:teuthology.orchestra.run.smithi094.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T11:27:26.969 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/237 2023-10-16T11:27:26.969 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/237 2023-10-16T11:27:26.969 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:26.977 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:27.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:27.005 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-10-16T11:27:27.611 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:27.627 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:27.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:28.244 INFO:teuthology.orchestra.run.smithi094.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:27:28.257 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/238 2023-10-16T11:27:28.257 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/238 2023-10-16T11:27:28.257 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:27:28.267 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:28.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:27:28.297 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-10-16T11:27:28.896 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:27:28.913 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:27:28.914 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:27:46.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:27:46.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:28:16.442 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:28:16.449 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:28:46.610 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:28:46.616 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:29:17.489 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:29:17.501 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:29:49.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:29:49.660 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:29:49.830 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T11:29:49.828+0000 7fbe3e350640 -1 Fail to open '/proc/98021/cmdline' error = (2) No such file or directory 2023-10-16T11:29:49.830 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T11:29:49.828+0000 7fbe3e350640 -1 received signal: Hangup from (PID: 98021) UID: 0 2023-10-16T11:29:49.831 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T11:29:49.828+0000 7f4b0c385640 -1 Fail to open '/proc/98021/cmdline' error = (2) No such file or directory 2023-10-16T11:29:49.832 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T11:29:49.829+0000 7f4b0c385640 -1 received signal: Hangup from (PID: 98021) UID: 0 2023-10-16T11:29:49.833 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T11:29:49.825+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98021) UID: 0 2023-10-16T11:29:49.844 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T11:29:49.830+0000 7f2350a50640 -1 Fail to open '/proc/98021/cmdline' error = (2) No such file or directory 2023-10-16T11:29:49.845 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T11:29:49.830+0000 7f2350a50640 -1 received signal: Hangup from (PID: 98021) UID: 0 2023-10-16T11:29:58.035 INFO:teuthology.orchestra.run.smithi094.stdout:generic/239 149s 2023-10-16T11:29:58.055 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/239 2023-10-16T11:29:58.055 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:29:58.063 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:29:58.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:29:58.110 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-10-16T11:29:58.852 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:29:58.867 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:29:58.867 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:30:05.435 INFO:teuthology.orchestra.run.smithi094.stdout:generic/240 7s 2023-10-16T11:30:05.455 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/240 2023-10-16T11:30:05.456 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:30:05.464 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:30:05.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:30:05.496 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-10-16T11:30:06.252 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:30:06.268 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:30:06.268 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:20.337 INFO:teuthology.orchestra.run.smithi094.stdout:generic/241 74s 2023-10-16T11:31:20.379 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/241 2023-10-16T11:31:20.380 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:31:20.387 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:20.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:31:20.427 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-10-16T11:31:21.354 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:31:21.371 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:31:21.371 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:21.813 INFO:teuthology.orchestra.run.smithi094.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:31:21.824 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/242 2023-10-16T11:31:21.824 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/242 2023-10-16T11:31:21.824 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:31:21.833 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:21.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:31:21.867 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-10-16T11:31:22.821 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:31:22.838 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:31:22.838 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:23.885 INFO:teuthology.orchestra.run.smithi094.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:31:23.896 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/243 2023-10-16T11:31:23.896 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/243 2023-10-16T11:31:23.896 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:31:23.906 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:23.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:31:23.945 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-10-16T11:31:24.542 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:31:24.559 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:31:24.559 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:25.091 INFO:teuthology.orchestra.run.smithi094.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T11:31:25.103 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/244 2023-10-16T11:31:25.103 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/244 2023-10-16T11:31:25.103 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:31:25.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:25.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:31:25.145 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-10-16T11:31:26.092 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:31:26.105 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:31:26.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:28.986 INFO:teuthology.orchestra.run.smithi094.stdout:generic/245 1s 2023-10-16T11:31:29.386 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/245 2023-10-16T11:31:29.387 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:31:29.397 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:29.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:31:29.439 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-10-16T11:31:30.226 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:31:30.240 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:31:30.240 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:31.027 INFO:teuthology.orchestra.run.smithi094.stdout:generic/246 1s 2023-10-16T11:31:31.045 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/246 2023-10-16T11:31:31.045 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:31:31.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:31:31.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:31:31.101 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-10-16T11:31:31.851 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:31:31.867 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:31:31.867 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:22.284 INFO:teuthology.orchestra.run.smithi094.stdout:generic/247 51s 2023-10-16T11:32:22.302 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/247 2023-10-16T11:32:22.302 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:22.312 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:22.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:22.340 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-10-16T11:32:22.953 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:22.970 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:22.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:23.482 INFO:teuthology.orchestra.run.smithi094.stdout:generic/248 0s 2023-10-16T11:32:23.502 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/248 2023-10-16T11:32:23.503 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:23.511 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:23.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:23.548 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-10-16T11:32:24.120 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:24.137 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:24.137 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:28.029 INFO:teuthology.orchestra.run.smithi094.stdout:generic/249 4s 2023-10-16T11:32:28.045 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/249 2023-10-16T11:32:28.046 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:28.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:28.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:28.088 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-10-16T11:32:28.829 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:28.843 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:28.843 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:29.282 INFO:teuthology.orchestra.run.smithi094.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:29.294 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/250 2023-10-16T11:32:29.295 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/250 2023-10-16T11:32:29.295 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:29.304 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:29.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:29.332 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-10-16T11:32:29.898 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:29.914 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:29.915 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:30.325 INFO:teuthology.orchestra.run.smithi094.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:30.335 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/251 2023-10-16T11:32:30.335 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/251 2023-10-16T11:32:30.335 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:30.343 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:30.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:30.377 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-10-16T11:32:30.988 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:31.004 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:31.004 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:31.496 INFO:teuthology.orchestra.run.smithi094.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:31.507 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/252 2023-10-16T11:32:31.507 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/252 2023-10-16T11:32:31.508 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:31.515 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:31.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:31.546 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-10-16T11:32:32.146 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:32.160 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:32.160 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:32.627 INFO:teuthology.orchestra.run.smithi094.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:32.637 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/253 2023-10-16T11:32:32.637 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/253 2023-10-16T11:32:32.637 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:32.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:32.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:32.673 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-10-16T11:32:33.376 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:33.390 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:33.944 INFO:teuthology.orchestra.run.smithi094.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:33.959 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/254 2023-10-16T11:32:33.960 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/254 2023-10-16T11:32:33.960 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:33.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:33.999 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-10-16T11:32:34.586 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:34.599 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:34.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:37.168 INFO:teuthology.orchestra.run.smithi094.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T11:32:37.183 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/255 2023-10-16T11:32:37.183 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/255 2023-10-16T11:32:37.184 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:37.193 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:37.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:37.240 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-10-16T11:32:37.956 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:37.973 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:37.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:40.425 INFO:teuthology.orchestra.run.smithi094.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:40.436 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/256 2023-10-16T11:32:40.437 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/256 2023-10-16T11:32:40.437 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:40.447 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:40.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:40.481 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-10-16T11:32:41.040 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:41.054 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:41.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:43.480 INFO:teuthology.orchestra.run.smithi094.stdout:generic/257 2s 2023-10-16T11:32:43.502 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/257 2023-10-16T11:32:43.503 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:43.512 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:43.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:43.542 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-10-16T11:32:44.277 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:44.295 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:44.296 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:44.786 INFO:teuthology.orchestra.run.smithi094.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/258.out.bad) 2023-10-16T11:32:44.795 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/258.out 2023-10-16 08:53:19.586273126 +0000 2023-10-16T11:32:44.795 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/258.out.bad 2023-10-16 11:32:44.780345590 +0000 2023-10-16T11:32:44.795 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,5 +1,6 @@ 2023-10-16T11:32:44.796 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 258 2023-10-16T11:32:44.796 INFO:teuthology.orchestra.run.smithi094.stdout: Creating file with timestamp of Jan 1, 1960 2023-10-16T11:32:44.796 INFO:teuthology.orchestra.run.smithi094.stdout: Testing for negative seconds since epoch 2023-10-16T11:32:44.796 INFO:teuthology.orchestra.run.smithi094.stdout: -Remounting to flush cache 2023-10-16T11:32:44.797 INFO:teuthology.orchestra.run.smithi094.stdout: -Testing for negative seconds since epoch 2023-10-16T11:32:44.797 INFO:teuthology.orchestra.run.smithi094.stdout: +Timestamp wrapped: 3979351756 2023-10-16T11:32:44.797 INFO:teuthology.orchestra.run.smithi094.stdout: +Timestamp wrapped 2023-10-16T11:32:44.797 INFO:teuthology.orchestra.run.smithi094.stdout: +(see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/258.full for details) 2023-10-16T11:32:44.803 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/258 2023-10-16T11:32:44.803 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/258 2023-10-16T11:32:44.804 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:32:44.811 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:44.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:32:44.838 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:32:44.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:32:44.839 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-10-16T11:32:45.387 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:45.403 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:45.403 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:45.780 INFO:teuthology.orchestra.run.smithi094.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:45.793 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/259 2023-10-16T11:32:45.793 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/259 2023-10-16T11:32:45.793 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:45.803 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:45.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:45.834 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-10-16T11:32:46.422 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:46.436 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:46.437 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:46.818 INFO:teuthology.orchestra.run.smithi094.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:46.828 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/260 2023-10-16T11:32:46.828 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/260 2023-10-16T11:32:46.829 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:46.835 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:46.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:46.864 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-10-16T11:32:47.461 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:47.477 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:47.477 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:47.889 INFO:teuthology.orchestra.run.smithi094.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:47.904 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/261 2023-10-16T11:32:47.905 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/261 2023-10-16T11:32:47.905 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:47.915 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:47.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:47.949 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-10-16T11:32:48.509 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:48.524 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:48.524 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:48.899 INFO:teuthology.orchestra.run.smithi094.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:32:48.912 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/262 2023-10-16T11:32:48.912 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/262 2023-10-16T11:32:48.913 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:32:48.921 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:32:48.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:32:48.953 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-10-16T11:32:49.554 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:32:49.569 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:32:49.569 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:33:36.297 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:33:36.309 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:33:36.534 INFO:tasks.ceph.mds.a.smithi094.stderr:2023-10-16T11:33:36.531+0000 7f1c38ac4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 284959) UID: 0 2023-10-16T11:33:36.534 INFO:tasks.ceph.mds.c.smithi094.stderr:2023-10-16T11:33:36.532+0000 7fa7d2cdd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 284959) UID: 0 2023-10-16T11:35:03.316 INFO:teuthology.orchestra.run.smithi094.stdout:generic/263 134s 2023-10-16T11:35:03.332 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/263 2023-10-16T11:35:03.332 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:03.340 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:03.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:03.371 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-10-16T11:35:04.124 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:04.136 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:04.137 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:04.558 INFO:teuthology.orchestra.run.smithi094.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:04.567 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/264 2023-10-16T11:35:04.567 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/264 2023-10-16T11:35:04.568 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:04.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:04.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:04.599 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-10-16T11:35:05.084 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:05.096 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:05.096 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:05.652 INFO:teuthology.orchestra.run.smithi094.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:05.667 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/265 2023-10-16T11:35:05.667 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/265 2023-10-16T11:35:05.667 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:05.679 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:05.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:05.710 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-10-16T11:35:06.190 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:06.203 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:06.203 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:06.622 INFO:teuthology.orchestra.run.smithi094.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:06.633 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/266 2023-10-16T11:35:06.633 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/266 2023-10-16T11:35:06.633 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:06.641 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:06.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:06.669 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-10-16T11:35:07.172 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:07.183 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:07.183 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:07.584 INFO:teuthology.orchestra.run.smithi094.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:07.594 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/267 2023-10-16T11:35:07.594 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/267 2023-10-16T11:35:07.594 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:07.602 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:07.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:07.627 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-10-16T11:35:08.087 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:08.098 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:08.098 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:08.538 INFO:teuthology.orchestra.run.smithi094.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:08.550 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/268 2023-10-16T11:35:08.550 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/268 2023-10-16T11:35:08.550 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:08.559 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:08.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:08.585 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-10-16T11:35:09.119 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:09.132 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:09.133 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:09.509 INFO:teuthology.orchestra.run.smithi094.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:09.518 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/269 2023-10-16T11:35:09.519 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/269 2023-10-16T11:35:09.519 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:09.526 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:09.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:09.549 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-10-16T11:35:10.044 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:10.056 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:10.056 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:10.457 INFO:teuthology.orchestra.run.smithi094.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T11:35:10.470 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/270 2023-10-16T11:35:10.471 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/270 2023-10-16T11:35:10.471 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:10.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:10.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:10.513 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-10-16T11:35:11.003 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:11.014 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:11.014 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:11.406 INFO:teuthology.orchestra.run.smithi094.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:11.418 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/271 2023-10-16T11:35:11.418 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/271 2023-10-16T11:35:11.419 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:11.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:11.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:11.463 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-10-16T11:35:11.979 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:11.991 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:11.992 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:12.423 INFO:teuthology.orchestra.run.smithi094.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/272 2023-10-16T11:35:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/272 2023-10-16T11:35:12.435 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:12.446 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:12.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:12.472 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-10-16T11:35:12.965 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:12.977 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:12.977 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:13.333 INFO:teuthology.orchestra.run.smithi094.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:13.343 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/273 2023-10-16T11:35:13.343 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/273 2023-10-16T11:35:13.343 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:13.350 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:13.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:13.374 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-10-16T11:35:13.878 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:13.890 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:13.890 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:14.287 INFO:teuthology.orchestra.run.smithi094.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:14.297 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/274 2023-10-16T11:35:14.297 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/274 2023-10-16T11:35:14.297 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:14.305 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:14.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:14.328 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-10-16T11:35:14.826 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:14.838 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:14.838 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:15.198 INFO:teuthology.orchestra.run.smithi094.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:15.207 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/275 2023-10-16T11:35:15.207 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/275 2023-10-16T11:35:15.207 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:15.214 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:15.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:15.237 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-10-16T11:35:15.717 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:15.729 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:15.729 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:16.174 INFO:teuthology.orchestra.run.smithi094.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:16.187 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/276 2023-10-16T11:35:16.188 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/276 2023-10-16T11:35:16.188 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:16.199 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:16.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:16.226 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-10-16T11:35:16.708 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:16.720 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:16.720 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:17.119 INFO:teuthology.orchestra.run.smithi094.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:17.129 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/277 2023-10-16T11:35:17.129 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/277 2023-10-16T11:35:17.129 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:17.136 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:17.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:17.160 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-10-16T11:35:17.665 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:17.681 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:17.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:18.082 INFO:teuthology.orchestra.run.smithi094.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:18.093 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/278 2023-10-16T11:35:18.093 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/278 2023-10-16T11:35:18.093 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:18.101 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:18.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:18.127 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-10-16T11:35:18.590 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:18.602 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:18.602 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:19.013 INFO:teuthology.orchestra.run.smithi094.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:19.024 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/279 2023-10-16T11:35:19.025 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/279 2023-10-16T11:35:19.025 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:19.033 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:19.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:19.061 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-10-16T11:35:19.562 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:19.573 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:19.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:20.061 INFO:teuthology.orchestra.run.smithi094.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:20.073 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/280 2023-10-16T11:35:20.073 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/280 2023-10-16T11:35:20.073 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:20.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:20.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:20.110 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-10-16T11:35:20.616 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:20.628 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:20.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:21.019 INFO:teuthology.orchestra.run.smithi094.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:21.028 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/281 2023-10-16T11:35:21.028 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/281 2023-10-16T11:35:21.028 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:21.035 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:21.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:21.061 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-10-16T11:35:21.548 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:21.561 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:21.562 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:22.010 INFO:teuthology.orchestra.run.smithi094.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:22.020 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/282 2023-10-16T11:35:22.020 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/282 2023-10-16T11:35:22.021 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:22.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:22.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:22.050 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-10-16T11:35:22.518 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:22.529 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:22.529 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:22.919 INFO:teuthology.orchestra.run.smithi094.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:22.929 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/283 2023-10-16T11:35:22.929 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/283 2023-10-16T11:35:22.930 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:22.937 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:22.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:22.962 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-10-16T11:35:23.449 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:23.460 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:23.460 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:23.828 INFO:teuthology.orchestra.run.smithi094.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:35:23.837 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/284 2023-10-16T11:35:23.837 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/284 2023-10-16T11:35:23.838 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:23.845 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:23.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:23.870 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-10-16T11:35:24.359 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:24.372 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:24.372 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:29.706 INFO:teuthology.orchestra.run.smithi094.stdout:generic/285 5s 2023-10-16T11:35:29.719 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/285 2023-10-16T11:35:29.720 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:35:29.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:35:29.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:35:29.757 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-10-16T11:35:30.505 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:35:30.516 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:35:30.517 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:36:44.800 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:36:44.810 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:36:44.929 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T11:36:44.927+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98079) UID: 0 2023-10-16T11:36:44.930 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T11:36:44.927+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98079) UID: 0 2023-10-16T11:36:44.931 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T11:36:44.927+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98079) UID: 0 2023-10-16T11:36:44.931 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T11:36:44.927+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98079) UID: 0 2023-10-16T11:38:01.936 INFO:teuthology.orchestra.run.smithi094.stdout:generic/286 151s 2023-10-16T11:38:01.961 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/286 2023-10-16T11:38:01.961 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:01.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:02.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:02.004 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-10-16T11:38:02.711 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:02.723 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:02.723 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:03.138 INFO:teuthology.orchestra.run.smithi094.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:03.149 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/287 2023-10-16T11:38:03.149 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/287 2023-10-16T11:38:03.149 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:03.156 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:03.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:03.184 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-10-16T11:38:03.667 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:03.680 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:03.680 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:04.541 INFO:teuthology.orchestra.run.smithi094.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:04.558 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/288 2023-10-16T11:38:04.558 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/288 2023-10-16T11:38:04.558 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:04.571 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:04.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:04.602 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-10-16T11:38:05.159 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:05.171 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:05.171 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:05.573 INFO:teuthology.orchestra.run.smithi094.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:05.584 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/289 2023-10-16T11:38:05.585 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/289 2023-10-16T11:38:05.585 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:05.594 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:05.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:05.625 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-10-16T11:38:06.174 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:06.186 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:06.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:06.591 INFO:teuthology.orchestra.run.smithi094.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:06.603 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/290 2023-10-16T11:38:06.603 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/290 2023-10-16T11:38:06.604 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:06.613 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:06.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:06.643 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-10-16T11:38:07.202 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:07.214 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:07.214 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:07.621 INFO:teuthology.orchestra.run.smithi094.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:07.633 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/291 2023-10-16T11:38:07.633 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/291 2023-10-16T11:38:07.633 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:07.644 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:07.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:07.676 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-10-16T11:38:08.221 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:08.234 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:08.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:08.641 INFO:teuthology.orchestra.run.smithi094.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:08.653 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/292 2023-10-16T11:38:08.653 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/292 2023-10-16T11:38:08.654 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:08.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:08.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:08.698 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-10-16T11:38:09.248 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:09.261 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:09.261 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:09.697 INFO:teuthology.orchestra.run.smithi094.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:09.709 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/293 2023-10-16T11:38:09.709 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/293 2023-10-16T11:38:09.709 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:09.718 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:09.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:09.748 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-10-16T11:38:10.315 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:10.327 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:10.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:10.730 INFO:teuthology.orchestra.run.smithi094.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:10.741 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/294 2023-10-16T11:38:10.741 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/294 2023-10-16T11:38:10.741 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:10.750 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:10.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:10.776 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-10-16T11:38:11.326 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:11.340 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:11.340 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:11.766 INFO:teuthology.orchestra.run.smithi094.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:11.776 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/295 2023-10-16T11:38:11.777 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/295 2023-10-16T11:38:11.777 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:11.785 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:11.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:11.813 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-10-16T11:38:12.339 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:12.352 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:12.352 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:12.775 INFO:teuthology.orchestra.run.smithi094.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:12.785 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/296 2023-10-16T11:38:12.786 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/296 2023-10-16T11:38:12.786 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:12.794 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:12.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:12.820 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-10-16T11:38:13.367 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:13.380 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:13.380 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:13.814 INFO:teuthology.orchestra.run.smithi094.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:13.827 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/297 2023-10-16T11:38:13.828 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/297 2023-10-16T11:38:13.828 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:13.839 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:13.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:13.868 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-10-16T11:38:14.431 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:14.444 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:14.444 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:14.866 INFO:teuthology.orchestra.run.smithi094.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:14.878 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/298 2023-10-16T11:38:14.878 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/298 2023-10-16T11:38:14.878 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:14.887 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:14.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:14.916 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-10-16T11:38:15.458 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:15.472 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:15.472 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:15.900 INFO:teuthology.orchestra.run.smithi094.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:15.909 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/299 2023-10-16T11:38:15.910 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/299 2023-10-16T11:38:15.910 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:15.917 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:15.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:15.942 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-10-16T11:38:16.489 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:16.503 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:16.503 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:16.918 INFO:teuthology.orchestra.run.smithi094.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:16.931 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/300 2023-10-16T11:38:16.931 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/300 2023-10-16T11:38:16.931 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:16.940 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:16.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:16.969 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-10-16T11:38:17.501 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:17.514 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:17.515 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:17.921 INFO:teuthology.orchestra.run.smithi094.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:17.933 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/301 2023-10-16T11:38:17.933 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/301 2023-10-16T11:38:17.933 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:17.942 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:17.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:17.972 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-10-16T11:38:18.525 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:18.538 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:18.538 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:18.944 INFO:teuthology.orchestra.run.smithi094.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:18.955 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/302 2023-10-16T11:38:18.955 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/302 2023-10-16T11:38:18.956 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:18.964 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:18.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:18.994 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-10-16T11:38:19.550 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:19.564 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:19.565 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:20.112 INFO:teuthology.orchestra.run.smithi094.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:38:20.127 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/303 2023-10-16T11:38:20.128 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/303 2023-10-16T11:38:20.128 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:20.139 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:20.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:20.186 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-10-16T11:38:20.875 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:20.887 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:20.888 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:21.438 INFO:teuthology.orchestra.run.smithi094.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T11:38:21.451 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/304 2023-10-16T11:38:21.452 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/304 2023-10-16T11:38:21.452 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:21.459 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:21.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:21.487 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-10-16T11:38:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:22.180 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:22.587 INFO:teuthology.orchestra.run.smithi094.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/305 2023-10-16T11:38:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/305 2023-10-16T11:38:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:22.609 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:22.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:22.642 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-10-16T11:38:23.224 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:23.237 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:23.237 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:23.657 INFO:teuthology.orchestra.run.smithi094.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:23.672 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/306 2023-10-16T11:38:23.672 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/306 2023-10-16T11:38:23.672 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:23.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:23.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:23.715 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-10-16T11:38:24.288 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:24.300 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:24.301 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:24.738 INFO:teuthology.orchestra.run.smithi094.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:38:24.748 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/307 2023-10-16T11:38:24.749 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/307 2023-10-16T11:38:24.749 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:24.757 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:24.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:24.787 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-10-16T11:38:25.336 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:25.350 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:25.350 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:25.860 INFO:teuthology.orchestra.run.smithi094.stdout:generic/308 0s 2023-10-16T11:38:25.878 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/308 2023-10-16T11:38:25.878 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:25.887 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:25.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:25.915 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-10-16T11:38:26.470 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:26.483 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:26.484 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:28.079 INFO:teuthology.orchestra.run.smithi094.stdout:generic/309 2s 2023-10-16T11:38:28.099 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/309 2023-10-16T11:38:28.100 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:38:28.104 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:38:28.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:38:28.131 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-10-16T11:38:28.803 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:38:28.816 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:38:28.816 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:39:38.770 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:39:38.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:40:08.964 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:40:08.974 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:40:15.412 INFO:teuthology.orchestra.run.smithi094.stdout:generic/310 107s 2023-10-16T11:40:15.433 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/310 2023-10-16T11:40:15.433 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:15.446 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:15.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:15.512 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-10-16T11:40:16.313 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:16.323 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:16.324 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:17.979 INFO:teuthology.orchestra.run.smithi094.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:17.992 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/311 2023-10-16T11:40:17.992 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/311 2023-10-16T11:40:17.993 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:18.004 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:18.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:18.038 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-10-16T11:40:18.600 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:18.612 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:18.612 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:19.092 INFO:teuthology.orchestra.run.smithi094.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:19.103 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/312 2023-10-16T11:40:19.103 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/312 2023-10-16T11:40:19.104 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:19.112 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:19.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:19.143 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-10-16T11:40:19.686 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:19.699 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:19.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:24.343 INFO:teuthology.orchestra.run.smithi094.stdout:generic/313 5s 2023-10-16T11:40:24.363 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/313 2023-10-16T11:40:24.363 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:24.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:24.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:24.404 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-10-16T11:40:24.926 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:24.939 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:24.939 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:26.249 INFO:teuthology.orchestra.run.smithi094.stdout:generic/314 2s 2023-10-16T11:40:26.265 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/314 2023-10-16T11:40:26.265 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:26.272 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:26.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:26.298 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-10-16T11:40:26.790 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:26.802 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:26.802 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:27.986 INFO:teuthology.orchestra.run.smithi094.stdout:generic/315 1s 2023-10-16T11:40:28.004 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/315 2023-10-16T11:40:28.005 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:28.013 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:28.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:28.067 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-10-16T11:40:28.788 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:28.800 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:28.800 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:32.926 INFO:teuthology.orchestra.run.smithi094.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T11:40:32.938 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/316 2023-10-16T11:40:32.938 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/316 2023-10-16T11:40:32.938 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:32.947 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:32.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:32.996 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-10-16T11:40:33.684 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:33.696 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:34.061 INFO:teuthology.orchestra.run.smithi094.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:34.071 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/317 2023-10-16T11:40:34.071 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/317 2023-10-16T11:40:34.071 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:34.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:34.106 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-10-16T11:40:34.669 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:34.683 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:34.683 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:35.085 INFO:teuthology.orchestra.run.smithi094.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:35.097 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/318 2023-10-16T11:40:35.098 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/318 2023-10-16T11:40:35.098 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:35.106 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:35.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:35.137 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-10-16T11:40:35.685 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:35.699 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:35.700 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:36.191 INFO:teuthology.orchestra.run.smithi094.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T11:40:36.204 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/319 2023-10-16T11:40:36.204 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/319 2023-10-16T11:40:36.205 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:36.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:36.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:36.243 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-10-16T11:40:36.786 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:36.800 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:36.800 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:37.211 INFO:teuthology.orchestra.run.smithi094.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:37.222 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/320 2023-10-16T11:40:37.223 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/320 2023-10-16T11:40:37.223 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:37.231 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:37.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:37.260 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-10-16T11:40:37.815 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:37.829 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:37.829 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:38.291 INFO:teuthology.orchestra.run.smithi094.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:38.306 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/321 2023-10-16T11:40:38.306 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/321 2023-10-16T11:40:38.307 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:38.320 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:38.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:38.349 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-10-16T11:40:38.887 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:38.898 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:38.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:39.321 INFO:teuthology.orchestra.run.smithi094.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:40:39.332 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/322 2023-10-16T11:40:39.332 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/322 2023-10-16T11:40:39.332 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:40:39.340 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:39.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:40:39.366 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-10-16T11:40:39.909 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:40:39.921 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:40:39.921 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:40:40.192 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:40:40.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:41:10.609 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:41:10.615 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:41:10.733 INFO:tasks.ceph.osd.0.smithi094.stderr:2023-10-16T11:41:10.731+0000 7f8fb1ec1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324155) UID: 0 2023-10-16T11:41:10.735 INFO:tasks.ceph.osd.3.smithi094.stderr:2023-10-16T11:41:10.733+0000 7f2e5cfee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324155) UID: 0 2023-10-16T11:41:10.735 INFO:tasks.ceph.osd.1.smithi094.stderr:2023-10-16T11:41:10.733+0000 7fb0a8aed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324155) UID: 0 2023-10-16T11:41:10.736 INFO:tasks.ceph.osd.2.smithi094.stderr:2023-10-16T11:41:10.733+0000 7fc213daf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324155) UID: 0 2023-10-16T11:42:41.877 INFO:teuthology.orchestra.run.smithi094.stdout:generic/323 122s 2023-10-16T11:42:41.892 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/323 2023-10-16T11:42:41.892 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:41.899 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:41.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:41.928 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-10-16T11:42:42.632 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:42.643 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:42.644 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:43.070 INFO:teuthology.orchestra.run.smithi094.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:43.081 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/324 2023-10-16T11:42:43.081 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/324 2023-10-16T11:42:43.082 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:43.091 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:43.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:43.117 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-10-16T11:42:43.614 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:43.627 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:43.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:44.058 INFO:teuthology.orchestra.run.smithi094.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:44.073 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/325 2023-10-16T11:42:44.073 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/325 2023-10-16T11:42:44.073 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:44.088 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:44.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:44.116 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-10-16T11:42:44.640 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:44.651 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:44.651 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:45.699 INFO:teuthology.orchestra.run.smithi094.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:45.712 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/326 2023-10-16T11:42:45.712 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/326 2023-10-16T11:42:45.712 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:45.721 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:45.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:45.752 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-10-16T11:42:46.271 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:46.283 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:46.284 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:46.684 INFO:teuthology.orchestra.run.smithi094.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:46.693 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/327 2023-10-16T11:42:46.693 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/327 2023-10-16T11:42:46.693 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:46.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:46.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:46.722 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-10-16T11:42:47.204 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:47.214 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:47.215 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:50.081 INFO:teuthology.orchestra.run.smithi094.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:50.093 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/328 2023-10-16T11:42:50.094 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/328 2023-10-16T11:42:50.094 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:50.102 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:50.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:50.130 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-10-16T11:42:50.617 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:50.629 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:50.629 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:51.976 INFO:teuthology.orchestra.run.smithi094.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:51.988 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/329 2023-10-16T11:42:51.988 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/329 2023-10-16T11:42:51.989 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:51.997 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:52.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:52.025 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-10-16T11:42:52.548 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:52.560 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:52.560 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:52.936 INFO:teuthology.orchestra.run.smithi094.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:52.945 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/330 2023-10-16T11:42:52.945 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/330 2023-10-16T11:42:52.946 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:52.961 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:52.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:52.985 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-10-16T11:42:53.463 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:53.476 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:53.476 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:53.885 INFO:teuthology.orchestra.run.smithi094.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:53.897 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/331 2023-10-16T11:42:53.897 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/331 2023-10-16T11:42:53.897 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:53.906 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:53.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:53.933 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-10-16T11:42:54.424 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:54.436 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:54.436 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:54.804 INFO:teuthology.orchestra.run.smithi094.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:54.813 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/332 2023-10-16T11:42:54.813 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/332 2023-10-16T11:42:54.814 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:54.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:54.843 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-10-16T11:42:55.319 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:55.330 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:55.331 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:55.682 INFO:teuthology.orchestra.run.smithi094.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:55.691 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/333 2023-10-16T11:42:55.691 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/333 2023-10-16T11:42:55.693 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:55.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:55.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:55.726 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-10-16T11:42:56.218 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:56.230 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:56.230 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:56.579 INFO:teuthology.orchestra.run.smithi094.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:56.590 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/334 2023-10-16T11:42:56.590 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/334 2023-10-16T11:42:56.591 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:56.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:56.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:56.625 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-10-16T11:42:57.114 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:57.126 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:57.126 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:57.519 INFO:teuthology.orchestra.run.smithi094.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:57.529 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/335 2023-10-16T11:42:57.530 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/335 2023-10-16T11:42:57.530 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:57.537 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:57.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:57.561 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-10-16T11:42:58.061 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:58.074 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:58.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:58.481 INFO:teuthology.orchestra.run.smithi094.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:58.492 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/336 2023-10-16T11:42:58.492 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/336 2023-10-16T11:42:58.492 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:58.500 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:58.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:58.525 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-10-16T11:42:59.000 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:59.013 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:59.013 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:59.451 INFO:teuthology.orchestra.run.smithi094.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:42:59.463 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/337 2023-10-16T11:42:59.463 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/337 2023-10-16T11:42:59.464 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:42:59.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:42:59.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:42:59.505 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-10-16T11:42:59.984 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:42:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:42:59.995 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:00.443 INFO:teuthology.orchestra.run.smithi094.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:00.457 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/338 2023-10-16T11:43:00.457 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/338 2023-10-16T11:43:00.458 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:00.468 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:00.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:00.498 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-10-16T11:43:01.016 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:01.029 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:01.029 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:01.439 INFO:teuthology.orchestra.run.smithi094.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:01.450 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/339 2023-10-16T11:43:01.450 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/339 2023-10-16T11:43:01.450 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:01.457 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:01.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:01.483 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-10-16T11:43:02.032 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:02.043 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:02.044 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:02.378 INFO:teuthology.orchestra.run.smithi094.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:02.388 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/340 2023-10-16T11:43:02.389 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/340 2023-10-16T11:43:02.389 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:02.395 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:02.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:02.417 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-10-16T11:43:02.909 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:02.921 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:02.921 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:03.333 INFO:teuthology.orchestra.run.smithi094.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:03.346 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/341 2023-10-16T11:43:03.346 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/341 2023-10-16T11:43:03.346 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:03.355 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:03.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:03.382 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-10-16T11:43:03.882 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:03.895 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:03.896 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:04.330 INFO:teuthology.orchestra.run.smithi094.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:04.341 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/342 2023-10-16T11:43:04.341 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/342 2023-10-16T11:43:04.341 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:04.349 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:04.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:04.373 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-10-16T11:43:04.890 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:04.902 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:04.902 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:05.326 INFO:teuthology.orchestra.run.smithi094.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:05.338 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/343 2023-10-16T11:43:05.338 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/343 2023-10-16T11:43:05.338 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:05.347 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:05.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:05.376 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-10-16T11:43:05.872 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:05.885 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:05.885 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:06.234 INFO:teuthology.orchestra.run.smithi094.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:06.244 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/344 2023-10-16T11:43:06.244 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/344 2023-10-16T11:43:06.244 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:06.252 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:06.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:06.276 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-10-16T11:43:06.764 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:06.776 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:06.776 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:07.140 INFO:teuthology.orchestra.run.smithi094.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:07.152 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/345 2023-10-16T11:43:07.152 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/345 2023-10-16T11:43:07.152 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:07.160 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:07.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:07.190 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-10-16T11:43:07.702 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:07.714 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:07.714 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:08.094 INFO:teuthology.orchestra.run.smithi094.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:08.104 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/346 2023-10-16T11:43:08.105 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/346 2023-10-16T11:43:08.105 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:08.111 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:08.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:08.135 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-10-16T11:43:08.634 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:08.646 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:08.646 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:09.102 INFO:teuthology.orchestra.run.smithi094.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:09.114 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/347 2023-10-16T11:43:09.114 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/347 2023-10-16T11:43:09.114 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:09.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:09.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:09.148 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-10-16T11:43:09.663 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:09.676 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:09.676 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:10.035 INFO:teuthology.orchestra.run.smithi094.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:10.046 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/348 2023-10-16T11:43:10.046 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/348 2023-10-16T11:43:10.046 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:10.054 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:10.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:10.079 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-10-16T11:43:10.567 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:10.579 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:10.579 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:13.450 INFO:teuthology.orchestra.run.smithi094.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T11:43:13.461 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/349 2023-10-16T11:43:13.461 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/349 2023-10-16T11:43:13.462 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:13.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:13.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:13.500 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-10-16T11:43:13.950 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:13.962 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:13.962 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:17.975 INFO:teuthology.orchestra.run.smithi094.stdout:generic/350 4s 2023-10-16T11:43:17.992 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/350 2023-10-16T11:43:17.992 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:18.000 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:18.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:18.028 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-10-16T11:43:18.553 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:18.566 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:18.566 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:21.624 INFO:teuthology.orchestra.run.smithi094.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-16T11:43:21.635 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/351 2023-10-16T11:43:21.635 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/351 2023-10-16T11:43:21.635 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:21.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:21.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:21.671 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-10-16T11:43:22.369 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:22.380 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:22.380 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:22.817 INFO:teuthology.orchestra.run.smithi094.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:22.831 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/352 2023-10-16T11:43:22.832 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/352 2023-10-16T11:43:22.832 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:22.843 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:22.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:22.870 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-10-16T11:43:23.348 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:23.359 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:23.359 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:23.924 INFO:teuthology.orchestra.run.smithi094.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:23.936 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/353 2023-10-16T11:43:23.936 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/353 2023-10-16T11:43:23.936 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:23.946 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:23.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:23.980 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-10-16T11:43:24.475 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:24.486 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:24.487 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:24.838 INFO:teuthology.orchestra.run.smithi094.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:24.848 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/354 2023-10-16T11:43:24.848 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/354 2023-10-16T11:43:24.848 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:24.856 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:24.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:24.881 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-10-16T11:43:25.370 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:25.381 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:25.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:27.445 INFO:teuthology.orchestra.run.smithi094.stdout:generic/355 2s 2023-10-16T11:43:27.460 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/355 2023-10-16T11:43:27.461 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:27.468 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:27.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:27.495 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-10-16T11:43:28.250 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:28.261 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:28.261 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:28.634 INFO:teuthology.orchestra.run.smithi094.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:28.645 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/356 2023-10-16T11:43:28.645 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/356 2023-10-16T11:43:28.645 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:28.653 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:28.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:28.682 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-10-16T11:43:29.175 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:29.187 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:29.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:29.565 INFO:teuthology.orchestra.run.smithi094.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:29.579 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/357 2023-10-16T11:43:29.579 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/357 2023-10-16T11:43:29.580 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:29.590 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:29.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:29.620 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-10-16T11:43:30.103 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:30.115 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:30.115 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:30.645 INFO:teuthology.orchestra.run.smithi094.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:30.658 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/358 2023-10-16T11:43:30.658 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/358 2023-10-16T11:43:30.659 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:30.668 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:30.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:30.697 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-10-16T11:43:31.223 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:31.234 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:31.235 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:31.640 INFO:teuthology.orchestra.run.smithi094.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:31.653 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/359 2023-10-16T11:43:31.653 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/359 2023-10-16T11:43:31.653 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:31.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:31.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:31.689 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-10-16T11:43:32.189 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:32.202 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:32.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:33.113 INFO:teuthology.orchestra.run.smithi094.stdout:generic/360 1s 2023-10-16T11:43:33.128 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/360 2023-10-16T11:43:33.129 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:33.139 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:33.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:33.162 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-10-16T11:43:33.697 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:33.708 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:34.212 INFO:teuthology.orchestra.run.smithi094.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:34.226 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/361 2023-10-16T11:43:34.227 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/361 2023-10-16T11:43:34.227 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:34.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:34.262 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-10-16T11:43:34.753 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:34.764 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:34.764 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:35.132 INFO:teuthology.orchestra.run.smithi094.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:35.142 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/362 2023-10-16T11:43:35.143 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/362 2023-10-16T11:43:35.143 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:35.150 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:35.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:35.176 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-10-16T11:43:35.665 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:35.677 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:35.678 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:36.056 INFO:teuthology.orchestra.run.smithi094.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:36.067 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/363 2023-10-16T11:43:36.067 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/363 2023-10-16T11:43:36.068 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:36.076 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:36.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:36.105 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-10-16T11:43:36.613 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:36.625 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:36.625 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:37.037 INFO:teuthology.orchestra.run.smithi094.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:37.049 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/364 2023-10-16T11:43:37.049 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/364 2023-10-16T11:43:37.049 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:37.057 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:37.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:37.089 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-10-16T11:43:37.591 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:37.603 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:37.603 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:37.964 INFO:teuthology.orchestra.run.smithi094.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:37.973 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/365 2023-10-16T11:43:37.973 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/365 2023-10-16T11:43:37.973 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:37.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:38.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:38.011 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-10-16T11:43:38.517 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:38.529 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:38.529 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:38.907 INFO:teuthology.orchestra.run.smithi094.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:38.917 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/366 2023-10-16T11:43:38.917 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/366 2023-10-16T11:43:38.918 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:38.926 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:38.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:38.951 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-10-16T11:43:39.457 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:39.469 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:39.469 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:39.836 INFO:teuthology.orchestra.run.smithi094.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:39.846 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/367 2023-10-16T11:43:39.846 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/367 2023-10-16T11:43:39.846 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:39.853 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:39.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:39.876 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-10-16T11:43:40.360 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:40.372 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:40.372 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:40.747 INFO:teuthology.orchestra.run.smithi094.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:40.757 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/368 2023-10-16T11:43:40.758 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/368 2023-10-16T11:43:40.758 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:40.766 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:40.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:40.794 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-10-16T11:43:41.279 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:41.291 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:41.291 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:41.655 INFO:teuthology.orchestra.run.smithi094.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:41.664 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/369 2023-10-16T11:43:41.664 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/369 2023-10-16T11:43:41.664 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:41.672 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:41.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:41.700 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-10-16T11:43:42.201 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:42.213 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:42.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:42.570 INFO:teuthology.orchestra.run.smithi094.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:42.580 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/370 2023-10-16T11:43:42.580 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/370 2023-10-16T11:43:42.580 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:42.588 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:42.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:42.618 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-10-16T11:43:43.107 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:43.120 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:43.120 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:43.535 INFO:teuthology.orchestra.run.smithi094.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:43.546 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/371 2023-10-16T11:43:43.546 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/371 2023-10-16T11:43:43.546 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:43.555 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:43.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:43.583 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-10-16T11:43:44.081 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:44.092 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:44.092 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:44.486 INFO:teuthology.orchestra.run.smithi094.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:44.497 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/372 2023-10-16T11:43:44.497 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/372 2023-10-16T11:43:44.498 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:44.506 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:44.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:44.533 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-10-16T11:43:44.999 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:45.011 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:45.011 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:45.372 INFO:teuthology.orchestra.run.smithi094.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:45.382 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/373 2023-10-16T11:43:45.382 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/373 2023-10-16T11:43:45.382 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:45.389 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:45.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:45.415 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-10-16T11:43:45.885 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:45.896 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:45.896 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:46.262 INFO:teuthology.orchestra.run.smithi094.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:46.271 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/374 2023-10-16T11:43:46.271 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/374 2023-10-16T11:43:46.272 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:46.279 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:46.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:46.301 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-10-16T11:43:46.810 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:46.823 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:46.824 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:47.259 INFO:teuthology.orchestra.run.smithi094.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T11:43:47.269 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/375 2023-10-16T11:43:47.269 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/375 2023-10-16T11:43:47.270 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:47.278 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:47.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:47.304 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-10-16T11:43:47.808 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:47.820 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:47.820 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:48.373 INFO:teuthology.orchestra.run.smithi094.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:48.385 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/376 2023-10-16T11:43:48.386 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/376 2023-10-16T11:43:48.386 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:48.395 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:48.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:48.423 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-10-16T11:43:48.928 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:48.941 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:48.941 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:49.323 INFO:teuthology.orchestra.run.smithi094.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:49.332 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/377 2023-10-16T11:43:49.332 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/377 2023-10-16T11:43:49.332 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:49.339 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:49.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:49.361 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-10-16T11:43:49.877 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:49.891 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:49.891 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:51.872 INFO:teuthology.orchestra.run.smithi094.stdout:generic/378 2s 2023-10-16T11:43:51.888 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/378 2023-10-16T11:43:51.888 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:51.895 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:51.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:51.924 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-10-16T11:43:53.520 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:53.533 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:53.534 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:54.092 INFO:teuthology.orchestra.run.smithi094.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/379 2023-10-16T11:43:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/379 2023-10-16T11:43:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:54.141 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:54.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:54.172 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-10-16T11:43:54.707 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:54.720 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:54.720 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:55.137 INFO:teuthology.orchestra.run.smithi094.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:55.149 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/380 2023-10-16T11:43:55.150 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/380 2023-10-16T11:43:55.150 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:55.158 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:55.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:55.184 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-10-16T11:43:55.669 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:55.681 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:55.681 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:56.046 INFO:teuthology.orchestra.run.smithi094.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:56.056 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/381 2023-10-16T11:43:56.056 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/381 2023-10-16T11:43:56.056 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:56.064 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:56.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:56.089 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-10-16T11:43:56.592 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:56.603 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:56.604 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:56.977 INFO:teuthology.orchestra.run.smithi094.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:56.990 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/382 2023-10-16T11:43:56.990 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/382 2023-10-16T11:43:56.990 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:57.001 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:57.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:57.028 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-10-16T11:43:57.527 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:57.540 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:57.540 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:57.914 INFO:teuthology.orchestra.run.smithi094.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:57.925 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/383 2023-10-16T11:43:57.925 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/383 2023-10-16T11:43:57.925 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:57.933 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:57.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:57.960 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-10-16T11:43:58.443 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:58.454 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:58.454 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:58.816 INFO:teuthology.orchestra.run.smithi094.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T11:43:58.825 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/384 2023-10-16T11:43:58.826 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/384 2023-10-16T11:43:58.826 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:58.833 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:58.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:58.855 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-10-16T11:43:59.336 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:43:59.348 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:43:59.348 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:59.710 INFO:teuthology.orchestra.run.smithi094.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:43:59.720 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/385 2023-10-16T11:43:59.720 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/385 2023-10-16T11:43:59.720 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:43:59.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:43:59.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:43:59.753 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-10-16T11:44:00.256 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:44:00.268 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:44:00.268 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:00.629 INFO:teuthology.orchestra.run.smithi094.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T11:44:00.638 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/386 2023-10-16T11:44:00.639 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/386 2023-10-16T11:44:00.639 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:44:00.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:00.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:44:00.668 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-10-16T11:44:01.135 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:44:01.147 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:44:01.147 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:01.531 INFO:teuthology.orchestra.run.smithi094.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:44:01.541 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/387 2023-10-16T11:44:01.541 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/387 2023-10-16T11:44:01.541 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:44:01.547 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:01.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:44:01.570 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-10-16T11:44:02.077 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:44:02.088 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:44:02.088 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:02.475 INFO:teuthology.orchestra.run.smithi094.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:44:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/388 2023-10-16T11:44:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/388 2023-10-16T11:44:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:44:02.496 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:02.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:44:02.528 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-10-16T11:44:03.012 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:44:03.023 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:44:03.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:03.430 INFO:teuthology.orchestra.run.smithi094.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-10-16T11:44:03.442 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/389 2023-10-16T11:44:03.442 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/389 2023-10-16T11:44:03.442 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:44:03.453 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:03.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:44:03.482 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-10-16T11:44:03.987 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:44:03.999 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:44:04.000 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:04.464 INFO:teuthology.orchestra.run.smithi094.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:44:04.476 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/390 2023-10-16T11:44:04.477 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/390 2023-10-16T11:44:04.477 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:44:04.488 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:44:04.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:44:04.528 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-10-16T11:44:05.019 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:44:05.031 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:44:05.031 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:11.738 INFO:teuthology.orchestra.run.smithi094.stdout:generic/391 66s 2023-10-16T11:45:11.953 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/391 2023-10-16T11:45:11.953 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:11.966 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:12.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:12.183 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-10-16T11:45:14.891 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:14.910 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:14.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:15.445 INFO:teuthology.orchestra.run.smithi094.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:15.461 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/392 2023-10-16T11:45:15.461 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/392 2023-10-16T11:45:15.461 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:15.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:15.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:15.512 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-10-16T11:45:16.012 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:16.023 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:16.024 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:16.505 INFO:teuthology.orchestra.run.smithi094.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:16.515 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/393 2023-10-16T11:45:16.515 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/393 2023-10-16T11:45:16.516 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:16.522 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:16.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:16.546 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-10-16T11:45:17.595 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:17.608 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:17.608 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:19.040 INFO:teuthology.orchestra.run.smithi094.stdout:generic/394 1s 2023-10-16T11:45:19.064 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/394 2023-10-16T11:45:19.064 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:19.076 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:19.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:19.109 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-10-16T11:45:19.879 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:19.894 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:19.894 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:20.463 INFO:teuthology.orchestra.run.smithi094.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:20.474 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/395 2023-10-16T11:45:20.475 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/395 2023-10-16T11:45:20.475 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:20.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:20.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:20.521 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-10-16T11:45:20.978 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:20.991 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:20.991 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:21.479 INFO:teuthology.orchestra.run.smithi094.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:21.490 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/396 2023-10-16T11:45:21.490 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/396 2023-10-16T11:45:21.491 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:21.499 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:21.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:21.529 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-10-16T11:45:22.025 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:22.037 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:22.037 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:22.574 INFO:teuthology.orchestra.run.smithi094.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:22.586 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/397 2023-10-16T11:45:22.586 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/397 2023-10-16T11:45:22.587 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:22.596 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:22.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:22.623 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-10-16T11:45:23.134 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:23.147 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:23.147 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:23.603 INFO:teuthology.orchestra.run.smithi094.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:23.611 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/398 2023-10-16T11:45:23.612 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/398 2023-10-16T11:45:23.612 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:23.618 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:23.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:23.641 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-10-16T11:45:24.099 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:24.111 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:24.112 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:24.638 INFO:teuthology.orchestra.run.smithi094.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:24.653 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/399 2023-10-16T11:45:24.653 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/399 2023-10-16T11:45:24.653 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:24.667 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:24.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:24.699 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-10-16T11:45:25.253 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:25.266 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:25.266 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:25.687 INFO:teuthology.orchestra.run.smithi094.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T11:45:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/400 2023-10-16T11:45:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/400 2023-10-16T11:45:25.700 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:25.712 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:25.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:25.747 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-10-16T11:45:26.313 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:26.326 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:26.326 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:26.729 INFO:teuthology.orchestra.run.smithi094.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:26.738 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/401 2023-10-16T11:45:26.739 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/401 2023-10-16T11:45:26.739 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:26.749 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:26.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:26.778 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-10-16T11:45:27.334 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:27.347 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:27.347 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:27.805 INFO:teuthology.orchestra.run.smithi094.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:27.819 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/402 2023-10-16T11:45:27.820 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/402 2023-10-16T11:45:27.820 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:27.832 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:27.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:27.863 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-10-16T11:45:28.429 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:28.444 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:28.444 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:28.877 INFO:teuthology.orchestra.run.smithi094.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:28.889 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/403 2023-10-16T11:45:28.889 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/403 2023-10-16T11:45:28.889 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:28.898 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:28.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:28.929 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-10-16T11:45:29.488 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:29.501 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:29.501 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:33.317 INFO:teuthology.orchestra.run.smithi094.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-16T11:45:33.331 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/404 2023-10-16T11:45:33.332 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/404 2023-10-16T11:45:33.332 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:33.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:33.374 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-10-16T11:45:34.063 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:34.075 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:34.581 INFO:teuthology.orchestra.run.smithi094.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:34.595 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/405 2023-10-16T11:45:34.595 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/405 2023-10-16T11:45:34.595 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:34.606 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:34.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:34.638 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-10-16T11:45:35.208 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:35.222 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:35.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:35.713 INFO:teuthology.orchestra.run.smithi094.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:35.723 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/406 2023-10-16T11:45:35.724 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/406 2023-10-16T11:45:35.724 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:35.732 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:35.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:35.762 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-10-16T11:45:36.313 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:36.326 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:36.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:36.931 INFO:teuthology.orchestra.run.smithi094.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:45:36.945 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/407 2023-10-16T11:45:36.945 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/407 2023-10-16T11:45:36.945 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:36.957 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:36.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:36.996 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-10-16T11:45:37.692 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:37.703 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:37.704 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:38.216 INFO:teuthology.orchestra.run.smithi094.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T11:45:38.228 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/408 2023-10-16T11:45:38.228 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/408 2023-10-16T11:45:38.229 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:38.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:38.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:38.266 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-10-16T11:45:38.949 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:38.961 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:38.961 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:39.359 INFO:teuthology.orchestra.run.smithi094.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:39.370 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/409 2023-10-16T11:45:39.370 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/409 2023-10-16T11:45:39.370 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:39.379 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:39.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:39.407 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-10-16T11:45:39.946 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:39.958 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:39.959 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:40.365 INFO:teuthology.orchestra.run.smithi094.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:40.374 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/410 2023-10-16T11:45:40.375 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/410 2023-10-16T11:45:40.375 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:40.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:40.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:40.406 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-10-16T11:45:40.987 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:41.000 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:41.000 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:41.439 INFO:teuthology.orchestra.run.smithi094.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:41.450 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/411 2023-10-16T11:45:41.450 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/411 2023-10-16T11:45:41.451 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:41.458 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:41.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:41.483 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-10-16T11:45:41.990 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:42.001 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:42.001 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:42.342 INFO:teuthology.orchestra.run.smithi094.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:42.351 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/412 2023-10-16T11:45:42.352 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/412 2023-10-16T11:45:42.352 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:42.359 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:42.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:42.386 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-10-16T11:45:42.905 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:42.916 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:42.916 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:43.270 INFO:teuthology.orchestra.run.smithi094.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:43.283 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/413 2023-10-16T11:45:43.283 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/413 2023-10-16T11:45:43.284 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:43.294 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:43.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:43.325 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-10-16T11:45:43.854 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:43.866 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:43.866 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:44.239 INFO:teuthology.orchestra.run.smithi094.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:44.250 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/414 2023-10-16T11:45:44.250 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/414 2023-10-16T11:45:44.250 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:44.257 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:44.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:44.284 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-10-16T11:45:44.817 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:44.830 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:44.830 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:45.247 INFO:teuthology.orchestra.run.smithi094.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:45.258 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/415 2023-10-16T11:45:45.258 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/415 2023-10-16T11:45:45.258 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:45.266 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:45.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:45.295 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-10-16T11:45:45.832 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:45.844 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:46.247 INFO:teuthology.orchestra.run.smithi094.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:46.259 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/416 2023-10-16T11:45:46.259 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/416 2023-10-16T11:45:46.259 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:46.269 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:46.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:46.301 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-10-16T11:45:46.884 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:46.897 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:46.898 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:47.346 INFO:teuthology.orchestra.run.smithi094.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:47.357 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/417 2023-10-16T11:45:47.357 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/417 2023-10-16T11:45:47.357 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:47.366 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:47.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:47.398 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-10-16T11:45:47.935 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:47.948 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:47.948 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:48.462 INFO:teuthology.orchestra.run.smithi094.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-10-16T11:45:48.477 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/418 2023-10-16T11:45:48.477 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/418 2023-10-16T11:45:48.477 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:48.489 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:48.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:48.523 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-10-16T11:45:49.077 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:49.089 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:49.089 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:49.635 INFO:teuthology.orchestra.run.smithi094.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:49.645 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/419 2023-10-16T11:45:49.645 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/419 2023-10-16T11:45:49.646 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:49.654 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:49.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:49.683 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-10-16T11:45:50.237 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:50.253 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:50.254 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:53.287 INFO:teuthology.orchestra.run.smithi094.stdout:generic/420 3s 2023-10-16T11:45:53.303 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/420 2023-10-16T11:45:53.304 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:53.312 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:53.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:53.343 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-10-16T11:45:54.038 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:54.050 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:54.051 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:54.532 INFO:teuthology.orchestra.run.smithi094.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:54.543 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/421 2023-10-16T11:45:54.543 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/421 2023-10-16T11:45:54.544 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:54.553 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:54.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:54.582 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-10-16T11:45:54.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:45:54.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:45:55.099 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:55.111 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:55.112 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:55.533 INFO:teuthology.orchestra.run.smithi094.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:55.544 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/422 2023-10-16T11:45:55.544 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/422 2023-10-16T11:45:55.545 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:55.553 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:55.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:55.584 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-10-16T11:45:56.132 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:56.145 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:56.145 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:56.900 INFO:teuthology.orchestra.run.smithi094.stdout:generic/423 0s 2023-10-16T11:45:56.917 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/423 2023-10-16T11:45:56.917 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:56.925 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:56.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:56.957 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-10-16T11:45:57.652 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:57.665 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:57.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:58.110 INFO:teuthology.orchestra.run.smithi094.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-10-16T11:45:58.121 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/424 2023-10-16T11:45:58.122 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/424 2023-10-16T11:45:58.122 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:58.130 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:58.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:58.159 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-10-16T11:45:58.705 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:58.718 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:58.718 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:59.113 INFO:teuthology.orchestra.run.smithi094.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:45:59.123 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/425 2023-10-16T11:45:59.123 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/425 2023-10-16T11:45:59.124 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:45:59.131 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:45:59.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:45:59.159 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-10-16T11:45:59.708 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:45:59.722 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:45:59.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:46:24.966 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:46:24.976 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:46:57.010 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:46:57.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:47:28.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:47:28.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:47:34.878 INFO:teuthology.orchestra.run.smithi094.stdout:generic/426 95s 2023-10-16T11:47:34.978 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/426 2023-10-16T11:47:34.978 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:34.999 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:35.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:35.174 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-10-16T11:47:36.823 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:36.837 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:36.837 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:37.346 INFO:teuthology.orchestra.run.smithi094.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:47:37.359 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/427 2023-10-16T11:47:37.359 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/427 2023-10-16T11:47:37.360 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:37.370 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:37.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:37.399 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-10-16T11:47:37.951 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:37.964 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:37.965 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:38.496 INFO:teuthology.orchestra.run.smithi094.stdout:generic/428 1s 2023-10-16T11:47:38.515 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/428 2023-10-16T11:47:38.515 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:38.525 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:38.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:38.551 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-10-16T11:47:39.100 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:39.113 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:39.114 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:39.710 INFO:teuthology.orchestra.run.smithi094.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:47:39.725 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/429 2023-10-16T11:47:39.725 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/429 2023-10-16T11:47:39.726 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:39.737 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:39.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:39.771 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-10-16T11:47:40.314 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:40.326 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:40.326 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:41.083 INFO:teuthology.orchestra.run.smithi094.stdout:generic/430 1s 2023-10-16T11:47:41.100 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/430 2023-10-16T11:47:41.101 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:41.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:41.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:41.141 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-10-16T11:47:41.845 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:41.856 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:41.857 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:42.528 INFO:teuthology.orchestra.run.smithi094.stdout:generic/431 1s 2023-10-16T11:47:42.545 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/431 2023-10-16T11:47:42.545 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:42.553 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:42.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:42.584 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-10-16T11:47:43.259 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:43.270 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:43.271 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:43.976 INFO:teuthology.orchestra.run.smithi094.stdout:generic/432 0s 2023-10-16T11:47:43.991 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/432 2023-10-16T11:47:43.991 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:44.000 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:44.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:44.027 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-10-16T11:47:44.675 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:44.687 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:44.687 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:45.344 INFO:teuthology.orchestra.run.smithi094.stdout:generic/433 1s 2023-10-16T11:47:45.358 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/433 2023-10-16T11:47:45.358 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:45.365 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:45.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:45.389 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-10-16T11:47:46.073 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:46.085 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:46.085 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:46.699 INFO:teuthology.orchestra.run.smithi094.stdout:generic/434 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/434.out.bad) 2023-10-16T11:47:46.707 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/434.out 2023-10-16 08:53:19.614272654 +0000 2023-10-16T11:47:46.708 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/434.out.bad 2023-10-16 11:47:46.693941387 +0000 2023-10-16T11:47:46.708 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -9,6 +9,6 @@ 2023-10-16T11:47:46.708 INFO:teuthology.orchestra.run.smithi094.stdout: copy_range: Bad file descriptor 2023-10-16T11:47:46.708 INFO:teuthology.orchestra.run.smithi094.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-10-16T11:47:46.709 INFO:teuthology.orchestra.run.smithi094.stdout: Try to copy to a device 2023-10-16T11:47:46.709 INFO:teuthology.orchestra.run.smithi094.stdout: -copy_range: Invalid argument 2023-10-16T11:47:46.709 INFO:teuthology.orchestra.run.smithi094.stdout: +/tmp/tmp.VH3pOVWuu6test/test-434/dev1: Permission denied 2023-10-16T11:47:46.709 INFO:teuthology.orchestra.run.smithi094.stdout: Try to copy to a fifo 2023-10-16T11:47:46.709 INFO:teuthology.orchestra.run.smithi094.stdout: copy_range: Invalid argument 2023-10-16T11:47:46.714 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/434 2023-10-16T11:47:46.714 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/434 2023-10-16T11:47:46.714 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:47:46.721 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:46.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:47:46.745 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:47:46.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:47:46.746 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-10-16T11:47:47.428 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:47.439 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:47.439 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:47.947 INFO:teuthology.orchestra.run.smithi094.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:47:47.960 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/435 2023-10-16T11:47:47.960 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/435 2023-10-16T11:47:47.961 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:47.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:48.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:48.007 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-10-16T11:47:48.557 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:48.570 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:48.570 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:51.241 INFO:teuthology.orchestra.run.smithi094.stdout:generic/436 3s 2023-10-16T11:47:51.258 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/436 2023-10-16T11:47:51.259 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:51.267 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:51.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:51.297 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-10-16T11:47:52.004 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:52.018 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:52.018 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:53.392 INFO:teuthology.orchestra.run.smithi094.stdout:generic/437 1s 2023-10-16T11:47:53.411 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/437 2023-10-16T11:47:53.411 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:47:53.419 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:53.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:47:53.450 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-10-16T11:47:54.015 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:47:54.027 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:47:54.028 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:47:59.024 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:47:59.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:48:29.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:48:29.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:48:59.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:48:59.363 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:49:29.497 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:49:29.508 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:49:59.636 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:49:59.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:50:29.766 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:50:29.777 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:50:59.913 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:50:59.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:51:22.904 INFO:teuthology.orchestra.run.smithi094.stdout:generic/438 208s 2023-10-16T11:51:22.921 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/438 2023-10-16T11:51:22.922 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:22.930 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:22.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:22.959 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-10-16T11:51:23.489 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:23.502 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:23.502 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:23.936 INFO:teuthology.orchestra.run.smithi094.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:23.946 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/439 2023-10-16T11:51:23.946 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/439 2023-10-16T11:51:23.946 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:23.954 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:23.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:23.980 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-10-16T11:51:24.529 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:24.542 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:24.543 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:25.076 INFO:teuthology.orchestra.run.smithi094.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:25.088 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/440 2023-10-16T11:51:25.088 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/440 2023-10-16T11:51:25.088 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:25.097 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:25.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:25.129 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-10-16T11:51:25.670 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:25.682 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:25.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:26.252 INFO:teuthology.orchestra.run.smithi094.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:26.266 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/441 2023-10-16T11:51:26.266 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/441 2023-10-16T11:51:26.266 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:26.280 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:26.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:26.316 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-10-16T11:51:26.844 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:26.857 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:26.857 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:27.362 INFO:teuthology.orchestra.run.smithi094.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:27.377 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/442 2023-10-16T11:51:27.377 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/442 2023-10-16T11:51:27.378 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:27.390 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:27.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:27.422 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-10-16T11:51:27.969 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:27.982 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:27.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:28.530 INFO:teuthology.orchestra.run.smithi094.stdout:generic/443 0s 2023-10-16T11:51:28.550 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/443 2023-10-16T11:51:28.550 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:28.562 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:28.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:28.596 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-10-16T11:51:29.133 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:29.145 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:29.145 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:29.634 INFO:teuthology.orchestra.run.smithi094.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T11:51:29.647 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/444 2023-10-16T11:51:29.648 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/444 2023-10-16T11:51:29.648 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:29.659 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:29.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:29.693 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-10-16T11:51:30.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:51:30.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:51:30.252 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:30.263 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:30.264 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:32.845 INFO:teuthology.orchestra.run.smithi094.stdout:generic/445 2s 2023-10-16T11:51:32.862 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/445 2023-10-16T11:51:32.862 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:32.869 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:32.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:32.906 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-10-16T11:51:33.596 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:33.609 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:34.053 INFO:teuthology.orchestra.run.smithi094.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:34.064 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/446 2023-10-16T11:51:34.064 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/446 2023-10-16T11:51:34.064 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:34.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:34.102 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-10-16T11:51:34.664 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:34.678 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:34.678 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:35.097 INFO:teuthology.orchestra.run.smithi094.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:35.112 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/447 2023-10-16T11:51:35.113 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/447 2023-10-16T11:51:35.113 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:35.124 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:35.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:35.158 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-10-16T11:51:35.714 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:35.728 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:35.729 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:38.411 INFO:teuthology.orchestra.run.smithi094.stdout:generic/448 3s 2023-10-16T11:51:38.429 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/448 2023-10-16T11:51:38.430 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:38.438 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:38.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:38.499 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-10-16T11:51:39.173 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:39.185 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:39.186 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:39.600 INFO:teuthology.orchestra.run.smithi094.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:39.612 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/449 2023-10-16T11:51:39.613 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/449 2023-10-16T11:51:39.613 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:39.623 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:39.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:39.654 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-10-16T11:51:40.206 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:40.220 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:40.220 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:44.245 INFO:teuthology.orchestra.run.smithi094.stdout:generic/450 4s 2023-10-16T11:51:44.268 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/450 2023-10-16T11:51:44.268 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:44.280 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:44.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:44.319 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-10-16T11:51:45.016 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:45.027 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:45.028 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:45.825 INFO:teuthology.orchestra.run.smithi094.stdout:generic/451 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/451.out.bad) 2023-10-16T11:51:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/451.out 2023-10-16 08:53:19.617272604 +0000 2023-10-16T11:51:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/451.out.bad 2023-10-16 11:51:45.820831469 +0000 2023-10-16T11:51:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,2 +1,5 @@ 2023-10-16T11:51:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 451 2023-10-16T11:51:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: +get stale data from buffer read 2023-10-16T11:51:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-10-16T11:51:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: +000a0000 2023-10-16T11:51:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: Silence is golden 2023-10-16T11:51:45.839 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/451 2023-10-16T11:51:45.839 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/451 2023-10-16T11:51:45.839 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:51:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:45.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:51:45.872 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:51:45.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:51:45.873 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-10-16T11:51:46.640 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:46.658 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:46.658 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:46.971 INFO:teuthology.orchestra.run.smithi094.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:46.981 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/452 2023-10-16T11:51:46.981 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/452 2023-10-16T11:51:46.981 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:46.990 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:47.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:47.018 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-10-16T11:51:47.531 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:47.544 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:47.544 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:47.943 INFO:teuthology.orchestra.run.smithi094.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:47.955 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/453 2023-10-16T11:51:47.955 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/453 2023-10-16T11:51:47.955 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:47.964 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:47.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:47.993 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-10-16T11:51:48.534 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:48.546 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:48.547 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:48.945 INFO:teuthology.orchestra.run.smithi094.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:48.956 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/454 2023-10-16T11:51:48.957 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/454 2023-10-16T11:51:48.957 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:48.966 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:48.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:48.994 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-10-16T11:51:49.562 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:49.575 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:49.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:50.156 INFO:teuthology.orchestra.run.smithi094.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:50.167 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/455 2023-10-16T11:51:50.168 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/455 2023-10-16T11:51:50.168 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:50.177 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:50.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:50.207 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-10-16T11:51:50.751 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:50.764 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:50.765 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:51.248 INFO:teuthology.orchestra.run.smithi094.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:51.262 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/456 2023-10-16T11:51:51.263 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/456 2023-10-16T11:51:51.263 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:51.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:51.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:51.306 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-10-16T11:51:51.842 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:51.856 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:51.856 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:52.452 INFO:teuthology.orchestra.run.smithi094.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:52.465 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/457 2023-10-16T11:51:52.465 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/457 2023-10-16T11:51:52.465 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:52.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:52.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:52.503 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-10-16T11:51:53.010 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:53.022 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:53.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:53.402 INFO:teuthology.orchestra.run.smithi094.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:53.414 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/458 2023-10-16T11:51:53.414 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/458 2023-10-16T11:51:53.414 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:53.423 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:53.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:53.451 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-10-16T11:51:54.005 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:54.019 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:54.020 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:54.719 INFO:teuthology.orchestra.run.smithi094.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:54.731 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/459 2023-10-16T11:51:54.731 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/459 2023-10-16T11:51:54.732 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:54.741 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:54.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:54.772 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-10-16T11:51:55.330 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:55.342 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:55.342 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:55.745 INFO:teuthology.orchestra.run.smithi094.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:55.755 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/460 2023-10-16T11:51:55.755 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/460 2023-10-16T11:51:55.756 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:55.764 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:55.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:55.791 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-10-16T11:51:56.334 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:56.348 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:56.348 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:56.743 INFO:teuthology.orchestra.run.smithi094.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:56.754 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/461 2023-10-16T11:51:56.754 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/461 2023-10-16T11:51:56.754 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:56.763 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:56.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:56.791 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-10-16T11:51:57.326 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:57.340 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:57.340 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:57.759 INFO:teuthology.orchestra.run.smithi094.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:51:57.771 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/462 2023-10-16T11:51:57.771 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/462 2023-10-16T11:51:57.771 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:57.781 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:57.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:57.808 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-10-16T11:51:58.367 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:58.381 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:58.381 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:58.941 INFO:teuthology.orchestra.run.smithi094.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T11:51:58.953 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/463 2023-10-16T11:51:58.953 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/463 2023-10-16T11:51:58.953 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:51:58.962 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:51:58.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:51:58.995 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-10-16T11:51:59.719 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:51:59.733 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:51:59.733 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:00.166 INFO:teuthology.orchestra.run.smithi094.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:52:00.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:52:00.183 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:52:00.184 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/464 2023-10-16T11:52:00.184 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/464 2023-10-16T11:52:00.185 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:52:00.191 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:00.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:52:00.220 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-10-16T11:52:00.818 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:00.831 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:00.831 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:30.073 INFO:teuthology.orchestra.run.smithi094.stdout:generic/465 30s 2023-10-16T11:52:30.110 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/465 2023-10-16T11:52:30.111 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:52:30.126 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:30.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:52:30.175 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-10-16T11:52:30.364 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:52:30.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:52:30.744 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:30.755 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:30.755 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:31.149 INFO:teuthology.orchestra.run.smithi094.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:52:31.160 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/466 2023-10-16T11:52:31.160 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/466 2023-10-16T11:52:31.160 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:52:31.168 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:31.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:52:31.195 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-10-16T11:52:31.743 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:31.757 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:31.757 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:40.272 INFO:teuthology.orchestra.run.smithi094.stdout:generic/467 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/467.out.bad) 2023-10-16T11:52:40.286 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/467.out 2023-10-16 08:53:19.620272554 +0000 2023-10-16T11:52:40.287 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/467.out.bad 2023-10-16 11:52:40.216897834 +0000 2023-10-16T11:52:40.287 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,5 +1,15 @@ 2023-10-16T11:52:40.287 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 467 2023-10-16T11:52:40.287 INFO:teuthology.orchestra.run.smithi094.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-10-16T11:52:40.287 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000000) opened an unlinked file! 2023-10-16T11:52:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000001) opened an unlinked file! 2023-10-16T11:52:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000002) opened an unlinked file! 2023-10-16T11:52:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000003) opened an unlinked file! 2023-10-16T11:52:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000004) opened an unlinked file! 2023-10-16T11:52:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000005) opened an unlinked file! 2023-10-16T11:52:40.288 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000006) opened an unlinked file! 2023-10-16T11:52:40.289 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000007) opened an unlinked file! 2023-10-16T11:52:40.289 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000008) opened an unlinked file! 2023-10-16T11:52:40.289 INFO:teuthology.orchestra.run.smithi094.stdout: +open_by_handle(/tmp/tmp.VH3pOVWuu6test/467-dir/file000009) opened an unlinked file! 2023-10-16T11:52:40.289 INFO:teuthology.orchestra.run.smithi094.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-10-16T11:52:40.289 INFO:teuthology.orchestra.run.smithi094.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-10-16T11:52:40.289 INFO:teuthology.orchestra.run.smithi094.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-10-16T11:52:40.303 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/467 2023-10-16T11:52:40.304 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/467 2023-10-16T11:52:40.304 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:52:40.355 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:40.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:52:40.554 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:52:40.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:52:40.555 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-10-16T11:52:42.373 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:42.388 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:42.389 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:42.883 INFO:teuthology.orchestra.run.smithi094.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:52:42.896 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/468 2023-10-16T11:52:42.896 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/468 2023-10-16T11:52:42.896 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:52:42.906 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:42.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:52:42.936 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-10-16T11:52:43.500 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:43.514 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:43.514 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:49.773 INFO:teuthology.orchestra.run.smithi094.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T11:52:49.788 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/469 2023-10-16T11:52:49.788 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/469 2023-10-16T11:52:49.788 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:52:49.800 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:49.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:52:49.845 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-10-16T11:52:50.519 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:50.530 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:50.531 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:50.975 INFO:teuthology.orchestra.run.smithi094.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:52:50.987 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/470 2023-10-16T11:52:50.987 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/470 2023-10-16T11:52:50.987 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:52:50.996 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:52:51.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:52:51.030 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-10-16T11:52:51.576 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:52:51.589 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:52:51.590 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:53:00.492 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:53:00.501 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:53:30.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:53:30.816 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:54:00.948 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:54:00.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:54:31.146 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:54:31.151 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:54:38.108 INFO:teuthology.orchestra.run.smithi094.stdout:generic/471 106s 2023-10-16T11:54:38.132 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/471 2023-10-16T11:54:38.133 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:38.145 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:38.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:38.175 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-10-16T11:54:39.195 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:39.217 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:39.217 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:39.830 INFO:teuthology.orchestra.run.smithi094.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:54:39.845 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/472 2023-10-16T11:54:39.845 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/472 2023-10-16T11:54:39.845 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:39.857 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:39.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:39.888 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-10-16T11:54:40.339 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:40.351 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:40.352 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:40.886 INFO:teuthology.orchestra.run.smithi094.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T11:54:40.900 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/473 2023-10-16T11:54:40.900 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/473 2023-10-16T11:54:40.900 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:40.911 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:40.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:40.943 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-10-16T11:54:41.472 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:41.485 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:41.485 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:41.886 INFO:teuthology.orchestra.run.smithi094.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:54:41.896 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/474 2023-10-16T11:54:41.896 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/474 2023-10-16T11:54:41.897 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:41.905 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:41.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:41.935 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-10-16T11:54:42.460 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:42.472 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:42.472 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:42.973 INFO:teuthology.orchestra.run.smithi094.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:54:42.987 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/475 2023-10-16T11:54:42.988 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/475 2023-10-16T11:54:42.988 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:43.001 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:43.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:43.033 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-10-16T11:54:43.568 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:43.581 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:43.581 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:44.017 INFO:teuthology.orchestra.run.smithi094.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:54:44.030 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/476 2023-10-16T11:54:44.030 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/476 2023-10-16T11:54:44.031 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:44.042 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:44.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:44.074 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-10-16T11:54:44.629 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:44.642 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:44.643 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:56.707 INFO:teuthology.orchestra.run.smithi094.stdout:generic/477 12s 2023-10-16T11:54:56.820 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/477 2023-10-16T11:54:56.821 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:54:56.837 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:54:56.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:54:56.947 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-10-16T11:54:58.553 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:54:58.567 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:54:58.567 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:01.301 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:55:01.308 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:55:10.776 INFO:teuthology.orchestra.run.smithi094.stdout:generic/478 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/478.out.bad) 2023-10-16T11:55:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/478.out 2023-10-16 08:53:19.621272536 +0000 2023-10-16T11:55:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/478.out.bad 2023-10-16 11:55:10.742313800 +0000 2023-10-16T11:55:10.788 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -10,7 +10,7 @@ 2023-10-16T11:55:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: get wrlck 2023-10-16T11:55:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: -lock could be placed 2023-10-16T11:55:10.789 INFO:teuthology.orchestra.run.smithi094.stdout: +get wrlck 2023-10-16T11:55:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -25,7 +25,7 @@ 2023-10-16T11:55:10.790 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: get wrlck 2023-10-16T11:55:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: -lock could be placed 2023-10-16T11:55:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: +get wrlck 2023-10-16T11:55:10.791 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -37,7 +37,7 @@ 2023-10-16T11:55:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: get rdlck 2023-10-16T11:55:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: get rdlck 2023-10-16T11:55:10.792 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: -lock could be placed 2023-10-16T11:55:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: +get rdlck 2023-10-16T11:55:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: get rdlck 2023-10-16T11:55:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: get rdlck 2023-10-16T11:55:10.793 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -46,7 +46,7 @@ 2023-10-16T11:55:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: get rdlck 2023-10-16T11:55:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: get rdlck 2023-10-16T11:55:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: -lock could be placed 2023-10-16T11:55:10.794 INFO:teuthology.orchestra.run.smithi094.stdout: +get rdlck 2023-10-16T11:55:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.795 INFO:teuthology.orchestra.run.smithi094.stdout: lock could be placed 2023-10-16T11:55:10.797 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/478 2023-10-16T11:55:10.797 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/478 2023-10-16T11:55:10.798 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:55:10.808 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:10.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:55:10.841 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:55:10.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:55:10.842 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-10-16T11:55:11.379 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:11.392 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:11.393 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:11.938 INFO:teuthology.orchestra.run.smithi094.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:11.953 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/479 2023-10-16T11:55:11.953 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/479 2023-10-16T11:55:11.954 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:11.965 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:12.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:12.001 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-10-16T11:55:12.564 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:12.577 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:13.024 INFO:teuthology.orchestra.run.smithi094.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:13.038 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/480 2023-10-16T11:55:13.038 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/480 2023-10-16T11:55:13.039 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:13.050 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:13.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:13.084 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-10-16T11:55:13.654 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:13.667 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:13.667 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:14.097 INFO:teuthology.orchestra.run.smithi094.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:14.109 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/481 2023-10-16T11:55:14.109 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/481 2023-10-16T11:55:14.109 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:14.119 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:14.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:14.153 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-10-16T11:55:14.707 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:14.718 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:14.719 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:15.295 INFO:teuthology.orchestra.run.smithi094.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:15.306 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/482 2023-10-16T11:55:15.307 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/482 2023-10-16T11:55:15.307 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:15.315 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:15.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:15.345 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-10-16T11:55:15.879 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:15.891 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:15.892 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:16.346 INFO:teuthology.orchestra.run.smithi094.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:16.360 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/483 2023-10-16T11:55:16.361 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/483 2023-10-16T11:55:16.361 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:16.373 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:16.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:16.408 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-10-16T11:55:16.968 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:16.981 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:16.981 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:17.443 INFO:teuthology.orchestra.run.smithi094.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:17.458 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/484 2023-10-16T11:55:17.458 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/484 2023-10-16T11:55:17.459 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:17.470 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:17.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:17.502 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-10-16T11:55:18.038 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:18.052 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:18.052 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:21.581 INFO:teuthology.orchestra.run.smithi094.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-16T11:55:21.595 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/485 2023-10-16T11:55:21.595 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/485 2023-10-16T11:55:21.595 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:21.607 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:21.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:21.649 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-10-16T11:55:22.321 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:22.333 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:22.333 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:22.786 INFO:teuthology.orchestra.run.smithi094.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:22.799 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/486 2023-10-16T11:55:22.799 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/486 2023-10-16T11:55:22.799 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:22.810 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:22.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:22.841 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-10-16T11:55:23.374 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:23.387 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:23.388 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:23.833 INFO:teuthology.orchestra.run.smithi094.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:23.844 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/487 2023-10-16T11:55:23.844 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/487 2023-10-16T11:55:23.845 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:23.853 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:23.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:23.887 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-10-16T11:55:24.448 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:24.461 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:24.461 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:24.870 INFO:teuthology.orchestra.run.smithi094.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:24.881 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/488 2023-10-16T11:55:24.882 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/488 2023-10-16T11:55:24.882 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:24.890 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:24.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:24.920 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-10-16T11:55:25.462 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:25.475 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:25.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:25.943 INFO:teuthology.orchestra.run.smithi094.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:25.954 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/489 2023-10-16T11:55:25.955 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/489 2023-10-16T11:55:25.955 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:25.964 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:25.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:25.994 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-10-16T11:55:26.519 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:26.531 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:26.531 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:29.121 INFO:teuthology.orchestra.run.smithi094.stdout:generic/490 3s 2023-10-16T11:55:29.137 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/490 2023-10-16T11:55:29.137 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:29.145 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:29.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:29.190 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-10-16T11:55:29.883 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:29.895 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:29.895 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:30.331 INFO:teuthology.orchestra.run.smithi094.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:30.344 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/491 2023-10-16T11:55:30.345 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/491 2023-10-16T11:55:30.345 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:30.357 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:30.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:30.389 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-10-16T11:55:30.917 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:30.930 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:30.931 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:31.348 INFO:teuthology.orchestra.run.smithi094.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:31.359 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/492 2023-10-16T11:55:31.360 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/492 2023-10-16T11:55:31.360 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:31.370 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:31.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:31.403 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-10-16T11:55:31.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:55:31.496 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:55:31.912 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:31.925 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:31.925 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:32.330 INFO:teuthology.orchestra.run.smithi094.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:32.342 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/493 2023-10-16T11:55:32.342 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/493 2023-10-16T11:55:32.342 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:32.351 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:32.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:32.412 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-10-16T11:55:32.979 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:32.993 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:32.993 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:33.425 INFO:teuthology.orchestra.run.smithi094.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:33.438 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/494 2023-10-16T11:55:33.439 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/494 2023-10-16T11:55:33.439 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:33.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:33.481 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-10-16T11:55:34.017 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:34.032 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:34.434 INFO:teuthology.orchestra.run.smithi094.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:34.444 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/495 2023-10-16T11:55:34.445 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/495 2023-10-16T11:55:34.445 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:34.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:34.486 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-10-16T11:55:35.045 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:35.058 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:35.059 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:35.492 INFO:teuthology.orchestra.run.smithi094.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:35.505 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/496 2023-10-16T11:55:35.506 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/496 2023-10-16T11:55:35.506 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:35.516 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:35.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:35.552 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-10-16T11:55:36.089 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:36.102 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:36.103 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:36.543 INFO:teuthology.orchestra.run.smithi094.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:36.558 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/497 2023-10-16T11:55:36.558 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/497 2023-10-16T11:55:36.558 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:36.568 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:36.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:36.600 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-10-16T11:55:37.145 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:37.159 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:37.160 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:37.646 INFO:teuthology.orchestra.run.smithi094.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:37.657 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/498 2023-10-16T11:55:37.657 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/498 2023-10-16T11:55:37.657 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:37.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:37.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:37.695 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-10-16T11:55:38.260 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:38.274 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:38.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:38.677 INFO:teuthology.orchestra.run.smithi094.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:38.691 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/499 2023-10-16T11:55:38.691 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/499 2023-10-16T11:55:38.691 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:38.703 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:38.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:38.738 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-10-16T11:55:39.279 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:39.291 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:39.291 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:39.807 INFO:teuthology.orchestra.run.smithi094.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/500 2023-10-16T11:55:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/500 2023-10-16T11:55:39.822 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:39.833 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:39.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:39.867 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-10-16T11:55:40.414 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:40.427 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:40.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:40.890 INFO:teuthology.orchestra.run.smithi094.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:40.901 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/501 2023-10-16T11:55:40.901 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/501 2023-10-16T11:55:40.902 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:40.913 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:40.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:40.945 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-10-16T11:55:41.494 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:41.507 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:41.507 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:41.958 INFO:teuthology.orchestra.run.smithi094.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:41.974 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/502 2023-10-16T11:55:41.974 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/502 2023-10-16T11:55:41.974 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:41.986 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:42.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:42.025 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-10-16T11:55:42.581 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:42.594 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:42.594 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:43.034 INFO:teuthology.orchestra.run.smithi094.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:43.046 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/503 2023-10-16T11:55:43.046 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/503 2023-10-16T11:55:43.046 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:43.056 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:43.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:43.087 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-10-16T11:55:43.626 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:43.639 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:43.640 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:44.130 INFO:teuthology.orchestra.run.smithi094.stdout:generic/504 - output mismatch (see /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/504.out.bad) 2023-10-16T11:55:44.138 INFO:teuthology.orchestra.run.smithi094.stdout: --- tests/generic/504.out 2023-10-16 08:53:19.625272470 +0000 2023-10-16T11:55:44.138 INFO:teuthology.orchestra.run.smithi094.stdout: +++ /tmp/tmp.tcp0mkZMHZxfstests-dev/results//generic/504.out.bad 2023-10-16 11:55:44.124739989 +0000 2023-10-16T11:55:44.138 INFO:teuthology.orchestra.run.smithi094.stdout: @@ -1,2 +1,3 @@ 2023-10-16T11:55:44.139 INFO:teuthology.orchestra.run.smithi094.stdout: QA output created by 504 2023-10-16T11:55:44.139 INFO:teuthology.orchestra.run.smithi094.stdout: +lock info not found 2023-10-16T11:55:44.139 INFO:teuthology.orchestra.run.smithi094.stdout: Silence is golden 2023-10-16T11:55:44.146 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/504 2023-10-16T11:55:44.147 INFO:teuthology.orchestra.run.smithi094.stdout:Failures: generic/504 2023-10-16T11:55:44.147 INFO:teuthology.orchestra.run.smithi094.stdout:Failed 1 of 1 tests 2023-10-16T11:55:44.156 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:44.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T11:55:44.187 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T11:55:44.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T11:55:44.188 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-10-16T11:55:44.736 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:44.749 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:44.750 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:45.176 INFO:teuthology.orchestra.run.smithi094.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:45.190 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/505 2023-10-16T11:55:45.190 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/505 2023-10-16T11:55:45.191 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:45.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:45.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:45.234 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-10-16T11:55:45.777 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:45.789 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:45.790 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:46.238 INFO:teuthology.orchestra.run.smithi094.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:46.250 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/506 2023-10-16T11:55:46.250 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/506 2023-10-16T11:55:46.251 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:46.261 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:46.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:46.299 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-10-16T11:55:46.836 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:46.849 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:46.850 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:47.371 INFO:teuthology.orchestra.run.smithi094.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-10-16T11:55:47.384 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/507 2023-10-16T11:55:47.384 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/507 2023-10-16T11:55:47.384 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:47.394 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:47.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:47.430 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-10-16T11:55:47.949 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:47.962 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:47.962 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:48.393 INFO:teuthology.orchestra.run.smithi094.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-10-16T11:55:48.407 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/508 2023-10-16T11:55:48.407 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/508 2023-10-16T11:55:48.408 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:48.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:48.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:48.452 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-10-16T11:55:48.998 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:49.011 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:49.012 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:49.462 INFO:teuthology.orchestra.run.smithi094.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:49.476 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/509 2023-10-16T11:55:49.476 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/509 2023-10-16T11:55:49.476 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:49.488 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:49.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:49.525 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-10-16T11:55:50.064 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:50.076 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:50.077 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:50.519 INFO:teuthology.orchestra.run.smithi094.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:50.533 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/510 2023-10-16T11:55:50.533 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/510 2023-10-16T11:55:50.534 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:50.545 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:50.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:50.582 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-10-16T11:55:51.128 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:51.141 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:51.141 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:51.565 INFO:teuthology.orchestra.run.smithi094.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:51.578 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/511 2023-10-16T11:55:51.579 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/511 2023-10-16T11:55:51.579 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:51.591 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:51.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:51.622 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-10-16T11:55:52.163 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:52.176 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:52.176 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:52.705 INFO:teuthology.orchestra.run.smithi094.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:52.715 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/512 2023-10-16T11:55:52.715 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/512 2023-10-16T11:55:52.716 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:52.724 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:52.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:52.756 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-10-16T11:55:53.292 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:53.306 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:53.307 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:53.722 INFO:teuthology.orchestra.run.smithi094.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:53.734 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/513 2023-10-16T11:55:53.735 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/513 2023-10-16T11:55:53.735 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:53.746 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:53.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:53.780 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-10-16T11:55:54.327 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:54.340 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:54.340 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:54.729 INFO:teuthology.orchestra.run.smithi094.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:54.740 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/514 2023-10-16T11:55:54.740 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/514 2023-10-16T11:55:54.740 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:54.749 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:54.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:54.783 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-10-16T11:55:55.345 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:55.357 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:55.357 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:55.747 INFO:teuthology.orchestra.run.smithi094.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:55.760 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/515 2023-10-16T11:55:55.761 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/515 2023-10-16T11:55:55.761 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:55.770 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:55.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:55.800 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-10-16T11:55:56.343 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:56.357 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:56.358 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:56.947 INFO:teuthology.orchestra.run.smithi094.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T11:55:56.958 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/516 2023-10-16T11:55:56.959 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/516 2023-10-16T11:55:56.959 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:56.967 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:57.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:57.014 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-10-16T11:55:57.676 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:57.688 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:57.688 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:58.040 INFO:teuthology.orchestra.run.smithi094.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:58.051 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/517 2023-10-16T11:55:58.051 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/517 2023-10-16T11:55:58.051 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:58.061 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:58.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:58.091 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-10-16T11:55:58.617 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:58.630 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:58.631 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:59.048 INFO:teuthology.orchestra.run.smithi094.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:55:59.060 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/518 2023-10-16T11:55:59.060 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/518 2023-10-16T11:55:59.060 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:55:59.069 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:55:59.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:55:59.097 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-10-16T11:55:59.641 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:55:59.654 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:55:59.654 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:56:00.032 INFO:teuthology.orchestra.run.smithi094.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:56:00.044 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/519 2023-10-16T11:56:00.045 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/519 2023-10-16T11:56:00.045 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:56:00.055 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:56:00.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:56:00.089 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-10-16T11:56:00.623 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:56:00.636 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:56:00.636 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:56:01.132 INFO:teuthology.orchestra.run.smithi094.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T11:56:01.147 INFO:teuthology.orchestra.run.smithi094.stdout:Ran: generic/520 2023-10-16T11:56:01.147 INFO:teuthology.orchestra.run.smithi094.stdout:Not run: generic/520 2023-10-16T11:56:01.147 INFO:teuthology.orchestra.run.smithi094.stdout:Passed all 1 tests 2023-10-16T11:56:01.159 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:56:01.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T11:56:01.195 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-10-16T11:56:01.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:56:01.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:56:01.746 INFO:teuthology.orchestra.run.smithi094.stdout:FSTYP -- ceph-fuse 2023-10-16T11:56:01.758 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM -- Linux/x86_64 smithi094 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T11:56:01.758 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-16T11:56:31.876 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:56:31.885 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:57:02.023 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:57:02.033 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:57:32.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:57:32.171 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:58:02.312 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:58:02.325 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:58:32.450 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:58:32.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:59:02.922 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:59:02.933 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:59:33.065 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T11:59:33.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:00:03.232 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:00:03.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:00:33.364 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:00:33.374 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:01:03.505 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:01:03.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:01:33.658 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:01:33.669 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:02:03.797 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:02:03.807 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:02:34.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:02:34.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:03:04.182 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:03:04.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:03:34.326 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:03:34.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:04:04.465 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:04:04.475 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:04:34.615 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:04:34.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:05:04.773 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:05:04.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:05:34.911 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:05:34.920 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:06:05.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:06:05.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:06:35.232 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:06:35.243 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:07:05.645 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:07:05.655 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:07:35.782 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:07:35.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:08:05.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:08:05.922 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:08:36.043 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:08:36.054 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:08:36.161 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-16T12:08:36.158+0000 7f4b0c385640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99019) UID: 0 2023-10-16T12:08:36.161 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-16T12:08:36.158+0000 7fd244502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99019) UID: 0 2023-10-16T12:08:36.162 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-16T12:08:36.158+0000 7fbe3e350640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99019) UID: 0 2023-10-16T12:08:36.162 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-16T12:08:36.158+0000 7f2350a50640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99019) UID: 0 2023-10-16T12:11:39.829 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:11:39.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:12:10.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:12:10.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:12:40.186 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:12:40.197 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:13:10.329 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:13:10.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:13:40.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:13:40.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:14:10.601 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:14:10.611 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:14:41.101 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:14:41.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:15:11.250 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:15:11.261 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:15:41.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:15:41.404 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:16:11.532 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:16:11.542 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:16:41.671 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:16:41.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:17:11.811 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:17:11.821 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:17:41.948 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:17:41.958 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:18:12.100 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:18:12.111 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:18:42.266 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:18:42.277 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:19:12.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:19:12.409 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:19:42.538 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:19:42.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:20:12.676 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:20:12.686 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:20:42.813 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:20:42.824 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:20:45.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:20:45.333 INFO:teuthology.orchestra.run.smithi094.stdout:generic/521 2023-10-16T12:20:45.334 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T12:20:45.334 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-10-16T12:20:45.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:20:45.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:20:46.155 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-16T12:20:46.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-16T12:20:46.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-16T12:20:46.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-16T12:20:46.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-16T12:20:46.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-16T12:20:46.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-16T12:20:46.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-16T12:20:46.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-16T12:20:46.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-16T12:20:46.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-16T12:20:46.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-16T12:20:46.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-16T12:20:46.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-16T12:20:46.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-16T12:20:46.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-16T12:20:46.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-16T12:20:46.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-16T12:20:46.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:20:46.343 DEBUG:teuthology.orchestra.run.smithi094:> (cd /tmp/tmp.tcp0mkZMHZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-10-16T12:20:51.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2023-10-16T12:20:51.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2023-10-16T12:20:51.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2023-10-16T12:20:51.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2023-10-16T12:20:51.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2023-10-16T12:20:51.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2023-10-16T12:20:51.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2023-10-16T12:20:51.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2023-10-16T12:20:51.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2023-10-16T12:20:51.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2023-10-16T12:20:51.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2023-10-16T12:20:51.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~5s 2023-10-16T12:20:51.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~5s 2023-10-16T12:20:51.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~5s 2023-10-16T12:20:51.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~5s 2023-10-16T12:20:51.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~5s 2023-10-16T12:20:51.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~5s 2023-10-16T12:20:56.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2023-10-16T12:20:56.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2023-10-16T12:20:56.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2023-10-16T12:20:56.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2023-10-16T12:20:56.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2023-10-16T12:20:56.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2023-10-16T12:20:56.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2023-10-16T12:20:56.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~10s 2023-10-16T12:20:56.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2023-10-16T12:20:56.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2023-10-16T12:20:56.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~10s 2023-10-16T12:20:56.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~10s 2023-10-16T12:20:56.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~10s 2023-10-16T12:20:56.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~10s 2023-10-16T12:20:56.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~10s 2023-10-16T12:20:56.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~10s 2023-10-16T12:20:56.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~10s 2023-10-16T12:21:01.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2023-10-16T12:21:01.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2023-10-16T12:21:01.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2023-10-16T12:21:01.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2023-10-16T12:21:01.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2023-10-16T12:21:01.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2023-10-16T12:21:01.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2023-10-16T12:21:01.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~15s 2023-10-16T12:21:01.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~15s 2023-10-16T12:21:01.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2023-10-16T12:21:01.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~15s 2023-10-16T12:21:01.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~15s 2023-10-16T12:21:01.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~15s 2023-10-16T12:21:01.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~15s 2023-10-16T12:21:01.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~15s 2023-10-16T12:21:01.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~15s 2023-10-16T12:21:01.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~15s 2023-10-16T12:21:06.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-10-16T12:21:06.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2023-10-16T12:21:06.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-10-16T12:21:06.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-10-16T12:21:06.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2023-10-16T12:21:06.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-10-16T12:21:06.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2023-10-16T12:21:06.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~20s 2023-10-16T12:21:06.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2023-10-16T12:21:06.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2023-10-16T12:21:06.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~20s 2023-10-16T12:21:06.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-10-16T12:21:06.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-10-16T12:21:06.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2023-10-16T12:21:06.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-10-16T12:21:06.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~20s 2023-10-16T12:21:06.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~20s 2023-10-16T12:21:11.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2023-10-16T12:21:11.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2023-10-16T12:21:11.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2023-10-16T12:21:11.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2023-10-16T12:21:11.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2023-10-16T12:21:11.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2023-10-16T12:21:11.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2023-10-16T12:21:11.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2023-10-16T12:21:11.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2023-10-16T12:21:11.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2023-10-16T12:21:11.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2023-10-16T12:21:11.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2023-10-16T12:21:11.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2023-10-16T12:21:11.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~25s 2023-10-16T12:21:11.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~25s 2023-10-16T12:21:11.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~25s 2023-10-16T12:21:11.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~25s 2023-10-16T12:21:12.969 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:21:16.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2023-10-16T12:21:16.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2023-10-16T12:21:16.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2023-10-16T12:21:16.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2023-10-16T12:21:16.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2023-10-16T12:21:16.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2023-10-16T12:21:16.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2023-10-16T12:21:16.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~30s 2023-10-16T12:21:16.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~30s 2023-10-16T12:21:16.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~30s 2023-10-16T12:21:16.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~30s 2023-10-16T12:21:16.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~30s 2023-10-16T12:21:16.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~30s 2023-10-16T12:21:16.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~30s 2023-10-16T12:21:16.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~30s 2023-10-16T12:21:16.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~30s 2023-10-16T12:21:16.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~30s 2023-10-16T12:21:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2023-10-16T12:21:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-10-16T12:21:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2023-10-16T12:21:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2023-10-16T12:21:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2023-10-16T12:21:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2023-10-16T12:21:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2023-10-16T12:21:21.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2023-10-16T12:21:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~35s 2023-10-16T12:21:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2023-10-16T12:21:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~35s 2023-10-16T12:21:21.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~35s 2023-10-16T12:21:21.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2023-10-16T12:21:21.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~35s 2023-10-16T12:21:21.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~35s 2023-10-16T12:21:21.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~35s 2023-10-16T12:21:21.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~35s 2023-10-16T12:21:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-10-16T12:21:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2023-10-16T12:21:26.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-10-16T12:21:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-10-16T12:21:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2023-10-16T12:21:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-10-16T12:21:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2023-10-16T12:21:26.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~40s 2023-10-16T12:21:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2023-10-16T12:21:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2023-10-16T12:21:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~40s 2023-10-16T12:21:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2023-10-16T12:21:26.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-10-16T12:21:26.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~40s 2023-10-16T12:21:26.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2023-10-16T12:21:26.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~40s 2023-10-16T12:21:26.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~40s 2023-10-16T12:21:31.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2023-10-16T12:21:31.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2023-10-16T12:21:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2023-10-16T12:21:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2023-10-16T12:21:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2023-10-16T12:21:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2023-10-16T12:21:31.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2023-10-16T12:21:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~45s 2023-10-16T12:21:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~45s 2023-10-16T12:21:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2023-10-16T12:21:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~45s 2023-10-16T12:21:31.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~45s 2023-10-16T12:21:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2023-10-16T12:21:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~45s 2023-10-16T12:21:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~45s 2023-10-16T12:21:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~45s 2023-10-16T12:21:31.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~45s 2023-10-16T12:21:36.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2023-10-16T12:21:36.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2023-10-16T12:21:36.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2023-10-16T12:21:36.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2023-10-16T12:21:36.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2023-10-16T12:21:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2023-10-16T12:21:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2023-10-16T12:21:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2023-10-16T12:21:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2023-10-16T12:21:36.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2023-10-16T12:21:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~50s 2023-10-16T12:21:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2023-10-16T12:21:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~50s 2023-10-16T12:21:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~50s 2023-10-16T12:21:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~50s 2023-10-16T12:21:36.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~50s 2023-10-16T12:21:36.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~50s 2023-10-16T12:21:41.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2023-10-16T12:21:41.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2023-10-16T12:21:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2023-10-16T12:21:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2023-10-16T12:21:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2023-10-16T12:21:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2023-10-16T12:21:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2023-10-16T12:21:41.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~55s 2023-10-16T12:21:41.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~55s 2023-10-16T12:21:41.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~55s 2023-10-16T12:21:41.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~55s 2023-10-16T12:21:41.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~55s 2023-10-16T12:21:41.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2023-10-16T12:21:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~55s 2023-10-16T12:21:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~55s 2023-10-16T12:21:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~55s 2023-10-16T12:21:41.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~55s 2023-10-16T12:21:46.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2023-10-16T12:21:46.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2023-10-16T12:21:46.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-10-16T12:21:46.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-10-16T12:21:46.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2023-10-16T12:21:46.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-10-16T12:21:46.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2023-10-16T12:21:46.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~60s 2023-10-16T12:21:46.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2023-10-16T12:21:46.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~60s 2023-10-16T12:21:46.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~60s 2023-10-16T12:21:46.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~60s 2023-10-16T12:21:46.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2023-10-16T12:21:46.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~60s 2023-10-16T12:21:46.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~60s 2023-10-16T12:21:46.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~60s 2023-10-16T12:21:46.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~60s 2023-10-16T12:21:51.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2023-10-16T12:21:51.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-10-16T12:21:51.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-10-16T12:21:51.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2023-10-16T12:21:51.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2023-10-16T12:21:51.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2023-10-16T12:21:51.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2023-10-16T12:21:51.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~65s 2023-10-16T12:21:51.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~65s 2023-10-16T12:21:51.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~65s 2023-10-16T12:21:51.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~65s 2023-10-16T12:21:51.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-10-16T12:21:51.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-10-16T12:21:51.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~65s 2023-10-16T12:21:51.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~65s 2023-10-16T12:21:51.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~65s 2023-10-16T12:21:51.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~65s 2023-10-16T12:21:56.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2023-10-16T12:21:56.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2023-10-16T12:21:56.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2023-10-16T12:21:56.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2023-10-16T12:21:56.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2023-10-16T12:21:56.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2023-10-16T12:21:56.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2023-10-16T12:21:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2023-10-16T12:21:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~70s 2023-10-16T12:21:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2023-10-16T12:21:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~70s 2023-10-16T12:21:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~70s 2023-10-16T12:21:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2023-10-16T12:21:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2023-10-16T12:21:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~70s 2023-10-16T12:21:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~70s 2023-10-16T12:21:56.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~70s 2023-10-16T12:22:01.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2023-10-16T12:22:01.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2023-10-16T12:22:01.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2023-10-16T12:22:01.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2023-10-16T12:22:01.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2023-10-16T12:22:01.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~75s 2023-10-16T12:22:01.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2023-10-16T12:22:01.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~75s 2023-10-16T12:22:01.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~75s 2023-10-16T12:22:01.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~75s 2023-10-16T12:22:01.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~75s 2023-10-16T12:22:01.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~75s 2023-10-16T12:22:01.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~75s 2023-10-16T12:22:01.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~75s 2023-10-16T12:22:01.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~75s 2023-10-16T12:22:01.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~75s 2023-10-16T12:22:01.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~75s 2023-10-16T12:22:06.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2023-10-16T12:22:06.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2023-10-16T12:22:06.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~80s 2023-10-16T12:22:06.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2023-10-16T12:22:06.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~80s 2023-10-16T12:22:06.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~80s 2023-10-16T12:22:06.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~80s 2023-10-16T12:22:06.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~80s 2023-10-16T12:22:06.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~80s 2023-10-16T12:22:06.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~80s 2023-10-16T12:22:06.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~80s 2023-10-16T12:22:06.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~80s 2023-10-16T12:22:06.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~80s 2023-10-16T12:22:06.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~80s 2023-10-16T12:22:06.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~80s 2023-10-16T12:22:06.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~80s 2023-10-16T12:22:06.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~80s 2023-10-16T12:22:11.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-10-16T12:22:11.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2023-10-16T12:22:11.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~85s 2023-10-16T12:22:11.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-10-16T12:22:11.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~85s 2023-10-16T12:22:11.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~85s 2023-10-16T12:22:11.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~85s 2023-10-16T12:22:11.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~85s 2023-10-16T12:22:11.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~85s 2023-10-16T12:22:11.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~85s 2023-10-16T12:22:11.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~85s 2023-10-16T12:22:11.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2023-10-16T12:22:11.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2023-10-16T12:22:11.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~85s 2023-10-16T12:22:11.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~85s 2023-10-16T12:22:11.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~85s 2023-10-16T12:22:11.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~85s 2023-10-16T12:22:16.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2023-10-16T12:22:16.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2023-10-16T12:22:16.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~90s 2023-10-16T12:22:16.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2023-10-16T12:22:16.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~90s 2023-10-16T12:22:16.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~90s 2023-10-16T12:22:16.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~90s 2023-10-16T12:22:16.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~90s 2023-10-16T12:22:16.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~90s 2023-10-16T12:22:16.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~90s 2023-10-16T12:22:16.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~90s 2023-10-16T12:22:16.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~90s 2023-10-16T12:22:16.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~90s 2023-10-16T12:22:16.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~90s 2023-10-16T12:22:16.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~90s 2023-10-16T12:22:16.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~90s 2023-10-16T12:22:16.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~90s 2023-10-16T12:22:21.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2023-10-16T12:22:21.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2023-10-16T12:22:21.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2023-10-16T12:22:21.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2023-10-16T12:22:21.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2023-10-16T12:22:21.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~95s 2023-10-16T12:22:21.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2023-10-16T12:22:21.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~95s 2023-10-16T12:22:21.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2023-10-16T12:22:21.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2023-10-16T12:22:21.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~95s 2023-10-16T12:22:21.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~95s 2023-10-16T12:22:21.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2023-10-16T12:22:21.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~95s 2023-10-16T12:22:21.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~95s 2023-10-16T12:22:21.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~95s 2023-10-16T12:22:21.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~95s 2023-10-16T12:22:26.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2023-10-16T12:22:26.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2023-10-16T12:22:26.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2023-10-16T12:22:26.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~100s 2023-10-16T12:22:26.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~100s 2023-10-16T12:22:26.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~100s 2023-10-16T12:22:26.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~100s 2023-10-16T12:22:26.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~100s 2023-10-16T12:22:26.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~100s 2023-10-16T12:22:26.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~100s 2023-10-16T12:22:26.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~100s 2023-10-16T12:22:26.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~100s 2023-10-16T12:22:26.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2023-10-16T12:22:26.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~100s 2023-10-16T12:22:26.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~100s 2023-10-16T12:22:26.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~100s 2023-10-16T12:22:26.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~100s 2023-10-16T12:22:31.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2023-10-16T12:22:31.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2023-10-16T12:22:31.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2023-10-16T12:22:31.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2023-10-16T12:22:31.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2023-10-16T12:22:31.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-10-16T12:22:31.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2023-10-16T12:22:31.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~105s 2023-10-16T12:22:31.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~105s 2023-10-16T12:22:31.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~105s 2023-10-16T12:22:31.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~105s 2023-10-16T12:22:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~105s 2023-10-16T12:22:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~105s 2023-10-16T12:22:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~105s 2023-10-16T12:22:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~105s 2023-10-16T12:22:31.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~105s 2023-10-16T12:22:31.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~105s 2023-10-16T12:22:36.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2023-10-16T12:22:36.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2023-10-16T12:22:36.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2023-10-16T12:22:36.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2023-10-16T12:22:36.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2023-10-16T12:22:36.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2023-10-16T12:22:36.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2023-10-16T12:22:36.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~110s 2023-10-16T12:22:36.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~110s 2023-10-16T12:22:36.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~110s 2023-10-16T12:22:36.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~110s 2023-10-16T12:22:36.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~110s 2023-10-16T12:22:36.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~110s 2023-10-16T12:22:36.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~110s 2023-10-16T12:22:36.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~110s 2023-10-16T12:22:36.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~110s 2023-10-16T12:22:36.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~110s 2023-10-16T12:22:41.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~115s 2023-10-16T12:22:41.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~115s 2023-10-16T12:22:41.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~115s 2023-10-16T12:22:41.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2023-10-16T12:22:41.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~115s 2023-10-16T12:22:41.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~115s 2023-10-16T12:22:41.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~115s 2023-10-16T12:22:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~115s 2023-10-16T12:22:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~115s 2023-10-16T12:22:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~115s 2023-10-16T12:22:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~115s 2023-10-16T12:22:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~115s 2023-10-16T12:22:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~115s 2023-10-16T12:22:41.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~115s 2023-10-16T12:22:41.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~115s 2023-10-16T12:22:41.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~115s 2023-10-16T12:22:41.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~115s 2023-10-16T12:22:46.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~120s 2023-10-16T12:22:46.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2023-10-16T12:22:46.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2023-10-16T12:22:46.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2023-10-16T12:22:46.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2023-10-16T12:22:46.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~120s 2023-10-16T12:22:46.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2023-10-16T12:22:46.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~120s 2023-10-16T12:22:46.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2023-10-16T12:22:46.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2023-10-16T12:22:46.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~120s 2023-10-16T12:22:46.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~120s 2023-10-16T12:22:46.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~120s 2023-10-16T12:22:46.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~120s 2023-10-16T12:22:46.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~120s 2023-10-16T12:22:46.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~120s 2023-10-16T12:22:46.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~120s 2023-10-16T12:22:51.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~125s 2023-10-16T12:22:51.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~125s 2023-10-16T12:22:51.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2023-10-16T12:22:51.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~125s 2023-10-16T12:22:51.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~125s 2023-10-16T12:22:51.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2023-10-16T12:22:51.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~125s 2023-10-16T12:22:51.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~125s 2023-10-16T12:22:51.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~125s 2023-10-16T12:22:51.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~125s 2023-10-16T12:22:51.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~125s 2023-10-16T12:22:51.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~125s 2023-10-16T12:22:51.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2023-10-16T12:22:51.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~125s 2023-10-16T12:22:51.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~125s 2023-10-16T12:22:51.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~125s 2023-10-16T12:22:51.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~125s 2023-10-16T12:22:56.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2023-10-16T12:22:56.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2023-10-16T12:22:56.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2023-10-16T12:22:56.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2023-10-16T12:22:56.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2023-10-16T12:22:56.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~130s 2023-10-16T12:22:56.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2023-10-16T12:22:56.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~130s 2023-10-16T12:22:56.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~130s 2023-10-16T12:22:56.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~130s 2023-10-16T12:22:56.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~130s 2023-10-16T12:22:56.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2023-10-16T12:22:56.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2023-10-16T12:22:56.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~130s 2023-10-16T12:22:56.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~130s 2023-10-16T12:22:56.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~130s 2023-10-16T12:22:56.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~130s 2023-10-16T12:23:01.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2023-10-16T12:23:01.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2023-10-16T12:23:01.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2023-10-16T12:23:01.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2023-10-16T12:23:01.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~135s 2023-10-16T12:23:01.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~135s 2023-10-16T12:23:01.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~135s 2023-10-16T12:23:01.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~135s 2023-10-16T12:23:01.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~135s 2023-10-16T12:23:01.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~135s 2023-10-16T12:23:01.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~135s 2023-10-16T12:23:01.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~135s 2023-10-16T12:23:01.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~135s 2023-10-16T12:23:01.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~135s 2023-10-16T12:23:01.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~135s 2023-10-16T12:23:01.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~135s 2023-10-16T12:23:01.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~135s 2023-10-16T12:23:06.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2023-10-16T12:23:06.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2023-10-16T12:23:06.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2023-10-16T12:23:06.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2023-10-16T12:23:06.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~140s 2023-10-16T12:23:06.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~140s 2023-10-16T12:23:06.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~140s 2023-10-16T12:23:06.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~140s 2023-10-16T12:23:06.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~140s 2023-10-16T12:23:06.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~140s 2023-10-16T12:23:06.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~140s 2023-10-16T12:23:06.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~140s 2023-10-16T12:23:06.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~140s 2023-10-16T12:23:06.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~140s 2023-10-16T12:23:06.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~140s 2023-10-16T12:23:06.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~140s 2023-10-16T12:23:06.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~140s 2023-10-16T12:23:11.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-10-16T12:23:11.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2023-10-16T12:23:11.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-10-16T12:23:11.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-10-16T12:23:11.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2023-10-16T12:23:11.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-10-16T12:23:11.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2023-10-16T12:23:11.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~145s 2023-10-16T12:23:11.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2023-10-16T12:23:11.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~145s 2023-10-16T12:23:11.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~145s 2023-10-16T12:23:11.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2023-10-16T12:23:11.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2023-10-16T12:23:11.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~145s 2023-10-16T12:23:11.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~145s 2023-10-16T12:23:11.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~145s 2023-10-16T12:23:11.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~145s 2023-10-16T12:23:16.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2023-10-16T12:23:16.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2023-10-16T12:23:16.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2023-10-16T12:23:16.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2023-10-16T12:23:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~150s 2023-10-16T12:23:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~150s 2023-10-16T12:23:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~150s 2023-10-16T12:23:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~150s 2023-10-16T12:23:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~150s 2023-10-16T12:23:16.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~150s 2023-10-16T12:23:16.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~150s 2023-10-16T12:23:16.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2023-10-16T12:23:16.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2023-10-16T12:23:16.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~150s 2023-10-16T12:23:16.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~150s 2023-10-16T12:23:16.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~150s 2023-10-16T12:23:16.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~150s 2023-10-16T12:23:21.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~155s 2023-10-16T12:23:21.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~155s 2023-10-16T12:23:21.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2023-10-16T12:23:21.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2023-10-16T12:23:21.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2023-10-16T12:23:21.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~155s 2023-10-16T12:23:21.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2023-10-16T12:23:21.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~155s 2023-10-16T12:23:21.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~155s 2023-10-16T12:23:21.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~155s 2023-10-16T12:23:21.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~155s 2023-10-16T12:23:21.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~155s 2023-10-16T12:23:21.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~155s 2023-10-16T12:23:21.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~155s 2023-10-16T12:23:21.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~155s 2023-10-16T12:23:21.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~155s 2023-10-16T12:23:21.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~155s 2023-10-16T12:23:26.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2023-10-16T12:23:26.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2023-10-16T12:23:26.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2023-10-16T12:23:26.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2023-10-16T12:23:26.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~160s 2023-10-16T12:23:26.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~160s 2023-10-16T12:23:26.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~160s 2023-10-16T12:23:26.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~160s 2023-10-16T12:23:26.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~160s 2023-10-16T12:23:26.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~160s 2023-10-16T12:23:26.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~160s 2023-10-16T12:23:26.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~160s 2023-10-16T12:23:26.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~160s 2023-10-16T12:23:26.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~160s 2023-10-16T12:23:26.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~160s 2023-10-16T12:23:26.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~160s 2023-10-16T12:23:26.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~160s 2023-10-16T12:23:31.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-10-16T12:23:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2023-10-16T12:23:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2023-10-16T12:23:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-10-16T12:23:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~165s 2023-10-16T12:23:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-10-16T12:23:31.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2023-10-16T12:23:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~165s 2023-10-16T12:23:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2023-10-16T12:23:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2023-10-16T12:23:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~165s 2023-10-16T12:23:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2023-10-16T12:23:31.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2023-10-16T12:23:31.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~165s 2023-10-16T12:23:31.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2023-10-16T12:23:31.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~165s 2023-10-16T12:23:31.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~165s 2023-10-16T12:23:35.802 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-16T12:23:35.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:23:35.806 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T12:23:35.806 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-10-16T12:23:35.807 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2023-10-16T12:23:35.807 INFO:tasks.cephfs_test_runner:ERROR 2023-10-16T12:23:35.808 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.808 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T12:23:35.808 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:23:35.809 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T12:23:35.809 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.809 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T12:23:35.810 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T12:23:35.810 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T12:23:35.810 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T12:23:35.810 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T12:23:35.811 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T12:23:35.811 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T12:23:35.811 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.811 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T12:23:35.812 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.812 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.812 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-16T12:23:35.812 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-16T12:23:35.812 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-16T12:23:35.813 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-16T12:23:35.813 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-10-16T12:23:35.813 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-10-16T12:23:35.813 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-10-16T12:23:35.814 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-10-16T12:23:35.814 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-10-16T12:23:35.814 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-10-16T12:23:35.814 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-10-16T12:23:35.815 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-10-16T12:23:35.815 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T12:23:35.815 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T12:23:35.815 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T12:23:35.816 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T12:23:35.816 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo env DIFF_LENGTH=0 ./check generic/523' 2023-10-16T12:23:35.816 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.816 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T12:23:35.817 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:23:35.817 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T12:23:35.817 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.817 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T12:23:35.817 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T12:23:35.818 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T12:23:35.818 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T12:23:35.818 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T12:23:35.819 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T12:23:35.819 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T12:23:35.819 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.819 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T12:23:35.820 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.820 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.820 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-10-16T12:23:35.820 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-10-16T12:23:35.820 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-10-16T12:23:35.821 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-10-16T12:23:35.821 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T12:23:35.821 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T12:23:35.821 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T12:23:35.822 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T12:23:35.822 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo userdel --force --remove fsgqa' 2023-10-16T12:23:35.822 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.822 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T12:23:35.823 INFO:tasks.cephfs_test_runner:Ran 1 test in 12672.163s 2023-10-16T12:23:35.823 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.823 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-10-16T12:23:35.823 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.824 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T12:23:35.824 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:23:35.824 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T12:23:35.824 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.824 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T12:23:35.825 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T12:23:35.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T12:23:35.825 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T12:23:35.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T12:23:35.826 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T12:23:35.826 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T12:23:35.826 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.827 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T12:23:35.827 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.827 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.827 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-16T12:23:35.827 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-16T12:23:35.828 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-16T12:23:35.828 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-16T12:23:35.828 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-10-16T12:23:35.828 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-10-16T12:23:35.829 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-10-16T12:23:35.829 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-10-16T12:23:35.829 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-10-16T12:23:35.829 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-10-16T12:23:35.830 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-10-16T12:23:35.830 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-10-16T12:23:35.830 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T12:23:35.830 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T12:23:35.831 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T12:23:35.831 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T12:23:35.831 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo env DIFF_LENGTH=0 ./check generic/523' 2023-10-16T12:23:35.831 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.832 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T12:23:35.832 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:23:35.832 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T12:23:35.832 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.833 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T12:23:35.833 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T12:23:35.833 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T12:23:35.833 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T12:23:35.834 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T12:23:35.834 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T12:23:35.834 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T12:23:35.834 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.835 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T12:23:35.835 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.835 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T12:23:35.835 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-10-16T12:23:35.836 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-10-16T12:23:35.836 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-10-16T12:23:35.836 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-10-16T12:23:35.836 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T12:23:35.836 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T12:23:35.837 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T12:23:35.837 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T12:23:35.837 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo userdel --force --remove fsgqa' 2023-10-16T12:23:35.837 INFO:tasks.cephfs_test_runner: 2023-10-16T12:23:35.838 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:23:35.901 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b3343bbeba2a4e07a99f88a68122fdb2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T12:23:35.903 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T12:23:35.912 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-16T12:23:35.920 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-16T12:23:35.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:23:35.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:23:35.925 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2023-10-16T12:23:36.060 ERROR:teuthology.orchestra.connection:Error authenticating with smithi094.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T12:23:36.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2023-10-16T12:23:36.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2023-10-16T12:23:36.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2023-10-16T12:23:36.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2023-10-16T12:23:36.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2023-10-16T12:23:36.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2023-10-16T12:23:36.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2023-10-16T12:23:36.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~170s 2023-10-16T12:23:36.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2023-10-16T12:23:36.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~170s 2023-10-16T12:23:36.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~170s 2023-10-16T12:23:36.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2023-10-16T12:23:36.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~170s 2023-10-16T12:23:36.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~170s 2023-10-16T12:23:36.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~170s 2023-10-16T12:23:36.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~170s 2023-10-16T12:23:36.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~170s 2023-10-16T12:23:40.192 ERROR:teuthology.orchestra.connection:Error authenticating with smithi094.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T12:23:41.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2023-10-16T12:23:41.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2023-10-16T12:23:41.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~175s 2023-10-16T12:23:41.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2023-10-16T12:23:41.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~175s 2023-10-16T12:23:41.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~175s 2023-10-16T12:23:41.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~175s 2023-10-16T12:23:41.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~175s 2023-10-16T12:23:41.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~175s 2023-10-16T12:23:41.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~175s 2023-10-16T12:23:41.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~175s 2023-10-16T12:23:41.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~175s 2023-10-16T12:23:41.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~175s 2023-10-16T12:23:41.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~175s 2023-10-16T12:23:41.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~175s 2023-10-16T12:23:41.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~175s 2023-10-16T12:23:41.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~175s 2023-10-16T12:23:46.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2023-10-16T12:23:46.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2023-10-16T12:23:46.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2023-10-16T12:23:46.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2023-10-16T12:23:46.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2023-10-16T12:23:46.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~180s 2023-10-16T12:23:46.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2023-10-16T12:23:46.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~180s 2023-10-16T12:23:46.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~180s 2023-10-16T12:23:46.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~180s 2023-10-16T12:23:46.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~180s 2023-10-16T12:23:46.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~180s 2023-10-16T12:23:46.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~180s 2023-10-16T12:23:46.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~180s 2023-10-16T12:23:46.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~180s 2023-10-16T12:23:46.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~180s 2023-10-16T12:23:46.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~180s 2023-10-16T12:23:51.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-10-16T12:23:51.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~185s 2023-10-16T12:23:51.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2023-10-16T12:23:51.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-10-16T12:23:51.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~185s 2023-10-16T12:23:51.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-10-16T12:23:51.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2023-10-16T12:23:51.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~185s 2023-10-16T12:23:51.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2023-10-16T12:23:51.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~185s 2023-10-16T12:23:51.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~185s 2023-10-16T12:23:51.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2023-10-16T12:23:51.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2023-10-16T12:23:51.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~185s 2023-10-16T12:23:51.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2023-10-16T12:23:51.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~185s 2023-10-16T12:23:51.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~185s 2023-10-16T12:23:56.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~190s 2023-10-16T12:23:56.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2023-10-16T12:23:56.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2023-10-16T12:23:56.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2023-10-16T12:23:56.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~190s 2023-10-16T12:23:56.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2023-10-16T12:23:56.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~190s 2023-10-16T12:23:56.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~190s 2023-10-16T12:23:56.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~190s 2023-10-16T12:23:56.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2023-10-16T12:23:56.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~190s 2023-10-16T12:23:56.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~190s 2023-10-16T12:23:56.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~190s 2023-10-16T12:23:56.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~190s 2023-10-16T12:23:56.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~190s 2023-10-16T12:23:56.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~190s 2023-10-16T12:23:56.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~190s 2023-10-16T12:24:01.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2023-10-16T12:24:01.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2023-10-16T12:24:01.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2023-10-16T12:24:01.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2023-10-16T12:24:01.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~195s 2023-10-16T12:24:01.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~195s 2023-10-16T12:24:01.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~195s 2023-10-16T12:24:01.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~195s 2023-10-16T12:24:01.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~195s 2023-10-16T12:24:01.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~195s 2023-10-16T12:24:01.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~195s 2023-10-16T12:24:01.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2023-10-16T12:24:01.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2023-10-16T12:24:01.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~195s 2023-10-16T12:24:01.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~195s 2023-10-16T12:24:01.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~195s 2023-10-16T12:24:01.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~195s 2023-10-16T12:24:05.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:24:05.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:24:06.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~200s 2023-10-16T12:24:06.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~200s 2023-10-16T12:24:06.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2023-10-16T12:24:06.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2023-10-16T12:24:06.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~200s 2023-10-16T12:24:06.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~200s 2023-10-16T12:24:06.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~200s 2023-10-16T12:24:06.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~200s 2023-10-16T12:24:06.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~200s 2023-10-16T12:24:06.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~200s 2023-10-16T12:24:06.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~200s 2023-10-16T12:24:06.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~200s 2023-10-16T12:24:06.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~200s 2023-10-16T12:24:06.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~200s 2023-10-16T12:24:06.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~200s 2023-10-16T12:24:06.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~200s 2023-10-16T12:24:06.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~200s 2023-10-16T12:24:11.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-10-16T12:24:11.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~205s 2023-10-16T12:24:11.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2023-10-16T12:24:11.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-10-16T12:24:11.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2023-10-16T12:24:11.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-10-16T12:24:11.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2023-10-16T12:24:11.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~205s 2023-10-16T12:24:11.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2023-10-16T12:24:11.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~205s 2023-10-16T12:24:11.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~205s 2023-10-16T12:24:11.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~205s 2023-10-16T12:24:11.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-10-16T12:24:11.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~205s 2023-10-16T12:24:11.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~205s 2023-10-16T12:24:11.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~205s 2023-10-16T12:24:11.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~205s 2023-10-16T12:24:16.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~210s 2023-10-16T12:24:16.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~210s 2023-10-16T12:24:16.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2023-10-16T12:24:16.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~210s 2023-10-16T12:24:16.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~210s 2023-10-16T12:24:16.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2023-10-16T12:24:16.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~210s 2023-10-16T12:24:16.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~210s 2023-10-16T12:24:16.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~210s 2023-10-16T12:24:16.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~210s 2023-10-16T12:24:16.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~210s 2023-10-16T12:24:16.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2023-10-16T12:24:16.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~210s 2023-10-16T12:24:16.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~210s 2023-10-16T12:24:16.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~210s 2023-10-16T12:24:16.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~210s 2023-10-16T12:24:16.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~210s 2023-10-16T12:24:21.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2023-10-16T12:24:21.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2023-10-16T12:24:21.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2023-10-16T12:24:21.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2023-10-16T12:24:21.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2023-10-16T12:24:21.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~215s 2023-10-16T12:24:21.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2023-10-16T12:24:21.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~215s 2023-10-16T12:24:21.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2023-10-16T12:24:21.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2023-10-16T12:24:21.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~215s 2023-10-16T12:24:21.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2023-10-16T12:24:21.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2023-10-16T12:24:21.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~215s 2023-10-16T12:24:21.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~215s 2023-10-16T12:24:21.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~215s 2023-10-16T12:24:21.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~215s 2023-10-16T12:24:21.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-16T12:24:21.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-16T12:24:26.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2023-10-16T12:24:26.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2023-10-16T12:24:26.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2023-10-16T12:24:26.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2023-10-16T12:24:26.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~220s 2023-10-16T12:24:26.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~220s 2023-10-16T12:24:26.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~220s 2023-10-16T12:24:26.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~220s 2023-10-16T12:24:26.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~220s 2023-10-16T12:24:26.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~220s 2023-10-16T12:24:26.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~220s 2023-10-16T12:24:26.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~220s 2023-10-16T12:24:26.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2023-10-16T12:24:26.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~220s 2023-10-16T12:24:26.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~220s 2023-10-16T12:24:26.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~220s 2023-10-16T12:24:26.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~220s 2023-10-16T12:24:30.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:24:30.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:24:30.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:24:30.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:24:31.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-10-16T12:24:31.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~225s 2023-10-16T12:24:31.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2023-10-16T12:24:31.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-10-16T12:24:31.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~225s 2023-10-16T12:24:31.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-10-16T12:24:31.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~225s 2023-10-16T12:24:31.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~225s 2023-10-16T12:24:31.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2023-10-16T12:24:31.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~225s 2023-10-16T12:24:31.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~225s 2023-10-16T12:24:31.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~225s 2023-10-16T12:24:31.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-10-16T12:24:31.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~225s 2023-10-16T12:24:31.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~225s 2023-10-16T12:24:31.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~225s 2023-10-16T12:24:31.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~225s 2023-10-16T12:24:33.946 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-16T12:24:33.947 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-16T12:24:36.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~230s 2023-10-16T12:24:36.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~230s 2023-10-16T12:24:36.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2023-10-16T12:24:36.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~230s 2023-10-16T12:24:36.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2023-10-16T12:24:36.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~230s 2023-10-16T12:24:36.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2023-10-16T12:24:36.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~230s 2023-10-16T12:24:36.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~230s 2023-10-16T12:24:36.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~230s 2023-10-16T12:24:36.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~230s 2023-10-16T12:24:36.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~230s 2023-10-16T12:24:36.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~230s 2023-10-16T12:24:36.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~230s 2023-10-16T12:24:36.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~230s 2023-10-16T12:24:36.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~230s 2023-10-16T12:24:36.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~230s 2023-10-16T12:24:41.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~235s 2023-10-16T12:24:41.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2023-10-16T12:24:41.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2023-10-16T12:24:41.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~235s 2023-10-16T12:24:41.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~235s 2023-10-16T12:24:41.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~235s 2023-10-16T12:24:41.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~235s 2023-10-16T12:24:41.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~235s 2023-10-16T12:24:41.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~235s 2023-10-16T12:24:41.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~235s 2023-10-16T12:24:41.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~235s 2023-10-16T12:24:41.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~235s 2023-10-16T12:24:41.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~235s 2023-10-16T12:24:41.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~235s 2023-10-16T12:24:41.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~235s 2023-10-16T12:24:41.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~235s 2023-10-16T12:24:41.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~235s 2023-10-16T12:24:45.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:24:45.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:24:45.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:24:45.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:24:46.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~240s 2023-10-16T12:24:46.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2023-10-16T12:24:46.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2023-10-16T12:24:46.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2023-10-16T12:24:46.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2023-10-16T12:24:46.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~240s 2023-10-16T12:24:46.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2023-10-16T12:24:46.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~240s 2023-10-16T12:24:46.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2023-10-16T12:24:46.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2023-10-16T12:24:46.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~240s 2023-10-16T12:24:46.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~240s 2023-10-16T12:24:46.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2023-10-16T12:24:46.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~240s 2023-10-16T12:24:46.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~240s 2023-10-16T12:24:46.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~240s 2023-10-16T12:24:46.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~240s 2023-10-16T12:24:51.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-10-16T12:24:51.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~245s 2023-10-16T12:24:51.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-10-16T12:24:51.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-10-16T12:24:51.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~245s 2023-10-16T12:24:51.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-10-16T12:24:51.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~245s 2023-10-16T12:24:51.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~245s 2023-10-16T12:24:51.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2023-10-16T12:24:51.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~245s 2023-10-16T12:24:51.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~245s 2023-10-16T12:24:51.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~245s 2023-10-16T12:24:51.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-10-16T12:24:51.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~245s 2023-10-16T12:24:51.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~245s 2023-10-16T12:24:51.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~245s 2023-10-16T12:24:51.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~245s 2023-10-16T12:24:56.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~250s 2023-10-16T12:24:56.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2023-10-16T12:24:56.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~250s 2023-10-16T12:24:56.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2023-10-16T12:24:56.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~250s 2023-10-16T12:24:56.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~250s 2023-10-16T12:24:56.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2023-10-16T12:24:56.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~250s 2023-10-16T12:24:56.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~250s 2023-10-16T12:24:56.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~250s 2023-10-16T12:24:56.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~250s 2023-10-16T12:24:56.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~250s 2023-10-16T12:24:56.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~250s 2023-10-16T12:24:56.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~250s 2023-10-16T12:24:56.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~250s 2023-10-16T12:24:56.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~250s 2023-10-16T12:24:56.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~250s 2023-10-16T12:25:01.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2023-10-16T12:25:01.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2023-10-16T12:25:01.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2023-10-16T12:25:01.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2023-10-16T12:25:01.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2023-10-16T12:25:01.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2023-10-16T12:25:01.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2023-10-16T12:25:01.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~255s 2023-10-16T12:25:01.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~255s 2023-10-16T12:25:01.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~255s 2023-10-16T12:25:01.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~255s 2023-10-16T12:25:01.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~255s 2023-10-16T12:25:01.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~255s 2023-10-16T12:25:01.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~255s 2023-10-16T12:25:01.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~255s 2023-10-16T12:25:01.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~255s 2023-10-16T12:25:01.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~255s 2023-10-16T12:25:06.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2023-10-16T12:25:06.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2023-10-16T12:25:06.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~260s 2023-10-16T12:25:06.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2023-10-16T12:25:06.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~260s 2023-10-16T12:25:06.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~260s 2023-10-16T12:25:06.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~260s 2023-10-16T12:25:06.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~260s 2023-10-16T12:25:06.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~260s 2023-10-16T12:25:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~260s 2023-10-16T12:25:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~260s 2023-10-16T12:25:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~260s 2023-10-16T12:25:06.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~260s 2023-10-16T12:25:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~260s 2023-10-16T12:25:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~260s 2023-10-16T12:25:06.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~260s 2023-10-16T12:25:06.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~260s 2023-10-16T12:25:11.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-10-16T12:25:11.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2023-10-16T12:25:11.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2023-10-16T12:25:11.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2023-10-16T12:25:11.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2023-10-16T12:25:11.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-10-16T12:25:11.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2023-10-16T12:25:11.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~265s 2023-10-16T12:25:11.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2023-10-16T12:25:11.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~265s 2023-10-16T12:25:11.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~265s 2023-10-16T12:25:11.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~265s 2023-10-16T12:25:11.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~265s 2023-10-16T12:25:11.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~265s 2023-10-16T12:25:11.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~265s 2023-10-16T12:25:11.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~265s 2023-10-16T12:25:11.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~265s 2023-10-16T12:25:16.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2023-10-16T12:25:16.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2023-10-16T12:25:16.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2023-10-16T12:25:16.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2023-10-16T12:25:16.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~270s 2023-10-16T12:25:16.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~270s 2023-10-16T12:25:16.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2023-10-16T12:25:16.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~270s 2023-10-16T12:25:16.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~270s 2023-10-16T12:25:16.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~270s 2023-10-16T12:25:16.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~270s 2023-10-16T12:25:16.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~270s 2023-10-16T12:25:16.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2023-10-16T12:25:16.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~270s 2023-10-16T12:25:16.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~270s 2023-10-16T12:25:16.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~270s 2023-10-16T12:25:16.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~270s 2023-10-16T12:25:21.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2023-10-16T12:25:21.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2023-10-16T12:25:21.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2023-10-16T12:25:21.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2023-10-16T12:25:21.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~275s 2023-10-16T12:25:21.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2023-10-16T12:25:21.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~275s 2023-10-16T12:25:21.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~275s 2023-10-16T12:25:21.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~275s 2023-10-16T12:25:21.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~275s 2023-10-16T12:25:21.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~275s 2023-10-16T12:25:21.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~275s 2023-10-16T12:25:21.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~275s 2023-10-16T12:25:21.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~275s 2023-10-16T12:25:21.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~275s 2023-10-16T12:25:21.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~275s 2023-10-16T12:25:21.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~275s 2023-10-16T12:25:26.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~280s 2023-10-16T12:25:26.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~280s 2023-10-16T12:25:26.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~280s 2023-10-16T12:25:26.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~280s 2023-10-16T12:25:26.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~280s 2023-10-16T12:25:26.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~280s 2023-10-16T12:25:26.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~280s 2023-10-16T12:25:26.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~280s 2023-10-16T12:25:26.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~280s 2023-10-16T12:25:26.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~280s 2023-10-16T12:25:26.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~280s 2023-10-16T12:25:26.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2023-10-16T12:25:26.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2023-10-16T12:25:26.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~280s 2023-10-16T12:25:26.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~280s 2023-10-16T12:25:26.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~280s 2023-10-16T12:25:26.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~280s 2023-10-16T12:25:31.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~285s 2023-10-16T12:25:31.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~285s 2023-10-16T12:25:31.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~285s 2023-10-16T12:25:31.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~285s 2023-10-16T12:25:31.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~285s 2023-10-16T12:25:31.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~285s 2023-10-16T12:25:31.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~285s 2023-10-16T12:25:31.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~285s 2023-10-16T12:25:31.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~285s 2023-10-16T12:25:31.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2023-10-16T12:25:31.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~285s 2023-10-16T12:25:31.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~285s 2023-10-16T12:25:31.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~285s 2023-10-16T12:25:31.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~285s 2023-10-16T12:25:31.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~285s 2023-10-16T12:25:31.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~285s 2023-10-16T12:25:31.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~285s 2023-10-16T12:25:36.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~290s 2023-10-16T12:25:36.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~290s 2023-10-16T12:25:36.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2023-10-16T12:25:36.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~290s 2023-10-16T12:25:36.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~290s 2023-10-16T12:25:36.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~290s 2023-10-16T12:25:36.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~290s 2023-10-16T12:25:36.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~290s 2023-10-16T12:25:36.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~290s 2023-10-16T12:25:36.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~290s 2023-10-16T12:25:36.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~290s 2023-10-16T12:25:36.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~290s 2023-10-16T12:25:36.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~290s 2023-10-16T12:25:36.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~290s 2023-10-16T12:25:36.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~290s 2023-10-16T12:25:36.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~290s 2023-10-16T12:25:36.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~290s 2023-10-16T12:25:41.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~295s 2023-10-16T12:25:41.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~295s 2023-10-16T12:25:41.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~295s 2023-10-16T12:25:41.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~295s 2023-10-16T12:25:41.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~295s 2023-10-16T12:25:41.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~295s 2023-10-16T12:25:41.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~295s 2023-10-16T12:25:41.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~295s 2023-10-16T12:25:41.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~295s 2023-10-16T12:25:41.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~295s 2023-10-16T12:25:41.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~295s 2023-10-16T12:25:41.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~295s 2023-10-16T12:25:41.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~295s 2023-10-16T12:25:41.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~295s 2023-10-16T12:25:41.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~295s 2023-10-16T12:25:41.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~295s 2023-10-16T12:25:41.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~295s 2023-10-16T12:25:45.951 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T12:25:45.953 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T12:25:46.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~300s 2023-10-16T12:25:46.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~300s 2023-10-16T12:25:46.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~300s 2023-10-16T12:25:46.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~300s 2023-10-16T12:25:46.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~300s 2023-10-16T12:25:46.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~300s 2023-10-16T12:25:46.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~300s 2023-10-16T12:25:46.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~300s 2023-10-16T12:25:46.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~300s 2023-10-16T12:25:46.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~300s 2023-10-16T12:25:46.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~300s 2023-10-16T12:25:46.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~300s 2023-10-16T12:25:46.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~300s 2023-10-16T12:25:46.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~300s 2023-10-16T12:25:46.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~300s 2023-10-16T12:25:46.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~300s 2023-10-16T12:25:46.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~300s 2023-10-16T12:25:46.636 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-16T12:25:46.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:25:46.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:25:46.963 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-16T12:25:47.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:25:47.307 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T12:25:47.307 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:47.331 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17849 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:47.331 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi094.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-16T12:25:47.331 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T12:25:47.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:47.332 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T12:25:47.388 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T12:25:47.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:47.390 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T12:25:47.390 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:47.449 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17849 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:47.449 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi094.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-10-16T12:25:47.449 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T12:25:47.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:47.450 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T12:25:47.506 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T12:25:47.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:47.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T12:25:47.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:25:47.627 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-16T12:25:47.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-16T12:25:47.912 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T12:25:47.913 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:47.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=616 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:47.939 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi130.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-10-16T12:25:47.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T12:25:47.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:47.940 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T12:25:47.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:47.997 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T12:25:47.997 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T12:25:47.998 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:48.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=616 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:48.054 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi130.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-10-16T12:25:48.054 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T12:25:48.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:48.055 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T12:25:48.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:48.110 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T12:25:48.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:25:48.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:25:48.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:25:48.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T12:25:49.020 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-16T12:25:49.026 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-16T12:25:49.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:25:49.093 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:25:49.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-16T12:25:49.094 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T12:25:49.094 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:49.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T12:25:49.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17849 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:49.152 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-16T12:25:49.152 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:49.184 INFO:teuthology.orchestra.run.smithi130.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2023-10-16T12:25:49.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17849 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:49.211 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T12:25:49.211 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:49.225 INFO:teuthology.orchestra.run.smithi094.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2023-10-16T12:25:49.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:49.306 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T12:25:49.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=616 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:49.326 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-16T12:25:49.326 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T12:25:49.385 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=616 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T12:25:49.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:49.386 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-16T12:25:49.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:49.444 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-10-16T12:25:49.515 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-10-16T12:25:49.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:49.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:49.517 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-16T12:25:49.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T12:25:49.534 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2023-10-16T12:25:49.606 INFO:teuthology.orchestra.run.smithi094.stderr:Cannot find device "ceph-brx" 2023-10-16T12:25:49.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:49.607 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T12:25:49.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T12:25:49.617 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T12:25:49.675 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: adjust-ulimits: command not found 2023-10-16T12:25:49.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:49.677 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-16T12:25:49.685 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T12:25:49.686 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T12:25:49.686 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.689 ERROR:teuthology.misc:Saw exception from ceph.mds.a Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-10-16T12:25:49.698 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T12:25:49.698 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.699 ERROR:teuthology.misc:Saw exception from ceph.mds.c Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-10-16T12:25:49.710 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T12:25:49.710 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.711 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-10-16T12:25:49.721 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T12:25:49.721 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.722 ERROR:teuthology.misc:Saw exception from ceph.mds.d Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-10-16T12:25:49.734 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T12:25:49.734 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T12:25:49.735 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.735 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.736 ERROR:teuthology.misc:Saw exception from ceph.osd.0 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2023-10-16T12:25:49.752 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T12:25:49.753 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.754 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2023-10-16T12:25:49.768 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T12:25:49.768 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.769 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2023-10-16T12:25:49.783 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T12:25:49.784 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.785 ERROR:teuthology.misc:Saw exception from ceph.osd.3 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2023-10-16T12:25:49.799 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T12:25:49.799 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.800 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2023-10-16T12:25:49.816 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T12:25:49.817 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.818 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2023-10-16T12:25:49.872 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T12:25:49.873 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.874 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2023-10-16T12:25:49.888 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T12:25:49.888 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.889 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2023-10-16T12:25:49.903 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T12:25:49.904 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T12:25:49.904 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.906 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.906 ERROR:teuthology.misc:Saw exception from ceph.mgr.y Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-10-16T12:25:49.923 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T12:25:49.924 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.925 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-16T12:25:49.945 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T12:25:49.946 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T12:25:49.947 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.948 ERROR:teuthology.misc:Saw exception from ceph.mon.a Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi094 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2023-10-16T12:25:49.970 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T12:25:49.971 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.973 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2023-10-16T12:25:49.995 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T12:25:49.996 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T12:25:49.996 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T12:25:49.997 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi130 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2023-10-16T12:25:50.034 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T12:25:50.037 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-16T12:25:50.068 INFO:teuthology.orchestra.run.smithi094.stderr:grep: /var/log/ceph/ceph.log: No such file or directory 2023-10-16T12:25:50.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T12:25:50.070 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T12:25:50.380 INFO:teuthology.orchestra.run.smithi094.stderr:umount: /var/lib/ceph/osd/ceph-0: no mount point specified. 2023-10-16T12:25:50.381 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T12:25:50.382 DEBUG:teuthology.orchestra.run.smithi094:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-10-16T12:25:50.497 INFO:teuthology.orchestra.run.smithi094.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-10-16T12:25:50.497 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.497 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.498 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-16T12:25:50.498 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.498 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:50.499 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T12:25:50.499 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.499 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.500 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T12:25:50.500 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T12:25:50.500 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:50.500 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.501 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:50.501 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.501 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.501 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.502 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.502 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.502 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.503 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.503 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.503 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.503 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.504 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T12:25:50.504 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:50.504 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.504 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.505 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.505 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.505 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T12:25:50.506 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:50.506 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:50.506 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.506 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.507 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:50.507 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.507 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T12:25:50.507 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.508 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T12:25:50.508 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T12:25:50.508 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.508 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.509 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.509 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 3w CHR 1,11 0t0 2057 /dev/kmsg 2023-10-16T12:25:50.509 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.509 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 5u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:50.510 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2023-10-16T12:25:50.510 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 7u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:50.510 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 8u netlink 0t0 1593 KOBJECT_UEVENT 2023-10-16T12:25:50.511 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 9u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.511 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.511 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 11u netlink 0t0 489 AUDIT 2023-10-16T12:25:50.511 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 12r REG 0,5 0 2210 /proc/1/mountinfo 2023-10-16T12:25:50.512 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 13r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.512 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 14r REG 0,5 0 4026532074 /proc/swaps 2023-10-16T12:25:50.512 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 15u unix 0xffff9dd16404f980 0t0 1594 /run/systemd/private type=STREAM 2023-10-16T12:25:50.512 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 16u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:50.513 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 18u unix 0xffff9dd1633a3a80 0t0 2212 /run/systemd/notify type=DGRAM 2023-10-16T12:25:50.513 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 19r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.513 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 23u unix 0xffff9dcc0bf40900 0t0 32793 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.513 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 24u netlink 0t0 16080 KOBJECT_UEVENT 2023-10-16T12:25:50.514 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 25u unix 0xffff9dd1633a2880 0t0 2214 /run/systemd/cgroups-agent type=DGRAM 2023-10-16T12:25:50.514 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 26u unix 0xffff9dd1633a5e80 0t0 2216 type=DGRAM 2023-10-16T12:25:50.514 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 27u unix 0xffff9dd161da7980 0t0 16081 /run/systemd/coredump type=SEQPACKET 2023-10-16T12:25:50.515 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 28u unix 0xffff9dd1633a7980 0t0 2217 type=DGRAM 2023-10-16T12:25:50.515 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 29u unix 0xffff9dd161da5100 0t0 16089 /run/lvm/lvmpolld.socket type=STREAM 2023-10-16T12:25:50.515 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 30u unix 0xffff9dd161da0480 0t0 16092 /run/rpcbind.sock type=STREAM 2023-10-16T12:25:50.516 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 31u IPv4 16095 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T12:25:50.516 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 32u unix 0xffff9dd1633ad580 0t0 16419 /run/systemd/journal/dev-log type=DGRAM 2023-10-16T12:25:50.516 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 33u unix 0xffff9dd1633abf00 0t0 16399 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.516 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 34u unix 0xffff9dd1633ac800 0t0 16403 /run/systemd/journal/socket type=DGRAM 2023-10-16T12:25:50.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 35u IPv4 16096 0t0 UDP *:sunrpc 2023-10-16T12:25:50.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 36u IPv6 16097 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T12:25:50.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 37u IPv6 16098 0t0 UDP *:sunrpc 2023-10-16T12:25:50.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 38r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 39u FIFO 0,24 0t0 17828 /run/dmeventd-server 2023-10-16T12:25:50.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 40u FIFO 0,24 0t0 17829 /run/dmeventd-client 2023-10-16T12:25:50.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 41u unix 0xffff9dd1626e6c00 0t0 17833 /run/udev/control type=SEQPACKET 2023-10-16T12:25:50.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 42u FIFO 0,24 0t0 17843 /run/initctl 2023-10-16T12:25:50.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 43r CHR 10,235 0t0 2154 /dev/autofs 2023-10-16T12:25:50.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 44r FIFO 0,13 0t0 17849 pipe 2023-10-16T12:25:50.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 45u unix 0xffff9dd1626e2d00 0t0 17851 type=DGRAM 2023-10-16T12:25:50.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 46u unix 0xffff9dd16262da00 0t0 17895 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 47u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:50.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 49u unix 0xffff9dcc51060900 0t0 21018 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 50u unix 0xffff9dd161d84c80 0t0 21961 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2023-10-16T12:25:50.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 51u netlink 0t0 17888 SELINUX 2023-10-16T12:25:50.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 52u unix 0xffff9dd164048480 0t0 1925 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:50.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 53u unix 0xffff9dd16404f080 0t0 1930 /run/avahi-daemon/socket type=STREAM 2023-10-16T12:25:50.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 54u unix 0xffff9dd164049680 0t0 1934 /var/run/cups/cups.sock type=STREAM 2023-10-16T12:25:50.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 55u unix 0xffff9dd16262de80 0t0 19251 type=STREAM 2023-10-16T12:25:50.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 56u unix 0xffff9dd1633a8d80 0t0 22585 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 58u unix 0xffff9dcc51061200 0t0 22073 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 60u unix 0xffff9dcc51061b00 0t0 3057 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 61u unix 0xffff9dd1633ad100 0t0 3059 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 62u unix 0xffff9dd1633af080 0t0 3061 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 63u unix 0xffff9dd1633a2d00 0t0 19256 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 64u unix 0xffff9dd164049f80 0t0 24612 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 65u unix 0xffff9dcc51063600 0t0 22077 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 67u unix 0xffff9dcc51064c80 0t0 22079 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 68u unix 0xffff9dd1633ac380 0t0 22587 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 69u unix 0xffff9dd1633ada00 0t0 22589 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 73u unix 0xffff9dd161da3f00 0t0 18209 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 76u unix 0xffff9dd1626e0900 0t0 25170 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 77u unix 0xffff9dd161da7080 0t0 20289 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.526 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1 root 78u unix 0xffff9dd161d80900 0t0 20291 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.526 INFO:teuthology.orchestra.run.smithi094.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.526 INFO:teuthology.orchestra.run.smithi094.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.526 INFO:teuthology.orchestra.run.smithi094.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-10-16T12:25:50.527 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.527 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.527 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-10-16T12:25:50.527 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-10-16T12:25:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 5 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 5 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.529 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 5 root txt unknown /proc/5/exe 2023-10-16T12:25:50.529 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.529 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.529 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-10-16T12:25:50.530 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.530 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.530 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-10-16T12:25:50.531 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 8 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.531 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 8 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.531 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 8 root txt unknown /proc/8/exe 2023-10-16T12:25:50.531 INFO:teuthology.orchestra.run.smithi094.stdout:mm_percpu 9 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.532 INFO:teuthology.orchestra.run.smithi094.stdout:mm_percpu 9 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.532 INFO:teuthology.orchestra.run.smithi094.stdout:mm_percpu 9 root txt unknown /proc/9/exe 2023-10-16T12:25:50.532 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_tasks 10 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.532 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_tasks 10 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.533 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_tasks 10 root txt unknown /proc/10/exe 2023-10-16T12:25:50.533 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.533 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.533 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-10-16T12:25:50.534 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 12 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.534 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 12 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.534 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 12 root txt unknown /proc/12/exe 2023-10-16T12:25:50.534 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_sched 13 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.535 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_sched 13 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.535 INFO:teuthology.orchestra.run.smithi094.stdout:rcu_sched 13 root txt unknown /proc/13/exe 2023-10-16T12:25:50.535 INFO:teuthology.orchestra.run.smithi094.stdout:migration 14 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.536 INFO:teuthology.orchestra.run.smithi094.stdout:migration 14 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.536 INFO:teuthology.orchestra.run.smithi094.stdout:migration 14 root txt unknown /proc/14/exe 2023-10-16T12:25:50.536 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 15 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.536 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 15 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.537 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 15 root txt unknown /proc/15/exe 2023-10-16T12:25:50.537 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/0 16 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.537 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/0 16 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.537 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/0 16 root txt unknown /proc/16/exe 2023-10-16T12:25:50.538 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/1 17 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.538 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/1 17 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.538 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/1 17 root txt unknown /proc/17/exe 2023-10-16T12:25:50.539 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 18 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.539 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 18 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.539 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 18 root txt unknown /proc/18/exe 2023-10-16T12:25:50.539 INFO:teuthology.orchestra.run.smithi094.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.540 INFO:teuthology.orchestra.run.smithi094.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.540 INFO:teuthology.orchestra.run.smithi094.stdout:migration 19 root txt unknown /proc/19/exe 2023-10-16T12:25:50.540 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 20 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.541 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 20 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.541 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 20 root txt unknown /proc/20/exe 2023-10-16T12:25:50.541 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 21 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.541 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 21 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.542 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 21 root txt unknown /proc/21/exe 2023-10-16T12:25:50.542 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 22 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.542 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 22 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.543 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 22 root txt unknown /proc/22/exe 2023-10-16T12:25:50.543 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/2 23 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.543 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/2 23 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.543 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/2 23 root txt unknown /proc/23/exe 2023-10-16T12:25:50.544 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 24 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.544 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 24 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.544 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 24 root txt unknown /proc/24/exe 2023-10-16T12:25:50.544 INFO:teuthology.orchestra.run.smithi094.stdout:migration 25 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.545 INFO:teuthology.orchestra.run.smithi094.stdout:migration 25 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.545 INFO:teuthology.orchestra.run.smithi094.stdout:migration 25 root txt unknown /proc/25/exe 2023-10-16T12:25:50.545 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 26 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.545 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 26 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 26 root txt unknown /proc/26/exe 2023-10-16T12:25:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 27 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.546 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 27 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 27 root txt unknown /proc/27/exe 2023-10-16T12:25:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 28 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 28 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.547 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 28 root txt unknown /proc/28/exe 2023-10-16T12:25:50.548 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/3 29 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.548 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/3 29 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.548 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/3 29 root txt unknown /proc/29/exe 2023-10-16T12:25:50.548 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 30 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.549 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 30 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.549 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 30 root txt unknown /proc/30/exe 2023-10-16T12:25:50.549 INFO:teuthology.orchestra.run.smithi094.stdout:migration 31 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.550 INFO:teuthology.orchestra.run.smithi094.stdout:migration 31 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.550 INFO:teuthology.orchestra.run.smithi094.stdout:migration 31 root txt unknown /proc/31/exe 2023-10-16T12:25:50.550 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 32 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.550 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 32 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.551 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 32 root txt unknown /proc/32/exe 2023-10-16T12:25:50.551 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 33 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.551 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 33 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.551 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 33 root txt unknown /proc/33/exe 2023-10-16T12:25:50.552 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 34 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.552 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 34 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.552 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 34 root txt unknown /proc/34/exe 2023-10-16T12:25:50.552 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/4 35 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.553 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/4 35 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.553 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/4 35 root txt unknown /proc/35/exe 2023-10-16T12:25:50.553 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 36 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.553 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 36 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.554 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 36 root txt unknown /proc/36/exe 2023-10-16T12:25:50.554 INFO:teuthology.orchestra.run.smithi094.stdout:migration 37 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.554 INFO:teuthology.orchestra.run.smithi094.stdout:migration 37 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.555 INFO:teuthology.orchestra.run.smithi094.stdout:migration 37 root txt unknown /proc/37/exe 2023-10-16T12:25:50.555 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 38 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.555 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 38 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.555 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 38 root txt unknown /proc/38/exe 2023-10-16T12:25:50.556 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 39 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.556 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 39 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.556 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 39 root txt unknown /proc/39/exe 2023-10-16T12:25:50.556 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.557 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.557 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 40 root txt unknown /proc/40/exe 2023-10-16T12:25:50.557 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/5 41 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.557 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/5 41 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.558 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/5 41 root txt unknown /proc/41/exe 2023-10-16T12:25:50.558 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 42 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.558 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 42 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.559 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 42 root txt unknown /proc/42/exe 2023-10-16T12:25:50.559 INFO:teuthology.orchestra.run.smithi094.stdout:migration 43 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.559 INFO:teuthology.orchestra.run.smithi094.stdout:migration 43 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.559 INFO:teuthology.orchestra.run.smithi094.stdout:migration 43 root txt unknown /proc/43/exe 2023-10-16T12:25:50.560 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 44 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.560 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 44 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.560 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 44 root txt unknown /proc/44/exe 2023-10-16T12:25:50.561 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 45 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.561 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 45 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.561 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 45 root txt unknown /proc/45/exe 2023-10-16T12:25:50.561 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 46 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.562 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 46 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.562 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 46 root txt unknown /proc/46/exe 2023-10-16T12:25:50.562 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/6 47 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.562 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/6 47 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.563 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/6 47 root txt unknown /proc/47/exe 2023-10-16T12:25:50.563 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 48 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.563 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 48 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.563 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 48 root txt unknown /proc/48/exe 2023-10-16T12:25:50.564 INFO:teuthology.orchestra.run.smithi094.stdout:migration 49 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.564 INFO:teuthology.orchestra.run.smithi094.stdout:migration 49 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.564 INFO:teuthology.orchestra.run.smithi094.stdout:migration 49 root txt unknown /proc/49/exe 2023-10-16T12:25:50.564 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 50 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.565 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 50 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.565 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 50 root txt unknown /proc/50/exe 2023-10-16T12:25:50.565 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 51 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.565 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 51 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.566 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 51 root txt unknown /proc/51/exe 2023-10-16T12:25:50.566 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 52 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.566 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 52 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.567 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 52 root txt unknown /proc/52/exe 2023-10-16T12:25:50.567 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/7 53 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.567 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/7 53 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.567 INFO:teuthology.orchestra.run.smithi094.stdout:cpuhp/7 53 root txt unknown /proc/53/exe 2023-10-16T12:25:50.568 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 54 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.568 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 54 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.568 INFO:teuthology.orchestra.run.smithi094.stdout:watchdog/ 54 root txt unknown /proc/54/exe 2023-10-16T12:25:50.568 INFO:teuthology.orchestra.run.smithi094.stdout:migration 55 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.569 INFO:teuthology.orchestra.run.smithi094.stdout:migration 55 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.569 INFO:teuthology.orchestra.run.smithi094.stdout:migration 55 root txt unknown /proc/55/exe 2023-10-16T12:25:50.569 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 56 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.569 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 56 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.570 INFO:teuthology.orchestra.run.smithi094.stdout:ksoftirqd 56 root txt unknown /proc/56/exe 2023-10-16T12:25:50.570 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 57 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.570 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 57 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.571 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 57 root txt unknown /proc/57/exe 2023-10-16T12:25:50.571 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 58 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.571 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 58 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.571 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 58 root txt unknown /proc/58/exe 2023-10-16T12:25:50.572 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 60 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.572 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 60 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.572 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 60 root txt unknown /proc/60/exe 2023-10-16T12:25:50.572 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 61 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.573 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 61 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.573 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 61 root txt unknown /proc/61/exe 2023-10-16T12:25:50.573 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 62 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.573 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 62 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.574 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 62 root txt unknown /proc/62/exe 2023-10-16T12:25:50.574 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 63 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.574 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 63 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.575 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 63 root txt unknown /proc/63/exe 2023-10-16T12:25:50.575 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 64 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.575 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 64 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.575 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 64 root txt unknown /proc/64/exe 2023-10-16T12:25:50.576 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.576 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.576 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-10-16T12:25:50.576 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.577 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.577 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-10-16T12:25:50.577 INFO:teuthology.orchestra.run.smithi094.stdout:kdevtmpfs 67 root cwd DIR 0,6 3380 3 / 2023-10-16T12:25:50.577 INFO:teuthology.orchestra.run.smithi094.stdout:kdevtmpfs 67 root rtd DIR 0,6 3380 3 / 2023-10-16T12:25:50.578 INFO:teuthology.orchestra.run.smithi094.stdout:kdevtmpfs 67 root txt unknown /proc/67/exe 2023-10-16T12:25:50.578 INFO:teuthology.orchestra.run.smithi094.stdout:netns 68 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.578 INFO:teuthology.orchestra.run.smithi094.stdout:netns 68 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.579 INFO:teuthology.orchestra.run.smithi094.stdout:netns 68 root txt unknown /proc/68/exe 2023-10-16T12:25:50.579 INFO:teuthology.orchestra.run.smithi094.stdout:kauditd 69 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.579 INFO:teuthology.orchestra.run.smithi094.stdout:kauditd 69 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.579 INFO:teuthology.orchestra.run.smithi094.stdout:kauditd 69 root txt unknown /proc/69/exe 2023-10-16T12:25:50.580 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 70 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.580 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 70 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.580 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 70 root txt unknown /proc/70/exe 2023-10-16T12:25:50.580 INFO:teuthology.orchestra.run.smithi094.stdout:khungtask 71 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.581 INFO:teuthology.orchestra.run.smithi094.stdout:khungtask 71 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.581 INFO:teuthology.orchestra.run.smithi094.stdout:khungtask 71 root txt unknown /proc/71/exe 2023-10-16T12:25:50.581 INFO:teuthology.orchestra.run.smithi094.stdout:oom_reape 72 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.582 INFO:teuthology.orchestra.run.smithi094.stdout:oom_reape 72 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.582 INFO:teuthology.orchestra.run.smithi094.stdout:oom_reape 72 root txt unknown /proc/72/exe 2023-10-16T12:25:50.582 INFO:teuthology.orchestra.run.smithi094.stdout:writeback 73 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.582 INFO:teuthology.orchestra.run.smithi094.stdout:writeback 73 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.583 INFO:teuthology.orchestra.run.smithi094.stdout:writeback 73 root txt unknown /proc/73/exe 2023-10-16T12:25:50.583 INFO:teuthology.orchestra.run.smithi094.stdout:kcompactd 74 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.583 INFO:teuthology.orchestra.run.smithi094.stdout:kcompactd 74 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.583 INFO:teuthology.orchestra.run.smithi094.stdout:kcompactd 74 root txt unknown /proc/74/exe 2023-10-16T12:25:50.584 INFO:teuthology.orchestra.run.smithi094.stdout:ksmd 75 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.584 INFO:teuthology.orchestra.run.smithi094.stdout:ksmd 75 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.584 INFO:teuthology.orchestra.run.smithi094.stdout:ksmd 75 root txt unknown /proc/75/exe 2023-10-16T12:25:50.584 INFO:teuthology.orchestra.run.smithi094.stdout:khugepage 76 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.585 INFO:teuthology.orchestra.run.smithi094.stdout:khugepage 76 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.585 INFO:teuthology.orchestra.run.smithi094.stdout:khugepage 76 root txt unknown /proc/76/exe 2023-10-16T12:25:50.585 INFO:teuthology.orchestra.run.smithi094.stdout:crypto 77 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.585 INFO:teuthology.orchestra.run.smithi094.stdout:crypto 77 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.586 INFO:teuthology.orchestra.run.smithi094.stdout:crypto 77 root txt unknown /proc/77/exe 2023-10-16T12:25:50.586 INFO:teuthology.orchestra.run.smithi094.stdout:kintegrit 78 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.586 INFO:teuthology.orchestra.run.smithi094.stdout:kintegrit 78 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.587 INFO:teuthology.orchestra.run.smithi094.stdout:kintegrit 78 root txt unknown /proc/78/exe 2023-10-16T12:25:50.587 INFO:teuthology.orchestra.run.smithi094.stdout:kblockd 79 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.587 INFO:teuthology.orchestra.run.smithi094.stdout:kblockd 79 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.587 INFO:teuthology.orchestra.run.smithi094.stdout:kblockd 79 root txt unknown /proc/79/exe 2023-10-16T12:25:50.588 INFO:teuthology.orchestra.run.smithi094.stdout:blkcg_pun 80 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.588 INFO:teuthology.orchestra.run.smithi094.stdout:blkcg_pun 80 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.588 INFO:teuthology.orchestra.run.smithi094.stdout:blkcg_pun 80 root txt unknown /proc/80/exe 2023-10-16T12:25:50.588 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 81 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.589 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 81 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.589 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 81 root txt unknown /proc/81/exe 2023-10-16T12:25:50.589 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 82 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.589 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 82 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.590 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 82 root txt unknown /proc/82/exe 2023-10-16T12:25:50.590 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 83 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.590 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 83 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.590 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 83 root txt unknown /proc/83/exe 2023-10-16T12:25:50.591 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 84 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.591 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 84 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.591 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 84 root txt unknown /proc/84/exe 2023-10-16T12:25:50.591 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 85 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.592 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 85 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.592 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 85 root txt unknown /proc/85/exe 2023-10-16T12:25:50.592 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 86 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.593 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 86 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.593 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 86 root txt unknown /proc/86/exe 2023-10-16T12:25:50.593 INFO:teuthology.orchestra.run.smithi094.stdout:tpm_dev_w 87 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.593 INFO:teuthology.orchestra.run.smithi094.stdout:tpm_dev_w 87 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.594 INFO:teuthology.orchestra.run.smithi094.stdout:tpm_dev_w 87 root txt unknown /proc/87/exe 2023-10-16T12:25:50.594 INFO:teuthology.orchestra.run.smithi094.stdout:md 88 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.594 INFO:teuthology.orchestra.run.smithi094.stdout:md 88 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.595 INFO:teuthology.orchestra.run.smithi094.stdout:md 88 root txt unknown /proc/88/exe 2023-10-16T12:25:50.595 INFO:teuthology.orchestra.run.smithi094.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.595 INFO:teuthology.orchestra.run.smithi094.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.595 INFO:teuthology.orchestra.run.smithi094.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-10-16T12:25:50.596 INFO:teuthology.orchestra.run.smithi094.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.596 INFO:teuthology.orchestra.run.smithi094.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.596 INFO:teuthology.orchestra.run.smithi094.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-10-16T12:25:50.596 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 91 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.597 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 91 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.597 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 91 root txt unknown /proc/91/exe 2023-10-16T12:25:50.597 INFO:teuthology.orchestra.run.smithi094.stdout:kswapd0 124 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.597 INFO:teuthology.orchestra.run.smithi094.stdout:kswapd0 124 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.598 INFO:teuthology.orchestra.run.smithi094.stdout:kswapd0 124 root txt unknown /proc/124/exe 2023-10-16T12:25:50.598 INFO:teuthology.orchestra.run.smithi094.stdout:kthrotld 226 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.598 INFO:teuthology.orchestra.run.smithi094.stdout:kthrotld 226 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.599 INFO:teuthology.orchestra.run.smithi094.stdout:kthrotld 226 root txt unknown /proc/226/exe 2023-10-16T12:25:50.599 INFO:teuthology.orchestra.run.smithi094.stdout:acpi_ther 227 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.599 INFO:teuthology.orchestra.run.smithi094.stdout:acpi_ther 227 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.599 INFO:teuthology.orchestra.run.smithi094.stdout:acpi_ther 227 root txt unknown /proc/227/exe 2023-10-16T12:25:50.600 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 228 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.600 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 228 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.600 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 228 root txt unknown /proc/228/exe 2023-10-16T12:25:50.600 INFO:teuthology.orchestra.run.smithi094.stdout:kmpath_rd 229 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.601 INFO:teuthology.orchestra.run.smithi094.stdout:kmpath_rd 229 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.601 INFO:teuthology.orchestra.run.smithi094.stdout:kmpath_rd 229 root txt unknown /proc/229/exe 2023-10-16T12:25:50.601 INFO:teuthology.orchestra.run.smithi094.stdout:kaluad 230 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.601 INFO:teuthology.orchestra.run.smithi094.stdout:kaluad 230 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.602 INFO:teuthology.orchestra.run.smithi094.stdout:kaluad 230 root txt unknown /proc/230/exe 2023-10-16T12:25:50.602 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 231 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.602 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 231 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.602 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 231 root txt unknown /proc/231/exe 2023-10-16T12:25:50.603 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 232 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.603 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 232 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.603 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 232 root txt unknown /proc/232/exe 2023-10-16T12:25:50.603 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 233 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.604 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 233 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.604 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 233 root txt unknown /proc/233/exe 2023-10-16T12:25:50.604 INFO:teuthology.orchestra.run.smithi094.stdout:ipv6_addr 234 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.604 INFO:teuthology.orchestra.run.smithi094.stdout:ipv6_addr 234 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.605 INFO:teuthology.orchestra.run.smithi094.stdout:ipv6_addr 234 root txt unknown /proc/234/exe 2023-10-16T12:25:50.605 INFO:teuthology.orchestra.run.smithi094.stdout:kstrp 235 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.605 INFO:teuthology.orchestra.run.smithi094.stdout:kstrp 235 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.605 INFO:teuthology.orchestra.run.smithi094.stdout:kstrp 235 root txt unknown /proc/235/exe 2023-10-16T12:25:50.606 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 236 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.606 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 236 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.606 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/4 236 root txt unknown /proc/236/exe 2023-10-16T12:25:50.607 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 316 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.607 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 316 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.607 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 316 root txt unknown /proc/316/exe 2023-10-16T12:25:50.607 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 348 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.608 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 348 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.608 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 348 root txt unknown /proc/348/exe 2023-10-16T12:25:50.608 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 349 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.608 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 349 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.609 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 349 root txt unknown /proc/349/exe 2023-10-16T12:25:50.609 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 351 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.609 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 351 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.609 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/0 351 root txt unknown /proc/351/exe 2023-10-16T12:25:50.610 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 353 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.610 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 353 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.610 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 353 root txt unknown /proc/353/exe 2023-10-16T12:25:50.611 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 355 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.611 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 355 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.611 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 355 root txt unknown /proc/355/exe 2023-10-16T12:25:50.611 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 371 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.612 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 371 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.612 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 371 root txt unknown /proc/371/exe 2023-10-16T12:25:50.612 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 380 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.612 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 380 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.613 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 380 root txt unknown /proc/380/exe 2023-10-16T12:25:50.613 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 382 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.613 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 382 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.613 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 382 root txt unknown /proc/382/exe 2023-10-16T12:25:50.614 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 383 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.614 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 383 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.614 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/7 383 root txt unknown /proc/383/exe 2023-10-16T12:25:50.615 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 493 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.615 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 493 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.615 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 493 root txt unknown /proc/493/exe 2023-10-16T12:25:50.615 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-wq 495 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.616 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-wq 495 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.616 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-wq 495 root txt unknown /proc/495/exe 2023-10-16T12:25:50.616 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-rese 496 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.617 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-rese 496 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.617 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-rese 496 root txt unknown /proc/496/exe 2023-10-16T12:25:50.617 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-dele 497 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.617 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-dele 497 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.618 INFO:teuthology.orchestra.run.smithi094.stdout:nvme-dele 497 root txt unknown /proc/497/exe 2023-10-16T12:25:50.618 INFO:teuthology.orchestra.run.smithi094.stdout:ata_sff 505 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.618 INFO:teuthology.orchestra.run.smithi094.stdout:ata_sff 505 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.619 INFO:teuthology.orchestra.run.smithi094.stdout:ata_sff 505 root txt unknown /proc/505/exe 2023-10-16T12:25:50.619 INFO:teuthology.orchestra.run.smithi094.stdout:ixgbe 508 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.619 INFO:teuthology.orchestra.run.smithi094.stdout:ixgbe 508 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.619 INFO:teuthology.orchestra.run.smithi094.stdout:ixgbe 508 root txt unknown /proc/508/exe 2023-10-16T12:25:50.620 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_0 512 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.620 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_0 512 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.620 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_0 512 root txt unknown /proc/512/exe 2023-10-16T12:25:50.621 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 513 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.621 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 513 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.621 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 513 root txt unknown /proc/513/exe 2023-10-16T12:25:50.621 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_1 514 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.622 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_1 514 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.622 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_1 514 root txt unknown /proc/514/exe 2023-10-16T12:25:50.622 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 515 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.623 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 515 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.623 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 515 root txt unknown /proc/515/exe 2023-10-16T12:25:50.623 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_2 518 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.623 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_2 518 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.624 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_2 518 root txt unknown /proc/518/exe 2023-10-16T12:25:50.624 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 519 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.624 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 519 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.625 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 519 root txt unknown /proc/519/exe 2023-10-16T12:25:50.625 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_3 520 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.625 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_3 520 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.625 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_3 520 root txt unknown /proc/520/exe 2023-10-16T12:25:50.626 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 521 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.626 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 521 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.626 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 521 root txt unknown /proc/521/exe 2023-10-16T12:25:50.627 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_4 522 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.627 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_4 522 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.627 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_4 522 root txt unknown /proc/522/exe 2023-10-16T12:25:50.627 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 523 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.628 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 523 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.628 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 523 root txt unknown /proc/523/exe 2023-10-16T12:25:50.628 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_5 524 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.628 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_5 524 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.629 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_5 524 root txt unknown /proc/524/exe 2023-10-16T12:25:50.629 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 525 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.629 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 525 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.630 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 525 root txt unknown /proc/525/exe 2023-10-16T12:25:50.630 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_6 526 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.630 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_6 526 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.630 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_6 526 root txt unknown /proc/526/exe 2023-10-16T12:25:50.631 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 527 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.631 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 527 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.631 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 527 root txt unknown /proc/527/exe 2023-10-16T12:25:50.631 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_7 528 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.632 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_7 528 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.632 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_7 528 root txt unknown /proc/528/exe 2023-10-16T12:25:50.632 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 529 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.632 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 529 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.633 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 529 root txt unknown /proc/529/exe 2023-10-16T12:25:50.633 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_8 530 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.633 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_8 530 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.633 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_8 530 root txt unknown /proc/530/exe 2023-10-16T12:25:50.634 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 531 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.634 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 531 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.634 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 531 root txt unknown /proc/531/exe 2023-10-16T12:25:50.635 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_9 532 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.635 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_9 532 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.635 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_eh_9 532 root txt unknown /proc/532/exe 2023-10-16T12:25:50.635 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 533 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.636 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 533 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.636 INFO:teuthology.orchestra.run.smithi094.stdout:scsi_tmf_ 533 root txt unknown /proc/533/exe 2023-10-16T12:25:50.636 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 534 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.636 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 534 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.637 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 534 root txt unknown /proc/534/exe 2023-10-16T12:25:50.637 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 535 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.637 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 535 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.637 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 535 root txt unknown /proc/535/exe 2023-10-16T12:25:50.638 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 536 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.638 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 536 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.638 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 536 root txt unknown /proc/536/exe 2023-10-16T12:25:50.638 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 545 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.639 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 545 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.639 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 545 root txt unknown /proc/545/exe 2023-10-16T12:25:50.639 INFO:teuthology.orchestra.run.smithi094.stdout:jbd2/sda1 562 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.640 INFO:teuthology.orchestra.run.smithi094.stdout:jbd2/sda1 562 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.640 INFO:teuthology.orchestra.run.smithi094.stdout:jbd2/sda1 562 root txt unknown /proc/562/exe 2023-10-16T12:25:50.640 INFO:teuthology.orchestra.run.smithi094.stdout:ext4-rsv- 563 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.640 INFO:teuthology.orchestra.run.smithi094.stdout:ext4-rsv- 563 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.641 INFO:teuthology.orchestra.run.smithi094.stdout:ext4-rsv- 563 root txt unknown /proc/563/exe 2023-10-16T12:25:50.641 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.641 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.641 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root txt REG 8,1 153992 8126 /usr/lib/systemd/systemd-journald 2023-10-16T12:25:50.642 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:50.642 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.642 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.643 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:50.643 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T12:25:50.643 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.643 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.644 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T12:25:50.644 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.644 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:50.644 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T12:25:50.645 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.645 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:50.645 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.645 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.646 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.646 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.646 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.647 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.647 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.647 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:50.647 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.648 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T12:25:50.648 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:50.648 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.648 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.649 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.649 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.649 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.649 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.650 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T12:25:50.650 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.650 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root mem REG 0,24 8 15075 /run/systemd/journal/kernel-seqnum 2023-10-16T12:25:50.653 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.653 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 1w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.654 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 2w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.654 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 3u unix 0xffff9dd1633ad580 0t0 16419 /run/systemd/journal/dev-log type=DGRAM 2023-10-16T12:25:50.654 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 4u unix 0xffff9dd1633abf00 0t0 16399 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.654 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 5u unix 0xffff9dd1633ac800 0t0 16403 /run/systemd/journal/socket type=DGRAM 2023-10-16T12:25:50.655 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 6u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.655 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 7u CHR 1,11 0t0 2057 /dev/kmsg 2023-10-16T12:25:50.655 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 8r REG 0,5 0 15076 /proc/sys/kernel/hostname 2023-10-16T12:25:50.656 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 9u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:50.656 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 10u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:50.656 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 11u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:50.656 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 12u unix 0xffff9dd1626e4380 0t0 17803 type=DGRAM 2023-10-16T12:25:50.657 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 13u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:50.657 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 14u REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:50.657 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 15u unix 0xffff9dd16262da00 0t0 17895 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.657 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 16u unix 0xffff9dcc0bf40900 0t0 32793 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.658 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 17u unix 0xffff9dcc51061200 0t0 22073 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.658 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 18u unix 0xffff9dcc51060900 0t0 21018 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.658 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 21u unix 0xffff9dcc51061b00 0t0 3057 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.658 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 22u unix 0xffff9dd1633ad100 0t0 3059 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.659 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 23u unix 0xffff9dd1633af080 0t0 3061 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.659 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 24u unix 0xffff9dd1633a2d00 0t0 19256 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.659 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 25u unix 0xffff9dd164049f80 0t0 24612 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.660 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 26u unix 0xffff9dcc51063600 0t0 22077 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.660 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 28u unix 0xffff9dcc51064c80 0t0 22079 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.660 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 29u unix 0xffff9dd1633a8d80 0t0 22585 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.660 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 30u unix 0xffff9dd1633ac380 0t0 22587 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.661 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 31u unix 0xffff9dd1633ada00 0t0 22589 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.661 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 33u unix 0xffff9dd161da3f00 0t0 18209 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.661 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 34u unix 0xffff9dd1626e0900 0t0 25170 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.661 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 35u unix 0xffff9dd161da7080 0t0 20289 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.662 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-j 657 root 36u unix 0xffff9dd161d80900 0t0 20291 /run/systemd/journal/stdout type=STREAM 2023-10-16T12:25:50.662 INFO:teuthology.orchestra.run.smithi094.stdout:ext4lazyi 665 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.662 INFO:teuthology.orchestra.run.smithi094.stdout:ext4lazyi 665 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.662 INFO:teuthology.orchestra.run.smithi094.stdout:ext4lazyi 665 root txt unknown /proc/665/exe 2023-10-16T12:25:50.663 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 686 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.663 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 686 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.663 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 686 root txt unknown /proc/686/exe 2023-10-16T12:25:50.664 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 695 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.664 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 695 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.664 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/6 695 root txt unknown /proc/695/exe 2023-10-16T12:25:50.664 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.665 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.665 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root txt REG 8,1 418304 8317 /usr/lib/systemd/systemd-udevd 2023-10-16T12:25:50.665 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.665 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.666 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T12:25:50.666 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.666 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 559522 41419 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.symbols.bin 2023-10-16T12:25:50.667 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 871129 41679 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.alias.bin 2023-10-16T12:25:50.667 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-10-16T12:25:50.667 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.667 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:50.668 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T12:25:50.668 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.668 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.668 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.669 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.669 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T12:25:50.669 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T12:25:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.670 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.671 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:50.672 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.673 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T12:25:50.673 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.673 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.674 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.675 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:50.675 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T12:25:50.675 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T12:25:50.675 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.676 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 10109 41420 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.builtin.bin 2023-10-16T12:25:50.676 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 442609 41424 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.dep.bin 2023-10-16T12:25:50.676 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T12:25:50.677 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T12:25:50.677 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.677 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 1u unix 0xffff9dd162629b00 0t0 18867 type=STREAM 2023-10-16T12:25:50.677 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 2u unix 0xffff9dd162629b00 0t0 18867 type=STREAM 2023-10-16T12:25:50.678 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 3u unix 0xffff9dd1626e6c00 0t0 17833 /run/udev/control type=SEQPACKET 2023-10-16T12:25:50.678 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 4u netlink 0t0 16080 KOBJECT_UEVENT 2023-10-16T12:25:50.678 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 5u unix 0xffff9dd16262a400 0t0 18874 type=DGRAM 2023-10-16T12:25:50.678 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 6r REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-10-16T12:25:50.679 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 7u unix 0xffff9dd161da0000 0t0 16272 type=DGRAM 2023-10-16T12:25:50.679 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T12:25:50.679 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 9r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.680 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 10u unix 0xffff9dd161da2400 0t0 16273 type=DGRAM 2023-10-16T12:25:50.680 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 11r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.680 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 12u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.680 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 13u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:50.681 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 14u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:50.681 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-u 699 root 15u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:50.681 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 712 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.681 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 712 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.682 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/2 712 root txt unknown /proc/712/exe 2023-10-16T12:25:50.682 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.682 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.683 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc txt REG 8,1 63160 14085 /usr/bin/rpcbind 2023-10-16T12:25:50.683 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.683 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.683 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.684 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.684 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.684 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.684 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.685 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.685 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.685 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:50.685 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.686 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:50.686 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.686 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.687 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.687 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.687 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.687 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.688 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.688 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:50.688 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:50.688 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:50.689 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:50.689 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.689 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.690 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.690 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:50.690 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.690 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.691 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 1u unix 0xffff9dcc51061680 0t0 21017 type=STREAM 2023-10-16T12:25:50.691 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 2u unix 0xffff9dcc51061680 0t0 21017 type=STREAM 2023-10-16T12:25:50.691 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 3u unix 0xffff9dd161da0480 0t0 16092 /run/rpcbind.sock type=STREAM 2023-10-16T12:25:50.692 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 4u IPv4 16095 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T12:25:50.692 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 5u IPv4 16096 0t0 UDP *:sunrpc 2023-10-16T12:25:50.692 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 6u IPv6 16097 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T12:25:50.692 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 7u IPv6 16098 0t0 UDP *:sunrpc 2023-10-16T12:25:50.693 INFO:teuthology.orchestra.run.smithi094.stdout:rpcbind 748 rpc 8rW REG 0,24 0 21024 /run/rpcbind/rpcbind.lock 2023-10-16T12:25:50.693 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.693 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.693 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-10-16T12:25:50.694 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.694 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.694 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.695 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.695 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.695 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.695 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.696 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.696 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:50.696 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.697 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:50.697 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:50.697 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:50.697 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.698 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:50.698 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:50.698 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.699 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.699 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.699 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T12:25:50.699 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:50.700 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.700 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.700 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.701 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.701 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 3u netlink 0t0 1812 AUDIT 2023-10-16T12:25:50.701 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 4u unix 0xffff9dcc0bf40000 0t0 31833 type=STREAM 2023-10-16T12:25:50.701 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 5r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.702 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 6w REG 8,1 8138515 1858 /var/log/audit/audit.log 2023-10-16T12:25:50.702 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 7u unix 0xffff9dcc51063180 0t0 21036 type=DGRAM 2023-10-16T12:25:50.702 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 8u unix 0xffff9dcc51065100 0t0 21035 type=STREAM 2023-10-16T12:25:50.702 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 9u unix 0xffff9dcc51060d80 0t0 21037 type=STREAM 2023-10-16T12:25:50.703 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 10u unix 0xffff9dcc51062d00 0t0 21038 type=STREAM 2023-10-16T12:25:50.703 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 root 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.703 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.704 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.704 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-10-16T12:25:50.704 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.704 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.705 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.705 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.705 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.705 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.706 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.706 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.706 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:50.707 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.707 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:50.707 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:50.707 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:50.708 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.708 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:50.708 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:50.708 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.709 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.709 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.709 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T12:25:50.709 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:50.710 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.710 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.710 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.711 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.711 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 3u netlink 0t0 1812 AUDIT 2023-10-16T12:25:50.711 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 4u unix 0xffff9dcc0bf40000 0t0 31833 type=STREAM 2023-10-16T12:25:50.711 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 5r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.712 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 6w REG 8,1 8138515 1858 /var/log/audit/audit.log 2023-10-16T12:25:50.712 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 7u unix 0xffff9dcc51063180 0t0 21036 type=DGRAM 2023-10-16T12:25:50.712 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 8u unix 0xffff9dcc51065100 0t0 21035 type=STREAM 2023-10-16T12:25:50.713 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 9u unix 0xffff9dcc51060d80 0t0 21037 type=STREAM 2023-10-16T12:25:50.713 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 10u unix 0xffff9dcc51062d00 0t0 21038 type=STREAM 2023-10-16T12:25:50.713 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 750 auditd root 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.713 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.714 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.714 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-10-16T12:25:50.714 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.714 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.715 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.715 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.715 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.716 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.716 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.716 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.716 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:50.717 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.717 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:50.717 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:50.717 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:50.718 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.718 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:50.718 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:50.719 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.719 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.719 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.719 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T12:25:50.720 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:50.720 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.720 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.720 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.721 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.721 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 3u netlink 0t0 1812 AUDIT 2023-10-16T12:25:50.721 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 4u unix 0xffff9dcc0bf40000 0t0 31833 type=STREAM 2023-10-16T12:25:50.722 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 5r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.722 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 6w REG 8,1 8138515 1858 /var/log/audit/audit.log 2023-10-16T12:25:50.722 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 7u unix 0xffff9dcc51063180 0t0 21036 type=DGRAM 2023-10-16T12:25:50.722 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 8u unix 0xffff9dcc51065100 0t0 21035 type=STREAM 2023-10-16T12:25:50.723 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 9u unix 0xffff9dcc51060d80 0t0 21037 type=STREAM 2023-10-16T12:25:50.723 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 10u unix 0xffff9dcc51062d00 0t0 21038 type=STREAM 2023-10-16T12:25:50.723 INFO:teuthology.orchestra.run.smithi094.stdout:auditd 749 755 auditd root 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.723 INFO:teuthology.orchestra.run.smithi094.stdout:rpciod 751 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.724 INFO:teuthology.orchestra.run.smithi094.stdout:rpciod 751 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.724 INFO:teuthology.orchestra.run.smithi094.stdout:rpciod 751 root txt unknown /proc/751/exe 2023-10-16T12:25:50.724 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 752 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.725 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 752 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.725 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/u 752 root txt unknown /proc/752/exe 2023-10-16T12:25:50.725 INFO:teuthology.orchestra.run.smithi094.stdout:xprtiod 753 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.725 INFO:teuthology.orchestra.run.smithi094.stdout:xprtiod 753 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.726 INFO:teuthology.orchestra.run.smithi094.stdout:xprtiod 753 root txt unknown /proc/753/exe 2023-10-16T12:25:50.726 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.726 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.726 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root txt REG 8,1 21008 10285 /usr/sbin/sedispatch 2023-10-16T12:25:50.727 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.727 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.727 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.728 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.728 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.728 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.728 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.729 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.729 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.729 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.729 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.730 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.730 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:50.730 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.731 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.731 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.731 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.731 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-10-16T12:25:50.732 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:50.732 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.732 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.733 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root 0u unix 0xffff9dcc51061f80 0t0 21034 type=STREAM 2023-10-16T12:25:50.733 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.733 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.733 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root 3u unix 0xffff9dd161d84380 0t0 29752 type=STREAM 2023-10-16T12:25:50.734 INFO:teuthology.orchestra.run.smithi094.stdout:sedispatc 754 root 4u unix 0xffff9dd161d83600 0t0 29861 type=DGRAM 2023-10-16T12:25:50.734 INFO:teuthology.orchestra.run.smithi094.stdout:kipmi0 777 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.734 INFO:teuthology.orchestra.run.smithi094.stdout:kipmi0 777 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.735 INFO:teuthology.orchestra.run.smithi094.stdout:kipmi0 777 root txt unknown /proc/777/exe 2023-10-16T12:25:50.735 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 788 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.735 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 788 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.735 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 788 root txt unknown /proc/788/exe 2023-10-16T12:25:50.736 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 789 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.736 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 789 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.736 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 789 root txt unknown /proc/789/exe 2023-10-16T12:25:50.737 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 790 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.737 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 790 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.737 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 790 root txt unknown /proc/790/exe 2023-10-16T12:25:50.737 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 791 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.738 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 791 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.738 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 791 root txt unknown /proc/791/exe 2023-10-16T12:25:50.738 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 792 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.739 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 792 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.739 INFO:teuthology.orchestra.run.smithi094.stdout:kdmflush/ 792 root txt unknown /proc/792/exe 2023-10-16T12:25:50.739 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.739 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.740 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.740 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.740 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.741 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.741 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.741 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.741 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.742 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.742 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.742 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.743 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.743 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.743 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.743 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.744 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.744 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.744 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.744 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.745 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.745 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.745 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.746 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.746 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.746 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.746 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.747 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.747 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.747 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.748 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.748 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.748 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.748 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.749 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.749 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.749 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.749 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.750 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.750 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.750 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.751 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.751 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.751 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.751 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.752 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.752 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.752 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.752 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.753 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.753 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.753 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.754 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.754 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.754 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.754 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.755 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.755 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.755 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.755 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.756 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.756 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.756 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.757 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.757 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.757 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.757 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.758 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.758 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.758 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.759 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.759 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.759 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.759 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.760 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.760 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.760 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.760 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.761 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.761 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.761 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.761 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.762 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.762 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.762 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.763 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.763 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.763 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.763 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.764 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.764 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.764 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.764 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.765 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.765 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.765 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.766 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.766 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.766 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.766 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.767 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.767 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.767 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.767 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.768 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.768 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.768 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.768 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.769 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.769 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.769 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.770 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.770 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.770 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.770 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.771 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.771 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.771 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.772 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.772 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 967 gmain polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.772 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.772 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.773 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.773 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.773 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.773 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.774 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.774 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.774 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.774 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.775 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.775 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.775 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.776 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.776 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.776 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.776 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.777 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.777 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.777 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.777 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.778 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.778 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.778 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.779 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.779 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.779 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.779 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.780 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.780 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.780 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.781 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.781 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.781 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.781 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.782 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.782 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.782 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.782 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.783 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.783 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.783 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.784 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.784 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.784 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.784 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.785 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.785 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.785 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.786 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.786 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.786 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.786 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.787 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.787 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.787 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.788 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.788 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.788 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.788 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 969 gdbus polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.789 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.789 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.789 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.789 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.790 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.790 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.790 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.791 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.791 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.791 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.791 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.792 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.792 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.792 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.792 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.793 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.793 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.793 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.794 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.794 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.794 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.794 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.795 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.795 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.795 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.795 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.796 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.796 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.796 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.797 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.797 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.797 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.797 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.798 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.798 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.798 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.799 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.799 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.799 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.799 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.800 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.800 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.800 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.800 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.801 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.801 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.801 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.801 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.802 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.802 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.802 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.803 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.803 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.803 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.803 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.804 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.804 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.804 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.804 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.805 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 976 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.805 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.805 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.806 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.806 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.806 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.806 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.807 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.807 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.807 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.807 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.808 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.808 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.808 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.809 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.809 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.809 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.809 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.810 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.810 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.810 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.811 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.811 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.811 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.811 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.812 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.812 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.812 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.812 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.813 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.813 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.813 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.813 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.814 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.814 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.814 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.815 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.815 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.815 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.816 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.816 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.816 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.816 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.817 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.817 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.817 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.817 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.818 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.818 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.818 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.819 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.819 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.819 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.819 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.820 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.820 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.820 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.821 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.821 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.821 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.821 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 977 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.822 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.822 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.822 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.822 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.823 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.823 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.823 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.824 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.824 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.824 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.824 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.825 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.825 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.825 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.825 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.826 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.826 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.826 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.827 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.827 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.827 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.827 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.829 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.829 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.829 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.830 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.830 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.830 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.830 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.831 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.831 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.831 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.831 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.832 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.832 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.832 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.833 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.833 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.833 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.833 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.834 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.834 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.834 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.834 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.835 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.835 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.835 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.837 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.837 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.837 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.837 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.838 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 978 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.838 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.838 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.838 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.839 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.839 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.839 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.841 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.841 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.841 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.841 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.842 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.842 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.842 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.843 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.843 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.843 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.843 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.844 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.844 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.844 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.844 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.845 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.845 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.845 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.845 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.846 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.846 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.846 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.847 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.847 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.847 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.847 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.848 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.848 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.848 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.848 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.849 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.849 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.849 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.850 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.850 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.850 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.851 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.851 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.851 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.851 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.852 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.852 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.852 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.852 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.853 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.853 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.853 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.853 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.854 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.854 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 979 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.854 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.855 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.855 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.855 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.855 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.856 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.857 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.858 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.858 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.858 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.858 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.859 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.859 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.859 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.860 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.860 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.860 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.860 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.861 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.861 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.861 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.862 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.863 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.865 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.865 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.865 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.865 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.866 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.866 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.866 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.867 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.867 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.867 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.867 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.868 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.868 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.868 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.868 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.869 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.869 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.869 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.870 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.870 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.870 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.870 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.871 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.871 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.871 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.872 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.872 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.872 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 980 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.872 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.873 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.873 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.873 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.873 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.874 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.874 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.874 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.875 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.875 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.875 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.875 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.876 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.876 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.876 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.876 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.877 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.877 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.877 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.878 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.878 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.878 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.878 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.879 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.879 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.879 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.880 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.880 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.880 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.880 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.881 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.881 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.881 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.881 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.882 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.882 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.882 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.883 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.883 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.883 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.883 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.884 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.884 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.884 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.885 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.885 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.885 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.885 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.886 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.886 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.886 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.886 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.887 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.887 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.887 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.888 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.888 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.888 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.888 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.889 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 981 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.889 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.889 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.889 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.890 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.890 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.890 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.891 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.891 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.891 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.891 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.892 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.892 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.892 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.892 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.893 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.893 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.893 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.893 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.894 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.894 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.894 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.895 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.895 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.895 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.895 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.896 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.896 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.896 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.896 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.897 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.897 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.897 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.897 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.898 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.898 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.898 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.899 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.899 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.899 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.899 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.900 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.900 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.900 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.900 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.901 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.901 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.901 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.902 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.902 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.902 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.902 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.903 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.903 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.903 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.904 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.904 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.904 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.904 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.905 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.905 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 982 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.905 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.906 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.906 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.906 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.906 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.907 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.907 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.907 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.908 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.908 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.908 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.908 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.909 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.909 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.909 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.910 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.910 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.910 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.910 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.911 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.911 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.911 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.912 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.912 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.912 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.912 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.913 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.913 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.913 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.913 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.914 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.914 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.914 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.915 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.915 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.915 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.915 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.916 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.916 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.916 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.917 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.917 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.917 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.917 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.918 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.918 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.918 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.918 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.919 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.919 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.919 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.920 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.920 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.920 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.920 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.921 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.921 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.921 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.921 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.922 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 983 JS\x20Hel polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.922 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.922 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.923 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-10-16T12:25:50.923 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.923 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.923 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.924 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.924 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.924 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.924 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.925 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.925 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.925 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.925 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.926 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.926 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.926 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.927 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.927 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.927 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.927 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.928 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.928 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.928 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.928 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.929 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.929 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.929 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.929 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.930 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.930 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.930 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.932 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.932 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.932 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-10-16T12:25:50.932 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:50.933 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.933 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.933 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:50.934 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:50.934 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T12:25:50.934 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.934 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.935 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.935 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.935 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.936 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.936 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 4r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.936 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.936 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.937 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.937 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 8u unix 0xffff9dd161da7500 0t0 23145 type=STREAM 2023-10-16T12:25:50.937 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 9u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.937 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.938 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 11u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.938 INFO:teuthology.orchestra.run.smithi094.stdout:polkitd 812 1006 polkitd polkitd 12u unix 0xffff9dcc0b1a1b00 0t0 27075 type=DGRAM 2023-10-16T12:25:50.938 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 829 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.939 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 829 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.939 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/1 829 root txt unknown /proc/829/exe 2023-10-16T12:25:50.939 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.939 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.940 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root txt REG 8,1 718504 11142 /usr/sbin/smartd 2023-10-16T12:25:50.940 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.940 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.940 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.941 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.941 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.941 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.941 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.942 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.942 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.942 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.943 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.943 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.943 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.943 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.944 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.944 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:50.944 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.944 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.945 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.945 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.945 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.946 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.946 INFO:teuthology.orchestra.run.smithi094.stdout:smartd 832 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.946 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.946 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.947 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root txt REG 8,1 83544 10536 /usr/sbin/sssd 2023-10-16T12:25:50.947 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.947 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:50.947 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:50.948 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.948 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T12:25:50.948 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T12:25:50.948 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:50.949 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.949 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-10-16T12:25:50.949 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-10-16T12:25:50.950 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-10-16T12:25:50.950 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-10-16T12:25:50.950 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-10-16T12:25:50.950 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-10-16T12:25:50.951 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-10-16T12:25:50.951 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-10-16T12:25:50.951 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-10-16T12:25:50.951 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-10-16T12:25:50.952 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-10-16T12:25:50.952 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-10-16T12:25:50.952 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-10-16T12:25:50.953 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-10-16T12:25:50.953 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:50.953 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:50.953 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:50.954 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:50.954 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:50.954 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:50.954 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:50.955 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:50.955 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:50.955 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:50.956 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:50.956 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-10-16T12:25:50.956 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-10-16T12:25:50.956 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.957 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.957 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.957 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.957 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.958 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.958 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.958 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.959 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.959 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:50.959 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:50.959 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.960 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.960 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.960 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.961 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:50.961 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-10-16T12:25:50.961 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-10-16T12:25:50.961 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-10-16T12:25:50.962 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-10-16T12:25:50.962 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-10-16T12:25:50.962 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:50.962 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-10-16T12:25:50.963 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:50.963 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-10-16T12:25:50.963 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-10-16T12:25:50.964 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-10-16T12:25:50.964 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:50.964 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:50.964 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:50.965 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:50.965 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.965 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-10-16T12:25:50.965 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.966 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-10-16T12:25:50.966 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:50.966 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.967 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-10-16T12:25:50.967 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:50.967 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 147336 5439 /usr/lib64/libnl-3.so.200.26.0 2023-10-16T12:25:50.967 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 549824 5447 /usr/lib64/libnl-route-3.so.200.26.0 2023-10-16T12:25:50.968 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.968 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:50.968 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:50.969 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:50.969 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:50.969 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:50.969 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:50.970 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:50.970 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:50.970 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:50.971 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:50.971 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:50.971 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T12:25:50.971 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:50.972 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 0r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:50.972 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 1u unix 0xffff9dcc51067500 0t0 21248 type=STREAM 2023-10-16T12:25:50.972 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 2u unix 0xffff9dcc51067500 0t0 21248 type=STREAM 2023-10-16T12:25:50.972 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 3w REG 8,1 5229 66780 /var/log/sssd/sssd.log 2023-10-16T12:25:50.973 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.973 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 5u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T12:25:50.973 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.974 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 7u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.974 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 8u unix 0xffff9dd1633a5a00 0t0 23735 type=DGRAM 2023-10-16T12:25:50.974 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 9u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T12:25:50.974 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 10u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:50.975 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 11u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T12:25:50.975 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 12u unix 0xffff9dd161da4800 0t0 23132 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T12:25:50.975 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 13u unix 0xffff9dd161da1200 0t0 23133 type=STREAM 2023-10-16T12:25:50.975 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 14u unix 0xffff9dd161da6780 0t0 23134 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T12:25:50.976 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 15r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:50.976 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 16r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:50.976 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 17u netlink 0t0 23140 ROUTE 2023-10-16T12:25:50.976 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 18u unix 0xffff9dcc0b1a7980 0t0 23186 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T12:25:50.977 INFO:teuthology.orchestra.run.smithi094.stdout:sssd 834 root 19u unix 0xffff9dd161da1b00 0t0 23784 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-10-16T12:25:50.977 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.977 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.978 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-10-16T12:25:50.978 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.978 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.978 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.979 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.980 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.980 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.980 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.980 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.981 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.981 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.981 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T12:25:50.982 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-10-16T12:25:50.982 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:50.982 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.982 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.983 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.983 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.983 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.983 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root 1u unix 0xffff9dd1633a8900 0t0 19914 type=STREAM 2023-10-16T12:25:50.984 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root 2u unix 0xffff9dd1633a8900 0t0 19914 type=STREAM 2023-10-16T12:25:50.984 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root 3u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.984 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.985 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 root 5u unix 0xffff9dcc51062400 0t0 21478 @irqbalance835.sock type=STREAM 2023-10-16T12:25:50.985 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.985 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.985 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-10-16T12:25:50.986 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:50.986 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:50.986 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:50.986 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:50.987 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:50.987 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:50.987 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:50.988 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:50.988 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.988 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.988 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:50.989 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:50.989 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.989 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T12:25:50.989 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-10-16T12:25:50.990 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:50.990 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:50.990 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:50.991 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.991 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:50.991 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:50.991 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root 1u unix 0xffff9dd1633a8900 0t0 19914 type=STREAM 2023-10-16T12:25:50.992 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root 2u unix 0xffff9dd1633a8900 0t0 19914 type=STREAM 2023-10-16T12:25:50.992 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root 3u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.992 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:50.992 INFO:teuthology.orchestra.run.smithi094.stdout:irqbalanc 835 900 gmain root 5u unix 0xffff9dcc51062400 0t0 21478 @irqbalance835.sock type=STREAM 2023-10-16T12:25:50.993 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus cwd DIR 8,1 4096 2 / 2023-10-16T12:25:50.993 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus rtd DIR 8,1 4096 2 / 2023-10-16T12:25:50.993 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-10-16T12:25:50.993 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T12:25:50.994 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:50.994 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:50.994 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:50.995 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:50.995 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:50.995 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:50.996 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:50.996 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:50.996 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:50.996 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:50.997 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:50.997 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:50.997 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:50.998 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:50.998 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:50.998 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:50.998 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:50.999 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:50.999 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:50.999 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:50.999 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.000 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.000 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.000 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.001 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.001 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 1u unix 0xffff9dd1633a8480 0t0 19972 type=STREAM 2023-10-16T12:25:51.001 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 2u unix 0xffff9dd1633a8480 0t0 19972 type=STREAM 2023-10-16T12:25:51.001 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 3u unix 0xffff9dd164048480 0t0 1925 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.002 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.002 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 5u unix 0xffff9dcc0b1a1680 0t0 27372 type=STREAM 2023-10-16T12:25:51.002 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 7u sock 0,9 0t0 26149 protocol: NETLINK 2023-10-16T12:25:51.003 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T12:25:51.003 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 9u netlink 0t0 26150 SELINUX 2023-10-16T12:25:51.003 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.003 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 11u unix 0xffff9dd1626e1200 0t0 26155 type=STREAM 2023-10-16T12:25:51.004 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 12u unix 0xffff9dd1626e0000 0t0 26156 type=STREAM 2023-10-16T12:25:51.004 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 13u unix 0xffff9dd16262e780 0t0 26157 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.004 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 14u unix 0xffff9dd161d87080 0t0 26164 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.005 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 15u unix 0xffff9dd161da3180 0t0 26170 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.005 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 16u unix 0xffff9dd1626e3180 0t0 26171 type=DGRAM 2023-10-16T12:25:51.005 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 17u unix 0xffff9dd161d80000 0t0 27965 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.005 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 19u unix 0xffff9dd161da5a00 0t0 26178 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.006 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 20u unix 0xffff9dd16404c380 0t0 26179 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.006 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 21u unix 0xffff9dcc0bf46c00 0t0 27371 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.006 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 22u unix 0xffff9dd161d86c00 0t0 19401 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.007 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 23u unix 0xffff9dd161da5e80 0t0 22243 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.007 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 dbus 24u unix 0xffff9dd1626e3f00 0t0 22252 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.007 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.007 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.008 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-10-16T12:25:51.008 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T12:25:51.008 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.009 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.009 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.009 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.009 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.010 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.010 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.010 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.011 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.011 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.011 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.011 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.012 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.012 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.012 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.012 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.013 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.013 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.013 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.014 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.014 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.014 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.014 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.015 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.015 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.015 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 1u unix 0xffff9dd1633a8480 0t0 19972 type=STREAM 2023-10-16T12:25:51.016 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 2u unix 0xffff9dd1633a8480 0t0 19972 type=STREAM 2023-10-16T12:25:51.016 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 3u unix 0xffff9dd164048480 0t0 1925 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.016 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.016 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 5u unix 0xffff9dcc0b1a1680 0t0 27372 type=STREAM 2023-10-16T12:25:51.017 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 7u sock 0,9 0t0 26149 protocol: NETLINK 2023-10-16T12:25:51.017 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 8r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T12:25:51.017 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 9u netlink 0t0 26150 SELINUX 2023-10-16T12:25:51.017 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.018 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 11u unix 0xffff9dd1626e1200 0t0 26155 type=STREAM 2023-10-16T12:25:51.018 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 12u unix 0xffff9dd1626e0000 0t0 26156 type=STREAM 2023-10-16T12:25:51.018 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 13u unix 0xffff9dd16262e780 0t0 26157 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.019 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 14u unix 0xffff9dd161d87080 0t0 26164 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.019 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 15u unix 0xffff9dd161da3180 0t0 26170 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.019 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 16u unix 0xffff9dd1626e3180 0t0 26171 type=DGRAM 2023-10-16T12:25:51.019 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 17u unix 0xffff9dd161d80000 0t0 27965 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.020 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 19u unix 0xffff9dd161da5a00 0t0 26178 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.020 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 20u unix 0xffff9dd16404c380 0t0 26179 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.020 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 21u unix 0xffff9dcc0bf46c00 0t0 27371 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.020 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 22u unix 0xffff9dd161d86c00 0t0 19401 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.021 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 23u unix 0xffff9dd161da5e80 0t0 22243 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.021 INFO:teuthology.orchestra.run.smithi094.stdout:dbus-daem 836 945 dbus-daem dbus 24u unix 0xffff9dd1626e3f00 0t0 22252 /run/dbus/system_bus_socket type=STREAM 2023-10-16T12:25:51.021 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.021 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.022 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T12:25:51.022 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T12:25:51.022 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.023 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T12:25:51.023 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T12:25:51.023 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T12:25:51.023 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.024 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.024 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.024 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:51.024 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T12:25:51.025 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T12:25:51.025 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.025 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.026 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T12:25:51.026 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.026 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:51.026 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.027 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.027 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.027 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.027 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.028 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.028 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.028 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.028 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.029 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T12:25:51.029 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:51.029 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:51.030 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.030 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.030 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.030 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.031 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.031 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.031 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T12:25:51.032 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T12:25:51.032 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T12:25:51.032 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.032 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.033 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.033 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.033 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.033 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.034 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.034 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.034 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.035 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.035 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.035 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.035 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.036 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.036 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.036 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.036 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.037 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.037 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.037 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.038 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.038 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.038 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.038 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T12:25:51.039 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.039 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.039 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T12:25:51.039 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.040 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.040 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.040 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.041 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.041 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.041 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.041 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.042 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.042 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.042 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.042 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.043 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.043 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.043 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.044 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.044 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.044 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 1u unix 0xffff9dd1633a0d80 0t0 23605 type=STREAM 2023-10-16T12:25:51.044 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 2u unix 0xffff9dd1633a0d80 0t0 23605 type=STREAM 2023-10-16T12:25:51.045 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 3u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.045 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.045 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 5u unix 0xffff9dd161da2d00 0t0 22834 type=DGRAM 2023-10-16T12:25:51.045 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 6u unix 0xffff9dd161da0d80 0t0 22835 type=STREAM 2023-10-16T12:25:51.046 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.046 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 8r REG 0,4 0 4026532000 net 2023-10-16T12:25:51.046 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 9r REG 0,4 0 4026532488 mnt 2023-10-16T12:25:51.046 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 10u netlink 0t0 24961 KOBJECT_UEVENT 2023-10-16T12:25:51.047 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 11u netlink 0t0 24962 GENERIC 2023-10-16T12:25:51.047 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 12u netlink 0t0 24963 ROUTE 2023-10-16T12:25:51.047 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.048 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 14r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.048 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 15r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.048 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 16u netlink 0t0 25084 KOBJECT_UEVENT 2023-10-16T12:25:51.048 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 17u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.049 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 18u unix 0xffff9dd16404a880 0t0 25111 type=STREAM 2023-10-16T12:25:51.049 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 19u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.049 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 20u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.049 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 21u pack 20299 0t0 IP type=SOCK_DGRAM 2023-10-16T12:25:51.050 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 22u raw6 0t0 23902 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T12:25:51.050 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 23w FIFO 0,24 0t0 26294 /run/systemd/inhibit/1.ref 2023-10-16T12:25:51.050 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 24u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.051 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 25u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.051 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 26u pack 23933 0t0 ARP type=SOCK_DGRAM 2023-10-16T12:25:51.051 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 root 27u IPv4 23934 0t0 UDP smithi094:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T12:25:51.051 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.052 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.052 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T12:25:51.052 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T12:25:51.052 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.053 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T12:25:51.053 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T12:25:51.053 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T12:25:51.053 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.054 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.054 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.054 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:51.055 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T12:25:51.055 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T12:25:51.055 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.055 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.056 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T12:25:51.056 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.056 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:51.056 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.057 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.057 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.057 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.058 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.058 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.058 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.058 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.059 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.059 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T12:25:51.059 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:51.060 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:51.060 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.060 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.060 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.061 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.061 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.061 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.061 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T12:25:51.062 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T12:25:51.062 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T12:25:51.062 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.063 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.063 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.063 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.063 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.064 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.064 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.064 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.064 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.065 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.065 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.065 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.065 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.066 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.066 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.066 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.067 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.067 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.067 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.067 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.068 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.068 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.068 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.068 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T12:25:51.069 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.069 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.069 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T12:25:51.070 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.070 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.070 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.071 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.071 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.071 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.071 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.072 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.072 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.072 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.073 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.073 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.073 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.073 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.074 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.074 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.074 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.074 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 1u unix 0xffff9dd1633a0d80 0t0 23605 type=STREAM 2023-10-16T12:25:51.075 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 2u unix 0xffff9dd1633a0d80 0t0 23605 type=STREAM 2023-10-16T12:25:51.075 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 3u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.075 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.076 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 5u unix 0xffff9dd161da2d00 0t0 22834 type=DGRAM 2023-10-16T12:25:51.076 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 6u unix 0xffff9dd161da0d80 0t0 22835 type=STREAM 2023-10-16T12:25:51.076 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.076 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 8r REG 0,4 0 4026532000 net 2023-10-16T12:25:51.077 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 9r REG 0,4 0 4026532488 mnt 2023-10-16T12:25:51.077 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 10u netlink 0t0 24961 KOBJECT_UEVENT 2023-10-16T12:25:51.077 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 11u netlink 0t0 24962 GENERIC 2023-10-16T12:25:51.078 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 12u netlink 0t0 24963 ROUTE 2023-10-16T12:25:51.078 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.078 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 14r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.078 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 15r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.079 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 16u netlink 0t0 25084 KOBJECT_UEVENT 2023-10-16T12:25:51.079 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 17u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.079 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 18u unix 0xffff9dd16404a880 0t0 25111 type=STREAM 2023-10-16T12:25:51.079 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 19u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.080 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 20u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.080 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 21u pack 20299 0t0 IP type=SOCK_DGRAM 2023-10-16T12:25:51.080 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 22u raw6 0t0 23902 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T12:25:51.081 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 23w FIFO 0,24 0t0 26294 /run/systemd/inhibit/1.ref 2023-10-16T12:25:51.081 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 24u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.081 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 25u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.081 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 26u pack 23933 0t0 ARP type=SOCK_DGRAM 2023-10-16T12:25:51.082 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 952 gmain root 27u IPv4 23934 0t0 UDP smithi094:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T12:25:51.082 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.082 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.082 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-10-16T12:25:51.083 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T12:25:51.083 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.083 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-10-16T12:25:51.084 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T12:25:51.084 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-10-16T12:25:51.084 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.084 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.085 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.085 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-10-16T12:25:51.085 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-10-16T12:25:51.085 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-10-16T12:25:51.086 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.086 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.086 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-10-16T12:25:51.086 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.087 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:51.087 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.087 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.088 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.088 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.088 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.088 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.089 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.089 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.089 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.089 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-10-16T12:25:51.090 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:51.090 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:51.090 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.090 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.091 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.091 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.091 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.092 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.092 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-10-16T12:25:51.092 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-10-16T12:25:51.092 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-10-16T12:25:51.093 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.093 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.093 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.093 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.094 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.094 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.094 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.094 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.095 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.095 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.095 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.096 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.096 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.096 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.096 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.097 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.097 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.097 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.097 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.098 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.098 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.098 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.099 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.099 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-10-16T12:25:51.099 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.099 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.100 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-10-16T12:25:51.100 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.100 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.100 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.101 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.101 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.101 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.101 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.102 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.102 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.102 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.103 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.103 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.103 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.103 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.104 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.104 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.104 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.104 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 1u unix 0xffff9dd1633a0d80 0t0 23605 type=STREAM 2023-10-16T12:25:51.105 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 2u unix 0xffff9dd1633a0d80 0t0 23605 type=STREAM 2023-10-16T12:25:51.105 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 3u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.105 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.106 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 5u unix 0xffff9dd161da2d00 0t0 22834 type=DGRAM 2023-10-16T12:25:51.106 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 6u unix 0xffff9dd161da0d80 0t0 22835 type=STREAM 2023-10-16T12:25:51.106 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.106 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 8r REG 0,4 0 4026532000 net 2023-10-16T12:25:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 9r REG 0,4 0 4026532488 mnt 2023-10-16T12:25:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 10u netlink 0t0 24961 KOBJECT_UEVENT 2023-10-16T12:25:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 11u netlink 0t0 24962 GENERIC 2023-10-16T12:25:51.107 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 12u netlink 0t0 24963 ROUTE 2023-10-16T12:25:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 13r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 14r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.108 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 15r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.109 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 16u netlink 0t0 25084 KOBJECT_UEVENT 2023-10-16T12:25:51.109 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 17u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.109 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 18u unix 0xffff9dd16404a880 0t0 25111 type=STREAM 2023-10-16T12:25:51.109 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 19u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.110 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 20u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.110 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 21u pack 20299 0t0 IP type=SOCK_DGRAM 2023-10-16T12:25:51.110 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 22u raw6 0t0 23902 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T12:25:51.111 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 23w FIFO 0,24 0t0 26294 /run/systemd/inhibit/1.ref 2023-10-16T12:25:51.111 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 24u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.111 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 25u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.111 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 26u pack 23933 0t0 ARP type=SOCK_DGRAM 2023-10-16T12:25:51.112 INFO:teuthology.orchestra.run.smithi094.stdout:NetworkMa 840 953 gdbus root 27u IPv4 23934 0t0 UDP smithi094:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T12:25:51.112 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi cwd DIR 8,1 4096 1974 /etc/avahi 2023-10-16T12:25:51.112 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi rtd DIR 8,1 4096 1974 /etc/avahi 2023-10-16T12:25:51.112 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-10-16T12:25:51.113 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.113 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.113 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T12:25:51.113 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.114 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.114 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.114 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.115 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.116 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.117 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.117 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.117 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.117 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.118 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.118 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.118 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.118 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.119 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.119 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.119 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-10-16T12:25:51.127 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-10-16T12:25:51.127 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-10-16T12:25:51.127 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.127 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.128 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 1u unix 0xffff9dd164048d80 0t0 24611 type=STREAM 2023-10-16T12:25:51.128 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 2u unix 0xffff9dd164048d80 0t0 24611 type=STREAM 2023-10-16T12:25:51.128 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 3u unix 0xffff9dd16404f080 0t0 1930 /run/avahi-daemon/socket type=STREAM 2023-10-16T12:25:51.129 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.129 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 5r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T12:25:51.129 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 6u unix 0xffff9dd16404ad00 0t0 24817 type=DGRAM 2023-10-16T12:25:51.129 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 7r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:51.130 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 8u unix 0xffff9dd161d83f00 0t0 22052 type=STREAM 2023-10-16T12:25:51.130 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 9r FIFO 0,13 0t0 22055 pipe 2023-10-16T12:25:51.130 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 10w FIFO 0,13 0t0 22055 pipe 2023-10-16T12:25:51.131 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 11r FIFO 0,13 0t0 22056 pipe 2023-10-16T12:25:51.131 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 12w FIFO 0,13 0t0 22056 pipe 2023-10-16T12:25:51.131 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 13u unix 0xffff9dd161d81680 0t0 22057 type=STREAM 2023-10-16T12:25:51.131 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 14r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.132 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 15u IPv4 20236 0t0 UDP *:mdns 2023-10-16T12:25:51.132 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 16u IPv6 20237 0t0 UDP *:mdns 2023-10-16T12:25:51.132 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 17u IPv4 20238 0t0 UDP *:55653 2023-10-16T12:25:51.132 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 18u IPv6 20239 0t0 UDP *:49461 2023-10-16T12:25:51.133 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 841 avahi 19u netlink 0t0 20240 ROUTE 2023-10-16T12:25:51.133 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.133 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.134 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root txt REG 8,1 185992 11073 /usr/sbin/mcelog 2023-10-16T12:25:51.134 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.134 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.134 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.135 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.135 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.135 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.135 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root 1u unix 0xffff9dd1633ab600 0t0 20094 type=STREAM 2023-10-16T12:25:51.136 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root 2u unix 0xffff9dd1633ab600 0t0 20094 type=STREAM 2023-10-16T12:25:51.136 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root 3r CHR 10,227 0t0 3977 /dev/mcelog 2023-10-16T12:25:51.136 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.137 INFO:teuthology.orchestra.run.smithi094.stdout:mcelog 852 root 5u unix 0xffff9dd1626e5e80 0t0 18214 /var/run/mcelog-client type=STREAM 2023-10-16T12:25:51.137 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.137 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.137 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt txt REG 8,1 25472 9470 /usr/bin/lsmd 2023-10-16T12:25:51.138 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.138 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.138 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.139 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.139 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt mem REG 8,1 54680 6239 /usr/lib64/libconfig.so.9.2.0 2023-10-16T12:25:51.139 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.139 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.140 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 1u unix 0xffff9dd1633aad00 0t0 20153 type=STREAM 2023-10-16T12:25:51.140 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 2u unix 0xffff9dd1633af500 0t0 20154 type=STREAM 2023-10-16T12:25:51.140 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 3uW REG 0,24 0 20161 /run/lsm/ipc/.lsmd-ipc-lock 2023-10-16T12:25:51.141 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.141 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 5u unix 0xffff9dd1633a9b00 0t0 20162 /var/run/lsm/ipc/sim type=STREAM 2023-10-16T12:25:51.141 INFO:teuthology.orchestra.run.smithi094.stdout:lsmd 853 libstoragemgmt 6u unix 0xffff9dd1633af980 0t0 20164 /var/run/lsm/ipc/simc type=STREAM 2023-10-16T12:25:51.141 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.142 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.142 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root txt REG 8,1 1150584 5025 /usr/bin/bash 2023-10-16T12:25:51.142 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.142 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.143 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.143 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.143 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.144 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.144 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T12:25:51.144 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.144 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.145 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.145 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.145 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.145 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.146 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.146 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.146 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.146 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.147 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.147 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.147 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.148 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.148 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root 1u unix 0xffff9dd161da5580 0t0 22677 type=STREAM 2023-10-16T12:25:51.148 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root 2u unix 0xffff9dd161da5580 0t0 22677 type=STREAM 2023-10-16T12:25:51.148 INFO:teuthology.orchestra.run.smithi094.stdout:ksmtuned 873 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.149 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.149 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.149 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root txt REG 8,1 38296 7205 /usr/bin/sleep 2023-10-16T12:25:51.149 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.150 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.150 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.150 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.151 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.151 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.151 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.151 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.152 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.152 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.152 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.152 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.153 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.153 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.153 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.153 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.154 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root 1u unix 0xffff9dd161da5580 0t0 22677 type=STREAM 2023-10-16T12:25:51.154 INFO:teuthology.orchestra.run.smithi094.stdout:sleep 874 root 2u unix 0xffff9dd161da5580 0t0 22677 type=STREAM 2023-10-16T12:25:51.154 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.154 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.155 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony txt REG 8,1 351352 11027 /usr/sbin/chronyd 2023-10-16T12:25:51.155 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.155 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.156 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.157 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.157 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 695184 7235 /usr/lib64/libnss_myhostname.so.2 2023-10-16T12:25:51.157 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.157 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 29256 4996 /usr/lib64/libnss_dns-2.28.so 2023-10-16T12:25:51.158 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.158 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.158 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.158 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.159 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.159 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.159 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.159 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.160 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.160 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.160 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.160 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.161 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.161 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:51.161 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.162 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.162 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.162 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.162 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.163 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.163 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 1w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.163 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.163 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 3u unix 0xffff9dd16404f500 0t0 24820 type=DGRAM 2023-10-16T12:25:51.164 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 4u IPv4 33048 0t0 UDP smithi094:35425->hv04.front.sepia.ceph.com:ntp 2023-10-16T12:25:51.164 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 5r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.164 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 6u IPv4 24828 0t0 UDP localhost:323 2023-10-16T12:25:51.165 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 7u IPv6 24829 0t0 UDP localhost:323 2023-10-16T12:25:51.165 INFO:teuthology.orchestra.run.smithi094.stdout:chronyd 897 chrony 8u unix 0xffff9dd16404da00 0t0 24837 /run/chrony/chronyd.sock type=DGRAM 2023-10-16T12:25:51.165 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.165 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.166 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-10-16T12:25:51.166 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.166 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.166 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.168 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.168 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.168 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.168 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.169 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.169 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.169 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.170 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.170 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.170 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.170 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.171 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.171 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.171 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.171 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.172 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.172 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.172 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-10-16T12:25:51.172 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-10-16T12:25:51.173 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-10-16T12:25:51.173 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.173 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.174 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 1u unix 0xffff9dd164048d80 0t0 24611 type=STREAM 2023-10-16T12:25:51.174 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 2u unix 0xffff9dd164048d80 0t0 24611 type=STREAM 2023-10-16T12:25:51.174 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 3u unix 0xffff9dd16404f080 0t0 1930 /run/avahi-daemon/socket type=STREAM 2023-10-16T12:25:51.174 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 4r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.175 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 5r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T12:25:51.175 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 6u unix 0xffff9dd16404ad00 0t0 24817 type=DGRAM 2023-10-16T12:25:51.175 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 7r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:51.175 INFO:teuthology.orchestra.run.smithi094.stdout:avahi-dae 947 avahi 9u unix 0xffff9dd161d81200 0t0 22053 type=STREAM 2023-10-16T12:25:51.176 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.176 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.176 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T12:25:51.177 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 0,14 13477 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T12:25:51.177 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:51.177 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.177 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.178 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.178 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.178 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.178 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.179 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T12:25:51.179 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T12:25:51.179 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.180 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.180 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.180 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.180 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.181 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.181 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.181 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.181 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.182 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.182 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.182 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.183 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.183 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.183 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.183 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.184 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T12:25:51.184 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T12:25:51.184 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.184 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.185 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.185 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.185 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.185 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.186 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.186 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.186 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.187 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.187 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.187 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.187 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.188 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.188 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.188 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T12:25:51.188 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.189 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.189 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.189 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.189 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T12:25:51.190 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.190 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.190 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.191 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.191 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.191 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.191 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.192 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.192 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.192 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.192 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.193 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.193 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.193 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.193 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.194 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.194 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.194 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.195 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.195 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.195 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.195 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.196 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.196 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.196 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.196 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T12:25:51.197 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.197 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.197 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.197 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.198 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.198 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.198 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.198 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.199 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.199 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.199 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.200 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.200 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.200 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.200 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.201 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 1u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.201 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 2u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.201 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.201 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T12:25:51.202 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 5u netlink 0t0 26305 KOBJECT_UEVENT 2023-10-16T12:25:51.202 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 6u unix 0xffff9dd1626e3600 0t0 26331 type=STREAM 2023-10-16T12:25:51.202 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.202 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 8w CHR 10,62 0t0 3979 /dev/cpu_dma_latency 2023-10-16T12:25:51.203 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 9u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.203 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 10u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.203 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 11u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.203 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 12u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.204 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 13u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.204 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 14u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.204 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 15u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.204 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 16u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.205 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 17r FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.205 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 18w FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.205 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 19u unix 0xffff9dd16262ec00 0t0 27716 type=STREAM 2023-10-16T12:25:51.205 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 root 20u unix 0xffff9dd16262c380 0t0 27717 type=STREAM 2023-10-16T12:25:51.206 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.206 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.206 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T12:25:51.206 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 0,14 13477 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T12:25:51.207 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:51.207 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.207 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.208 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.208 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.208 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.208 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.209 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T12:25:51.209 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T12:25:51.209 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.209 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.210 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.210 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.210 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.210 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.211 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.211 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.211 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.212 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.212 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.212 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.212 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.213 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.213 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.213 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.213 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T12:25:51.214 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T12:25:51.214 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.214 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.214 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.215 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.215 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.215 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.215 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.216 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.216 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.216 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.216 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.217 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.217 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.217 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.217 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.218 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T12:25:51.218 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.218 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.218 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.219 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.219 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T12:25:51.219 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.220 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.220 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.220 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.220 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.221 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.221 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.221 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.221 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.222 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.222 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.222 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.222 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.223 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.223 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.223 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.223 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.224 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.224 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.224 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.224 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.225 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.225 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.225 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.225 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.226 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T12:25:51.226 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.226 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.226 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.227 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.227 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.227 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.228 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.228 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.228 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.228 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.229 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.229 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.229 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.229 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.230 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.230 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 1u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.230 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 2u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.230 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.231 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T12:25:51.231 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 5u netlink 0t0 26305 KOBJECT_UEVENT 2023-10-16T12:25:51.231 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 6u unix 0xffff9dd1626e3600 0t0 26331 type=STREAM 2023-10-16T12:25:51.231 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.232 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 8w CHR 10,62 0t0 3979 /dev/cpu_dma_latency 2023-10-16T12:25:51.232 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 9u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.232 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 10u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.232 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 11u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.233 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 12u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.233 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 13u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.233 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 14u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.233 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 15u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.234 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 16u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.234 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 17r FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.234 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 18w FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.234 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 19u unix 0xffff9dd16262ec00 0t0 27716 type=STREAM 2023-10-16T12:25:51.235 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1190 tuned root 20u unix 0xffff9dd16262c380 0t0 27717 type=STREAM 2023-10-16T12:25:51.235 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.235 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.236 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T12:25:51.236 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 0,14 13477 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T12:25:51.236 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:51.236 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.237 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.237 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.237 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.237 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.238 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.238 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T12:25:51.238 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T12:25:51.238 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.239 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.239 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.239 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.239 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.240 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.240 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.240 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.240 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.241 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.241 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.241 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.241 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.242 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.242 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.242 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.242 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T12:25:51.243 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T12:25:51.243 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.243 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.244 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.244 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.244 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.244 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.245 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.245 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.245 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.245 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.246 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.246 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.246 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.246 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.247 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.247 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T12:25:51.247 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.247 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.248 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.248 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.248 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T12:25:51.249 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.249 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.249 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.249 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.250 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.250 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.250 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.251 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.251 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.251 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.251 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.252 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.252 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.252 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.252 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.253 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.254 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.254 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.254 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.255 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.255 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.255 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.255 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T12:25:51.256 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.256 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.256 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.256 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.257 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.257 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.257 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.257 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.258 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.258 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.258 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.259 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.259 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.259 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.259 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.260 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 1u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.260 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 2u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.260 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T12:25:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 5u netlink 0t0 26305 KOBJECT_UEVENT 2023-10-16T12:25:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 6u unix 0xffff9dd1626e3600 0t0 26331 type=STREAM 2023-10-16T12:25:51.261 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.262 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 8w CHR 10,62 0t0 3979 /dev/cpu_dma_latency 2023-10-16T12:25:51.262 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 9u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.262 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 10u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.262 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 11u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.263 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 12u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.263 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 13u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.263 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 14u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.264 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 15u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.264 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 16u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.264 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 17r FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.264 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 18w FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.265 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 19u unix 0xffff9dd16262ec00 0t0 27716 type=STREAM 2023-10-16T12:25:51.265 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1195 tuned root 20u unix 0xffff9dd16262c380 0t0 27717 type=STREAM 2023-10-16T12:25:51.265 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.265 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.266 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T12:25:51.266 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 0,14 13477 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T12:25:51.266 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:51.266 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.267 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.267 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.267 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.267 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.268 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.268 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T12:25:51.268 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T12:25:51.268 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.269 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.269 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.269 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.269 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.270 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.270 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.270 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.271 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.271 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.271 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.271 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.272 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.272 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.272 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.272 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.273 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T12:25:51.273 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T12:25:51.273 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.273 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.274 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.274 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.274 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.274 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.275 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.275 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.275 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.275 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.276 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.276 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.276 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.276 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.277 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.277 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T12:25:51.277 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.277 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.278 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.278 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.278 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T12:25:51.278 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.279 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.280 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.281 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.282 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.282 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.282 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.283 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.283 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.283 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.283 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.284 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.284 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.284 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.284 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.285 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.285 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.285 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T12:25:51.286 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.286 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.286 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.287 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.287 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.287 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.287 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.288 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.288 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.288 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.288 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.289 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.289 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.289 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.290 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.290 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 1u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.290 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 2u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.290 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.291 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T12:25:51.291 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 5u netlink 0t0 26305 KOBJECT_UEVENT 2023-10-16T12:25:51.291 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 6u unix 0xffff9dd1626e3600 0t0 26331 type=STREAM 2023-10-16T12:25:51.291 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.292 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 8w CHR 10,62 0t0 3979 /dev/cpu_dma_latency 2023-10-16T12:25:51.292 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 9u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.292 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 10u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.292 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 11u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.293 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 12u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.293 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 13u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.293 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 14u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.293 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 15u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.294 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 16u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.294 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 17r FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.294 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 18w FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.295 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 19u unix 0xffff9dd16262ec00 0t0 27716 type=STREAM 2023-10-16T12:25:51.295 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1212 tuned root 20u unix 0xffff9dd16262c380 0t0 27717 type=STREAM 2023-10-16T12:25:51.295 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.295 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.296 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-10-16T12:25:51.296 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 0,14 13477 anon_inode:[perf_event] (stat: No such file or directory) 2023-10-16T12:25:51.296 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-10-16T12:25:51.296 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.297 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.297 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.297 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.297 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.298 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.298 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T12:25:51.298 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T12:25:51.298 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.299 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.299 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.299 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.300 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.300 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.300 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.300 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.301 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.301 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-10-16T12:25:51.301 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.301 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.302 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.302 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-10-16T12:25:51.302 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.302 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-10-16T12:25:51.303 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-10-16T12:25:51.303 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-10-16T12:25:51.303 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-10-16T12:25:51.303 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.304 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.304 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.304 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.304 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.305 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.305 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.305 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.306 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.306 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.306 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.306 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.307 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.307 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.307 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-10-16T12:25:51.307 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.308 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.308 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.308 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.308 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-10-16T12:25:51.309 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.309 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.309 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.310 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.310 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.310 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.310 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.311 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.311 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.311 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.311 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.312 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.312 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.312 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.312 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-10-16T12:25:51.313 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.313 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.313 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.313 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.314 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.314 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.314 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.315 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.315 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.315 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.315 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-10-16T12:25:51.316 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.316 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.316 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.316 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.317 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.317 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.317 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.317 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.318 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.318 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.318 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.318 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.319 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.319 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.319 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.319 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 1u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.320 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 2u unix 0xffff9dcc51066780 0t0 26685 type=STREAM 2023-10-16T12:25:51.320 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.320 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 4w REG 8,1 25291 66484 /var/log/tuned/tuned.log 2023-10-16T12:25:51.320 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 5u netlink 0t0 26305 KOBJECT_UEVENT 2023-10-16T12:25:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 6u unix 0xffff9dd1626e3600 0t0 26331 type=STREAM 2023-10-16T12:25:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 7u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 8w CHR 10,62 0t0 3979 /dev/cpu_dma_latency 2023-10-16T12:25:51.321 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 9u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.322 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 10u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.322 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 11u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.322 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 12u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.323 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 13u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.323 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 14u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.323 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 15u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.323 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 16u a_inode 0,14 0 13477 [perf_event] 2023-10-16T12:25:51.324 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 17r FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.324 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 18w FIFO 0,13 0t0 23828 pipe 2023-10-16T12:25:51.324 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 19u unix 0xffff9dd16262ec00 0t0 27716 type=STREAM 2023-10-16T12:25:51.324 INFO:teuthology.orchestra.run.smithi094.stdout:tuned 955 1213 tuned root 20u unix 0xffff9dd16262c380 0t0 27717 type=STREAM 2023-10-16T12:25:51.325 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.325 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.325 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.325 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root DEL REG 8,1 20335 /var/lib/sss/mc/group 2023-10-16T12:25:51.326 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.326 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.326 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.326 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.327 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.327 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.327 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.327 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.328 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.328 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.328 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.328 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.329 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.330 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.330 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.330 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.330 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.331 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.331 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.331 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.331 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.332 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.332 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.332 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.333 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.333 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.333 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.333 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.334 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.334 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.334 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.334 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.335 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 1u unix 0xffff9dcc51065580 0t0 26758 type=STREAM 2023-10-16T12:25:51.335 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 2u unix 0xffff9dcc51065580 0t0 26758 type=STREAM 2023-10-16T12:25:51.335 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 3r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.335 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 4u IPv4 23147 0t0 TCP *:ssh (LISTEN) 2023-10-16T12:25:51.336 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 5r REG 8,1 6940392 20335 /var/lib/sss/mc/group (deleted) 2023-10-16T12:25:51.336 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 957 root 6u IPv6 23149 0t0 TCP *:ssh (LISTEN) 2023-10-16T12:25:51.336 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.336 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.337 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root txt REG 8,1 25704 10732 /usr/bin/rhsmcertd 2023-10-16T12:25:51.337 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.337 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.337 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.338 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.338 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.338 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.338 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.339 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.339 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.339 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.340 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.340 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-10-16T12:25:51.340 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.340 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.341 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-10-16T12:25:51.341 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.341 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.341 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.342 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.342 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.342 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.342 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.343 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.343 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.343 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.343 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.344 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.344 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.344 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.344 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.345 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.345 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root 3wW REG 0,24 0 22847 /run/lock/subsys/rhsmcertd 2023-10-16T12:25:51.345 INFO:teuthology.orchestra.run.smithi094.stdout:rhsmcertd 959 root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.346 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.346 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.346 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root txt REG 8,1 237976 50943 /usr/libexec/sssd/sssd_be 2023-10-16T12:25:51.346 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 68288 8465 /usr/lib64/libsss_certmap.so.0.2.0 2023-10-16T12:25:51.347 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 58096 32121 /usr/lib64/sssd/libsss_files.so 2023-10-16T12:25:51.347 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.347 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root DEL REG 8,1 20342 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.347 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root DEL REG 8,1 20334 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.348 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.348 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T12:25:51.348 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T12:25:51.349 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.349 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-10-16T12:25:51.349 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-10-16T12:25:51.349 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-10-16T12:25:51.350 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-10-16T12:25:51.350 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-10-16T12:25:51.350 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-10-16T12:25:51.351 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-10-16T12:25:51.351 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-10-16T12:25:51.351 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-10-16T12:25:51.351 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-10-16T12:25:51.352 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-10-16T12:25:51.352 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-10-16T12:25:51.352 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-10-16T12:25:51.352 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-10-16T12:25:51.353 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.353 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.353 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.353 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.354 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.354 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.354 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.355 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.355 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:51.355 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.355 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:51.356 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:51.356 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-10-16T12:25:51.356 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-10-16T12:25:51.356 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.357 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.357 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.357 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.357 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.358 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.358 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.358 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.359 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.359 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.359 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.359 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.360 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.360 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.360 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.360 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.361 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.361 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.361 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-10-16T12:25:51.362 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-10-16T12:25:51.362 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-10-16T12:25:51.362 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-10-16T12:25:51.362 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-10-16T12:25:51.363 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.363 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-10-16T12:25:51.363 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.363 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-10-16T12:25:51.364 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-10-16T12:25:51.364 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-10-16T12:25:51.364 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.365 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.365 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.365 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.365 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.366 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-10-16T12:25:51.366 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.366 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-10-16T12:25:51.367 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.367 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.367 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-10-16T12:25:51.367 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.368 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 79176 6499 /usr/lib64/libcares.so.2.2.0 2023-10-16T12:25:51.368 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.368 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.368 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T12:25:51.369 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.369 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.369 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.370 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.370 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.370 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.370 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.371 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.371 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.371 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.372 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.372 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.372 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 0w REG 8,1 102823 66778 /var/log/sssd/sssd_implicit_files.log 2023-10-16T12:25:51.372 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 1u unix 0xffff9dcc51067500 0t0 21248 type=STREAM 2023-10-16T12:25:51.373 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 2u unix 0xffff9dcc51067500 0t0 21248 type=STREAM 2023-10-16T12:25:51.373 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 3u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.373 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.373 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.374 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.374 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T12:25:51.374 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 8r FIFO 0,13 0t0 26976 pipe 2023-10-16T12:25:51.375 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 9w FIFO 0,13 0t0 26976 pipe 2023-10-16T12:25:51.375 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 10u unix 0xffff9dcc51065a00 0t0 26977 type=DGRAM 2023-10-16T12:25:51.375 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 11u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.376 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 12u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T12:25:51.376 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 13u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.376 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 14u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T12:25:51.376 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 15u unix 0xffff9dcc51067980 0t0 26978 /var/lib/sss/pipes/private/sbus-dp_implicit_files.963 type=STREAM 2023-10-16T12:25:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 16u unix 0xffff9dcc51064380 0t0 26979 type=STREAM 2023-10-16T12:25:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 17u unix 0xffff9dcc51066c00 0t0 26980 /var/lib/sss/pipes/private/sbus-dp_implicit_files.963 type=STREAM 2023-10-16T12:25:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 18r REG 8,1 9253600 20334 /var/lib/sss/mc/passwd (deleted) 2023-10-16T12:25:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 19r REG 8,1 11567160 20342 /var/lib/sss/mc/initgroups (deleted) 2023-10-16T12:25:51.378 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 20r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.378 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 21r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.378 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 22u unix 0xffff9dcc0b1a5e80 0t0 27074 type=STREAM 2023-10-16T12:25:51.379 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_be 963 root 23u unix 0xffff9dd161da2880 0t0 27077 /var/lib/sss/pipes/private/sbus-dp_implicit_files.963 type=STREAM 2023-10-16T12:25:51.379 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.379 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.379 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T12:25:51.380 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T12:25:51.380 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T12:25:51.380 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.380 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.381 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.381 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.381 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.383 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.383 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.383 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.383 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T12:25:51.384 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.384 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.384 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.384 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.385 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.385 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T12:25:51.385 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.386 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.386 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.386 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.386 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.387 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.387 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.387 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.387 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.388 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.388 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.388 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.388 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.389 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.389 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.389 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.390 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.390 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.390 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 1u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.390 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 2u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.391 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 3u unix 0xffff9dd16404d580 0t0 25094 type=DGRAM 2023-10-16T12:25:51.391 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 4r FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.391 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.392 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 6r FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.392 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 7w FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.392 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 8u unix 0xffff9dd164049200 0t0 25097 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T12:25:51.392 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 9u unix 0xffff9dd16404d100 0t0 25098 /run/gssproxy.sock type=STREAM 2023-10-16T12:25:51.393 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 root 10w FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.393 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.393 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.393 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T12:25:51.394 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T12:25:51.394 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T12:25:51.394 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.395 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.395 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.395 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.395 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.396 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.396 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.396 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.396 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.397 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.397 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.397 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.397 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T12:25:51.398 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.398 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.398 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.399 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.399 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.399 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T12:25:51.399 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.400 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.400 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.400 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.400 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.401 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.401 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.401 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.401 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.402 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.402 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.402 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.403 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.403 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.403 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.403 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.404 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.404 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.404 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 1u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.405 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 2u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.405 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 3u unix 0xffff9dd16404d580 0t0 25094 type=DGRAM 2023-10-16T12:25:51.405 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 4r FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.405 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.406 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 6r FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.406 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 7w FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.406 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 8u unix 0xffff9dd164049200 0t0 25097 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T12:25:51.407 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 9u unix 0xffff9dd16404d100 0t0 25098 /run/gssproxy.sock type=STREAM 2023-10-16T12:25:51.407 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 970 gssproxy root 10w FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.407 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.407 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.408 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T12:25:51.408 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T12:25:51.408 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T12:25:51.408 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.409 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.409 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.409 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.409 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.410 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.410 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.410 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.411 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.411 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.411 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.411 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.412 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T12:25:51.412 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.412 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.413 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.413 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.413 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.413 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T12:25:51.414 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.414 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.414 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.414 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.415 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.415 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.415 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.416 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.416 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.416 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.416 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.417 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.417 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.417 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.418 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.418 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.418 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.418 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.419 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 1u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.419 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 2u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.419 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 3u unix 0xffff9dd16404d580 0t0 25094 type=DGRAM 2023-10-16T12:25:51.419 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 4r FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.420 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.420 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 6r FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.420 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 7w FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.421 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 8u unix 0xffff9dd164049200 0t0 25097 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T12:25:51.421 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 9u unix 0xffff9dd16404d100 0t0 25098 /run/gssproxy.sock type=STREAM 2023-10-16T12:25:51.421 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 971 gssproxy root 10w FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.421 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.422 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.422 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T12:25:51.422 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T12:25:51.422 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T12:25:51.423 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.423 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.423 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.424 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.424 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.424 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.424 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.425 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.425 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.425 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.425 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.426 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.426 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T12:25:51.426 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.427 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.427 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.427 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.427 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.428 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T12:25:51.428 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.428 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.428 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.429 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.429 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.429 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.429 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.430 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.430 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.430 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.431 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.431 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.431 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.431 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.432 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.432 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.432 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.432 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.433 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 1u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.433 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 2u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.433 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 3u unix 0xffff9dd16404d580 0t0 25094 type=DGRAM 2023-10-16T12:25:51.433 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 4r FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.434 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.434 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 6r FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.434 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 7w FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.435 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 8u unix 0xffff9dd164049200 0t0 25097 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T12:25:51.435 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 9u unix 0xffff9dd16404d100 0t0 25098 /run/gssproxy.sock type=STREAM 2023-10-16T12:25:51.435 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 972 gssproxy root 10w FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.435 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.436 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.436 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T12:25:51.436 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T12:25:51.436 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T12:25:51.437 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.437 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.437 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.437 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.438 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.438 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.438 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.439 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.439 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.439 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.439 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.440 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.440 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T12:25:51.440 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.440 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.441 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.441 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.441 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.441 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T12:25:51.442 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.442 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.442 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.443 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.444 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.445 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.445 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.445 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.446 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.446 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.446 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.446 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.447 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 1u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.447 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 2u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.447 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 3u unix 0xffff9dd16404d580 0t0 25094 type=DGRAM 2023-10-16T12:25:51.448 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 4r FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.448 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.448 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 6r FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.448 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 7w FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.449 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 8u unix 0xffff9dd164049200 0t0 25097 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T12:25:51.449 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 9u unix 0xffff9dd16404d100 0t0 25098 /run/gssproxy.sock type=STREAM 2023-10-16T12:25:51.449 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 973 gssproxy root 10w FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.449 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.450 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.450 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-10-16T12:25:51.450 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-10-16T12:25:51.450 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-10-16T12:25:51.451 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.451 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.451 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.452 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.452 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.452 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.452 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.453 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.453 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.453 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.454 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.454 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.454 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-10-16T12:25:51.454 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.455 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.455 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.455 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.455 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.456 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-10-16T12:25:51.456 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.456 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.457 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.457 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.457 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.457 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.458 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.458 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.458 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.459 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.459 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.459 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.459 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.460 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.460 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.460 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.460 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.461 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.461 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 1u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.461 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 2u unix 0xffff9dcc51066300 0t0 26831 type=STREAM 2023-10-16T12:25:51.462 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 3u unix 0xffff9dd16404d580 0t0 25094 type=DGRAM 2023-10-16T12:25:51.462 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 4r FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.462 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.462 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 6r FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.463 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 7w FIFO 0,13 0t0 25096 pipe 2023-10-16T12:25:51.463 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 8u unix 0xffff9dd164049200 0t0 25097 /var/lib/gssproxy/default.sock type=STREAM 2023-10-16T12:25:51.463 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 9u unix 0xffff9dd16404d100 0t0 25098 /run/gssproxy.sock type=STREAM 2023-10-16T12:25:51.463 INFO:teuthology.orchestra.run.smithi094.stdout:gssproxy 968 974 gssproxy root 10w FIFO 0,13 0t0 25102 pipe 2023-10-16T12:25:51.464 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.464 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.464 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root txt REG 8,1 305856 50945 /usr/libexec/sssd/sssd_nss 2023-10-16T12:25:51.465 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem-w REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.465 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem-w REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.465 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem-w REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.465 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T12:25:51.466 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T12:25:51.466 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.466 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-10-16T12:25:51.467 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-10-16T12:25:51.467 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-10-16T12:25:51.467 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-10-16T12:25:51.467 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-10-16T12:25:51.468 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-10-16T12:25:51.468 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-10-16T12:25:51.468 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-10-16T12:25:51.468 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-10-16T12:25:51.469 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-10-16T12:25:51.469 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-10-16T12:25:51.469 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-10-16T12:25:51.470 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-10-16T12:25:51.470 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-10-16T12:25:51.470 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.470 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.471 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.471 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.471 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.471 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.472 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.472 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.472 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:51.473 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.473 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:51.473 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:51.473 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-10-16T12:25:51.474 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-10-16T12:25:51.474 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.474 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.475 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.475 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.475 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.475 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.476 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.476 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.476 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.476 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.477 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.477 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T12:25:51.477 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.477 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.478 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.478 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.478 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-10-16T12:25:51.479 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-10-16T12:25:51.479 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-10-16T12:25:51.479 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-10-16T12:25:51.480 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-10-16T12:25:51.480 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.480 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-10-16T12:25:51.480 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.481 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-10-16T12:25:51.481 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-10-16T12:25:51.481 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-10-16T12:25:51.481 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-10-16T12:25:51.482 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T12:25:51.482 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-10-16T12:25:51.483 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.483 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-10-16T12:25:51.483 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.483 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-10-16T12:25:51.484 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-10-16T12:25:51.484 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.484 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-10-16T12:25:51.485 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-10-16T12:25:51.485 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 28888 5451 /usr/lib64/libsss_idmap.so.0.5.1 2023-10-16T12:25:51.485 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.485 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.486 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T12:25:51.486 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.486 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.486 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.487 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.487 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.487 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.488 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.488 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.488 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.488 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.489 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.489 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.489 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 0w REG 8,1 168853 66816 /var/log/sssd/sssd_nss.log 2023-10-16T12:25:51.489 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 1u unix 0xffff9dcc51067500 0t0 21248 type=STREAM 2023-10-16T12:25:51.490 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 2u unix 0xffff9dcc51067500 0t0 21248 type=STREAM 2023-10-16T12:25:51.490 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 3u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.490 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 4u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.490 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 5u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.491 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.491 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-10-16T12:25:51.491 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 8r FIFO 0,13 0t0 25147 pipe 2023-10-16T12:25:51.491 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 9w FIFO 0,13 0t0 25147 pipe 2023-10-16T12:25:51.492 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 10u unix 0xffff9dd16404e300 0t0 25148 type=DGRAM 2023-10-16T12:25:51.492 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 11u unix 0xffff9dd161da6c00 0t0 23187 type=STREAM 2023-10-16T12:25:51.492 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 12u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.493 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 13u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-10-16T12:25:51.493 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 14u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.493 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 15u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-10-16T12:25:51.493 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 16u unix 0xffff9dd161da3a80 0t0 23201 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.494 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 17uw REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.494 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 18uw REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.494 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 19uw REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.494 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 20u unix 0xffff9dd161da1680 0t0 23202 type=STREAM 2023-10-16T12:25:51.495 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 21u unix 0xffff9dd161da1f80 0t0 25254 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.495 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 22u unix 0xffff9dd161d83180 0t0 25256 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.495 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 23u unix 0xffff9dd1626e7080 0t0 25284 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.495 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 24u unix 0xffff9dd1633a0900 0t0 25584 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.496 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 25u unix 0xffff9dcc0bf42400 0t0 25585 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.496 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 26u unix 0xffff9dd16262a880 0t0 32789 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.496 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 27u unix 0xffff9dcc0bf43a80 0t0 25591 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.497 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 28u unix 0xffff9dcc0bf40480 0t0 32795 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.497 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 29u unix 0xffff9dcc0b1a4c80 0t0 32800 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.497 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 30u unix 0xffff9dd16262c800 0t0 32816 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.497 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 31u unix 0xffff9dcc0b1a2d00 0t0 32818 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.498 INFO:teuthology.orchestra.run.smithi094.stdout:sssd_nss 1005 root 32u unix 0xffff9dd16262b180 0t0 31489 /var/lib/sss/pipes/nss type=STREAM 2023-10-16T12:25:51.498 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.498 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.498 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root txt REG 8,1 467608 14012 /usr/sbin/cupsd 2023-10-16T12:25:51.499 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.499 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.499 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.499 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.500 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.500 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.500 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.501 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.501 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.501 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.501 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-10-16T12:25:51.502 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.502 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.502 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.502 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.503 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.503 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.503 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.503 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.504 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.504 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.504 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.505 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:51.505 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.505 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-10-16T12:25:51.505 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-10-16T12:25:51.506 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-10-16T12:25:51.506 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-10-16T12:25:51.506 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.506 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.507 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T12:25:51.507 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.507 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.507 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.508 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.508 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.508 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.509 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.509 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.509 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 629504 8599 /usr/lib64/libcups.so.2 2023-10-16T12:25:51.509 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 74352 8596 /usr/lib64/libavahi-client.so.3.2.9 2023-10-16T12:25:51.510 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-10-16T12:25:51.510 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.510 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-10-16T12:25:51.510 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:51.511 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.511 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.511 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-10-16T12:25:51.512 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.512 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 28936 8602 /usr/lib64/libcupsmime.so.1 2023-10-16T12:25:51.512 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.512 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.513 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.513 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.513 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 1u unix 0xffff9dd161da0900 0t0 23364 type=STREAM 2023-10-16T12:25:51.513 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 2u unix 0xffff9dd161da0900 0t0 23364 type=STREAM 2023-10-16T12:25:51.514 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 3u unix 0xffff9dd164049680 0t0 1934 /var/run/cups/cups.sock type=STREAM 2023-10-16T12:25:51.514 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.514 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 5r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.515 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 6u unix 0xffff9dd161da4c80 0t0 23381 type=STREAM 2023-10-16T12:25:51.515 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 7r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.515 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 8u unix 0xffff9dd161da4380 0t0 23415 type=STREAM 2023-10-16T12:25:51.515 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 9u IPv6 23416 0t0 TCP localhost:ipp (LISTEN) 2023-10-16T12:25:51.516 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 10u IPv4 23417 0t0 TCP localhost:ipp (LISTEN) 2023-10-16T12:25:51.516 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 11r FIFO 0,13 0t0 23418 pipe 2023-10-16T12:25:51.516 INFO:teuthology.orchestra.run.smithi094.stdout:cupsd 1026 root 12w FIFO 0,13 0t0 23418 pipe 2023-10-16T12:25:51.516 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root txt REG 8,1 259272 8128 /usr/lib/systemd/systemd-logind 2023-10-16T12:25:51.517 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.518 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T12:25:51.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.519 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T12:25:51.520 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T12:25:51.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.521 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:51.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.522 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:51.523 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T12:25:51.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.524 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.525 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:51.526 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T12:25:51.526 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.526 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T12:25:51.526 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T12:25:51.527 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.527 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 1u unix 0xffff9dd161d85100 0t0 22212 type=STREAM 2023-10-16T12:25:51.527 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 2u unix 0xffff9dd161d85100 0t0 22212 type=STREAM 2023-10-16T12:25:51.527 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 3u unix 0xffff9dd161d80480 0t0 22220 type=DGRAM 2023-10-16T12:25:51.528 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.528 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 5u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:51.528 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 6u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.528 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 7r REG 0,21 4096 22179 /sys/devices/virtual/tty/tty0/active 2023-10-16T12:25:51.529 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 8u netlink 0t0 22226 KOBJECT_UEVENT 2023-10-16T12:25:51.529 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 9u netlink 0t0 22227 KOBJECT_UEVENT 2023-10-16T12:25:51.529 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 10u netlink 0t0 22228 KOBJECT_UEVENT 2023-10-16T12:25:51.530 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 11u netlink 0t0 22229 KOBJECT_UEVENT 2023-10-16T12:25:51.530 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 12u unix 0xffff9dd161d82d00 0t0 22230 type=STREAM 2023-10-16T12:25:51.530 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 13u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.530 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 14u CHR 13,65 0t0 2183 /dev/input/event1 2023-10-16T12:25:51.531 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 15u CHR 13,64 0t0 2182 /dev/input/event0 2023-10-16T12:25:51.531 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 16u CHR 13,66 0t0 2235 /dev/input/event2 2023-10-16T12:25:51.531 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 17u CHR 4,6 0t0 2070 /dev/tty6 2023-10-16T12:25:51.532 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 18r FIFO 0,24 0t0 26294 /run/systemd/inhibit/1.ref 2023-10-16T12:25:51.532 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 19r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.532 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 20r FIFO 0,24 0t0 29922 /run/systemd/sessions/1.ref 2023-10-16T12:25:51.532 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 21r FIFO 0,24 0t0 30130 /run/systemd/sessions/3.ref 2023-10-16T12:25:51.533 INFO:teuthology.orchestra.run.smithi094.stdout:systemd-l 1027 root 22r FIFO 0,24 0t0 30136 /run/systemd/sessions/4.ref 2023-10-16T12:25:51.533 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.533 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.533 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root txt REG 8,1 75704 8472 /usr/sbin/crond 2023-10-16T12:25:51.534 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.534 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.534 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.535 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.535 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.535 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.535 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.536 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.536 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.536 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.536 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.537 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.537 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.537 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.538 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.538 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.538 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.538 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.539 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.539 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.539 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.540 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.540 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.540 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.540 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.541 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.541 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 1u unix 0xffff9dd1626e1f80 0t0 26275 type=STREAM 2023-10-16T12:25:51.541 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 2u unix 0xffff9dd1626e1f80 0t0 26275 type=STREAM 2023-10-16T12:25:51.542 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 3uW REG 0,24 5 26279 /run/crond.pid 2023-10-16T12:25:51.542 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 4u unix 0xffff9dd1626e6300 0t0 26280 type=DGRAM 2023-10-16T12:25:51.542 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 5r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.542 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 7r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.543 INFO:teuthology.orchestra.run.smithi094.stdout:crond 1029 root 8u unix 0xffff9dd1626e0480 0t0 26302 type=STREAM 2023-10-16T12:25:51.543 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root cwd DIR 8,1 4096 66695 /var/spool/at 2023-10-16T12:25:51.543 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.543 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root txt REG 8,1 34144 9429 /usr/sbin/atd 2023-10-16T12:25:51.544 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.544 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.544 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.545 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.545 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.545 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.545 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.546 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.546 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.546 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.546 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.547 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.547 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.547 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.547 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.548 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.548 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.548 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.549 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 3r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.549 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 4u unix 0xffff9dd161d81f80 0t0 22216 type=STREAM 2023-10-16T12:25:51.549 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 5r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.549 INFO:teuthology.orchestra.run.smithi094.stdout:atd 1031 root 6uW REG 0,24 5 22219 /run/atd.pid 2023-10-16T12:25:51.550 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 1032 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.550 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 1032 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.550 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/5 1032 root txt unknown /proc/1032/exe 2023-10-16T12:25:51.551 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.551 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.551 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe txt REG 8,1 82312 32484 /usr/sbin/nrpe 2023-10-16T12:25:51.551 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.552 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.552 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.552 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.552 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.553 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.553 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.553 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.553 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.554 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.554 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.554 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 1w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.555 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 2w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.555 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 3r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.555 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 4u unix 0xffff9dd161d85a00 0t0 29716 type=DGRAM 2023-10-16T12:25:51.555 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 5r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.556 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 6u IPv4 29725 0t0 TCP *:nrpe (LISTEN) 2023-10-16T12:25:51.556 INFO:teuthology.orchestra.run.smithi094.stdout:nrpe 1235 nrpe 7u IPv6 29726 0t0 TCP *:nrpe (LISTEN) 2023-10-16T12:25:51.556 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.557 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.557 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-10-16T12:25:51.557 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:51.557 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-10-16T12:25:51.558 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T12:25:51.558 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.558 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-10-16T12:25:51.558 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.559 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.559 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.559 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.560 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.560 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.560 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.560 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.561 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.561 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.561 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.561 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.562 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.562 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T12:25:51.562 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-10-16T12:25:51.563 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.563 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.563 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.564 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.564 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.564 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.564 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 1w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.565 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 2w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.565 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 3r CHR 1,9 0t0 2056 /dev/urandom 2023-10-16T12:25:51.565 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 4u unix 0xffff9dd164049b00 0t0 25515 type=DGRAM 2023-10-16T12:25:51.566 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 5w REG 8,1 978371 66911 /var/log/messages 2023-10-16T12:25:51.566 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 6r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.566 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 7w REG 8,1 381947 66912 /var/log/secure 2023-10-16T12:25:51.566 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 8w REG 8,1 4843 66853 /var/log/cron 2023-10-16T12:25:51.567 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 root 9r REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:51.567 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.567 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.567 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-10-16T12:25:51.568 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:51.568 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-10-16T12:25:51.568 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T12:25:51.568 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.569 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-10-16T12:25:51.569 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.569 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.570 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.570 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.570 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.570 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.571 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.571 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.571 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.571 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.572 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.572 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.572 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.572 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T12:25:51.573 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-10-16T12:25:51.573 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.573 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.573 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.574 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.574 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.574 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.575 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 1w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.575 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 2w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.575 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 3r CHR 1,9 0t0 2056 /dev/urandom 2023-10-16T12:25:51.575 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 4u unix 0xffff9dd164049b00 0t0 25515 type=DGRAM 2023-10-16T12:25:51.576 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 5w REG 8,1 978371 66911 /var/log/messages 2023-10-16T12:25:51.576 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 6r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.576 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 7w REG 8,1 381947 66912 /var/log/secure 2023-10-16T12:25:51.576 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 8w REG 8,1 4843 66853 /var/log/cron 2023-10-16T12:25:51.577 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1284 in:imjour root 9r REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:51.577 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.577 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.577 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-10-16T12:25:51.578 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:51.578 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-10-16T12:25:51.578 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T12:25:51.578 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.579 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-10-16T12:25:51.579 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.579 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.579 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.580 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.580 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.580 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.580 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.581 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.581 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.581 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.581 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.582 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.582 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.582 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T12:25:51.583 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-10-16T12:25:51.583 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.583 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.583 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.584 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.584 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.584 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.584 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 1w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.585 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 2w CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.585 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 3r CHR 1,9 0t0 2056 /dev/urandom 2023-10-16T12:25:51.585 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 4u unix 0xffff9dd164049b00 0t0 25515 type=DGRAM 2023-10-16T12:25:51.585 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 5w REG 8,1 978371 66911 /var/log/messages 2023-10-16T12:25:51.586 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 6r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.586 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 7w REG 8,1 381947 66912 /var/log/secure 2023-10-16T12:25:51.586 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 8w REG 8,1 4843 66853 /var/log/cron 2023-10-16T12:25:51.586 INFO:teuthology.orchestra.run.smithi094.stdout:rsyslogd 1237 1291 rs:main root 9r REG 0,24 8388608 15097 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-10-16T12:25:51.587 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.587 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.587 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-10-16T12:25:51.587 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.588 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.588 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.588 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.588 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.589 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.589 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.589 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.589 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.590 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.590 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.590 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.591 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.591 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.591 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.591 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.592 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.592 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root 0u CHR 4,65 0t0 2157 /dev/ttyS1 2023-10-16T12:25:51.592 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root 1u CHR 4,65 0t0 2157 /dev/ttyS1 2023-10-16T12:25:51.592 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root 2u CHR 4,65 0t0 2157 /dev/ttyS1 2023-10-16T12:25:51.593 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root 3r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.593 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root 4u unix 0xffff9dcc0bf44c80 0t0 31828 type=STREAM 2023-10-16T12:25:51.593 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1640 root 6r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.593 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.594 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.594 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-10-16T12:25:51.594 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.594 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.595 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.595 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.595 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root mem REG 8,1 337024 17652 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T12:25:51.595 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.596 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root 0u CHR 4,1 0t0 2065 /dev/tty1 2023-10-16T12:25:51.596 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root 1u CHR 4,1 0t0 2065 /dev/tty1 2023-10-16T12:25:51.596 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root 2u CHR 4,1 0t0 2065 /dev/tty1 2023-10-16T12:25:51.597 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root 3r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.597 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root 4u unix 0xffff9dd1633a5100 0t0 24165 type=STREAM 2023-10-16T12:25:51.597 INFO:teuthology.orchestra.run.smithi094.stdout:agetty 1641 root 6r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.597 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 1644 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.598 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 1644 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.598 INFO:teuthology.orchestra.run.smithi094.stdout:kworker/3 1644 root txt unknown /proc/1644/exe 2023-10-16T12:25:51.598 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.598 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.599 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.599 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.599 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.600 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.600 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T12:25:51.600 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T12:25:51.600 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.601 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.601 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.601 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.601 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T12:25:51.602 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.602 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T12:25:51.602 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.602 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.603 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.603 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.603 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.603 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.604 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T12:25:51.604 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T12:25:51.604 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.604 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.605 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.605 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.605 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.605 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.606 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.606 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.606 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.606 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.607 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.607 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.607 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.607 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.608 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.608 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.608 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.608 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.609 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.609 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.609 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.610 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.610 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.610 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.610 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.611 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.611 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.611 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.612 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.612 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.612 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.612 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.613 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.613 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.613 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.614 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.614 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.614 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.614 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.615 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.615 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.615 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.615 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.616 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.616 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.616 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.617 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 3u unix 0xffff9dcc0bf47500 0t0 31992 type=DGRAM 2023-10-16T12:25:51.617 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 4r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.617 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 5u IPv4 31855 0t0 TCP smithi094:ssh->teuthology.front.sepia.ceph.com:49368 (ESTABLISHED) 2023-10-16T12:25:51.617 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 6u unix 0xffff9dd16262cc80 0t0 28195 type=STREAM 2023-10-16T12:25:51.618 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 7r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.618 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 8r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.618 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 9u unix 0xffff9dd162629200 0t0 28199 type=STREAM 2023-10-16T12:25:51.619 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 11w FIFO 0,24 0t0 29922 /run/systemd/sessions/1.ref 2023-10-16T12:25:51.619 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1669 root 12u unix 0xffff9dcc0bf45e80 0t0 31996 type=STREAM 2023-10-16T12:25:51.619 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.619 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.620 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-16T12:25:51.620 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.620 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.620 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T12:25:51.621 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.621 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.621 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T12:25:51.622 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T12:25:51.622 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:51.622 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.622 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.623 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.623 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.623 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.624 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.624 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.624 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.624 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.625 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.625 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.625 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.626 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T12:25:51.626 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:51.626 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.626 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.627 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.627 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.627 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T12:25:51.627 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.628 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.628 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.628 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.629 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:51.629 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.629 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T12:25:51.630 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.630 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.630 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 1u unix 0xffff9dcc0bf41f80 0t0 31942 type=STREAM 2023-10-16T12:25:51.630 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 2u unix 0xffff9dcc0bf41f80 0t0 31942 type=STREAM 2023-10-16T12:25:51.631 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 3u unix 0xffff9dcc0bf41680 0t0 31959 type=DGRAM 2023-10-16T12:25:51.631 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 4u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.631 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 5u a_inode 0,14 0 13477 [signalfd] 2023-10-16T12:25:51.631 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 6r DIR 0,26 0 808 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-10-16T12:25:51.632 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 7u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.632 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 8u netlink 0t0 31966 KOBJECT_UEVENT 2023-10-16T12:25:51.632 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 9u a_inode 0,14 0 13477 [eventpoll] 2023-10-16T12:25:51.632 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 10r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.633 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 11u unix 0xffff9dcc0bf44380 0t0 31984 /run/user/1000/bus type=STREAM 2023-10-16T12:25:51.633 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 12r REG 0,5 0 31971 /proc/1674/mountinfo 2023-10-16T12:25:51.633 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 13r a_inode 0,14 0 13477 inotify 2023-10-16T12:25:51.633 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-10-16T12:25:51.634 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 15u unix 0xffff9dcc0bf46300 0t0 31972 /run/user/1000/systemd/notify type=DGRAM 2023-10-16T12:25:51.634 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 16u unix 0xffff9dcc0bf43600 0t0 31974 type=DGRAM 2023-10-16T12:25:51.634 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 17u unix 0xffff9dcc0bf43180 0t0 31975 type=DGRAM 2023-10-16T12:25:51.635 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 18u unix 0xffff9dcc0bf40d80 0t0 31976 /run/user/1000/systemd/private type=STREAM 2023-10-16T12:25:51.635 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 19u unix 0xffff9dcc0bf42d00 0t0 31978 type=STREAM 2023-10-16T12:25:51.635 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 20u a_inode 0,14 0 13477 [timerfd] 2023-10-16T12:25:51.635 INFO:teuthology.orchestra.run.smithi094.stdout:systemd 1674 ubuntu 26u netlink 0t0 31987 SELINUX 2023-10-16T12:25:51.636 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.636 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.636 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-16T12:25:51.636 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.637 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.637 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.637 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.637 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.638 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.638 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.638 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.638 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.639 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.639 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.639 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.640 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.640 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.640 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.640 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.641 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.641 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.641 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.641 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.642 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.642 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.642 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.643 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.643 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.643 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.643 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.644 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.644 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-16T12:25:51.644 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-16T12:25:51.644 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-16T12:25:51.645 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-16T12:25:51.645 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.645 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-16T12:25:51.645 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-16T12:25:51.646 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-16T12:25:51.646 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.646 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.647 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.647 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.647 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.647 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.648 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.648 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.648 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.648 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.649 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-16T12:25:51.649 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.649 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-16T12:25:51.649 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-16T12:25:51.650 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.650 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.650 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.650 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.651 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-16T12:25:51.651 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.651 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.651 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.652 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.652 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T12:25:51.652 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.653 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-16T12:25:51.653 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.653 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 574801 1740 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T12:25:51.653 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu mem REG 8,1 19983 1496 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T12:25:51.654 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 0r CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.654 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 1u unix 0xffff9dcc0bf41f80 0t0 31942 type=STREAM 2023-10-16T12:25:51.654 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 2u unix 0xffff9dcc0bf41f80 0t0 31942 type=STREAM 2023-10-16T12:25:51.654 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 3r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.655 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 4r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.655 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 5u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.655 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 6u a_inode 0,14 0 13477 [eventfd] 2023-10-16T12:25:51.656 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 8w FIFO 0,13 0t0 31943 pipe 2023-10-16T12:25:51.656 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 9u unix 0xffff9dcc0bf45100 0t0 31955 type=STREAM 2023-10-16T12:25:51.656 INFO:teuthology.orchestra.run.smithi094.stdout:(sd-pam) 1677 ubuntu 10u unix 0xffff9dcc0bf47080 0t0 31956 type=DGRAM 2023-10-16T12:25:51.656 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.657 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.657 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.657 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.657 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.658 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.658 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T12:25:51.658 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T12:25:51.658 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.659 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.659 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.659 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.660 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T12:25:51.660 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.660 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T12:25:51.660 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.661 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.661 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.661 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.661 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.662 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.662 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T12:25:51.662 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T12:25:51.662 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.663 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.663 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.663 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.663 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.664 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.664 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.664 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.664 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.665 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.665 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.665 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.666 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.666 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.666 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.666 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.667 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.667 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.667 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.668 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.668 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.668 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.668 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.669 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.669 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.669 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.669 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.670 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.670 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.670 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.670 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.671 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.672 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.672 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.672 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.672 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.673 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.673 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.673 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.673 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.674 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.674 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.674 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.675 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 3u unix 0xffff9dcc0bf47500 0t0 31992 type=DGRAM 2023-10-16T12:25:51.675 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 4r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.675 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 5u IPv4 31855 0t0 TCP smithi094:ssh->teuthology.front.sepia.ceph.com:49368 (ESTABLISHED) 2023-10-16T12:25:51.675 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 6u unix 0xffff9dd16262cc80 0t0 28195 type=STREAM 2023-10-16T12:25:51.676 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 7r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.676 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 8r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.676 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 9u unix 0xffff9dd162629200 0t0 28199 type=STREAM 2023-10-16T12:25:51.676 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 10u unix 0xffff9dcc0bf45a00 0t0 31995 type=STREAM 2023-10-16T12:25:51.677 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 11w FIFO 0,24 0t0 29922 /run/systemd/sessions/1.ref 2023-10-16T12:25:51.677 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 12r FIFO 0,13 0t0 27413 pipe 2023-10-16T12:25:51.677 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1683 ubuntu 13w FIFO 0,13 0t0 27413 pipe 2023-10-16T12:25:51.677 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.678 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.678 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.678 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.679 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.679 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.679 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T12:25:51.679 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T12:25:51.680 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.680 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.680 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.680 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.681 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T12:25:51.681 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.681 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T12:25:51.682 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.682 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.682 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.682 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.683 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.683 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.683 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T12:25:51.683 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T12:25:51.684 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.684 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.684 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.685 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.685 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.685 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.685 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.686 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.686 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.686 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.686 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.687 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.687 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.687 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.687 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.688 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.688 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.688 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.689 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.689 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.689 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.689 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.690 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.690 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.690 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.690 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.691 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.691 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.691 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.692 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.692 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.692 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.692 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.693 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.693 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.693 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.693 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.694 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.694 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.694 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.695 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.695 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.695 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.695 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.696 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.696 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.696 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 3u unix 0xffff9dd16262e300 0t0 28241 type=STREAM 2023-10-16T12:25:51.696 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 4r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.697 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 5u IPv4 32063 0t0 TCP smithi094:ssh->teuthology.front.sepia.ceph.com:49380 (ESTABLISHED) 2023-10-16T12:25:51.697 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 6r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.697 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 7r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.697 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 8u unix 0xffff9dd1633a8000 0t0 29097 type=STREAM 2023-10-16T12:25:51.698 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 9u unix 0xffff9dd162628480 0t0 28244 type=DGRAM 2023-10-16T12:25:51.698 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 11w FIFO 0,24 0t0 30130 /run/systemd/sessions/3.ref 2023-10-16T12:25:51.698 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1781 root 12u unix 0xffff9dd162628d80 0t0 28248 type=STREAM 2023-10-16T12:25:51.699 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.699 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.699 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.699 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.700 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.700 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.700 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T12:25:51.700 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T12:25:51.701 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.701 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.701 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.701 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.702 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T12:25:51.702 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.702 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T12:25:51.703 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.703 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.703 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.703 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.704 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.704 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.704 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T12:25:51.704 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T12:25:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.706 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.706 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.706 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.706 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.707 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.707 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.707 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.707 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.708 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.708 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.708 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.709 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.709 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.709 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.709 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.710 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.710 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.710 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.710 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.711 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.711 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.711 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.711 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.712 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.712 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.712 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.713 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.713 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.713 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.713 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.714 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.714 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.714 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.715 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.715 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.715 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.715 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.716 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.716 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.716 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.717 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.717 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.717 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 3u unix 0xffff9dcc0b1a0d80 0t0 27526 type=STREAM 2023-10-16T12:25:51.717 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 4r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.718 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 5u IPv4 32067 0t0 TCP smithi094:ssh->teuthology.front.sepia.ceph.com:49388 (ESTABLISHED) 2023-10-16T12:25:51.718 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 6r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.718 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 7r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.719 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 8u unix 0xffff9dcc0b1a5100 0t0 27504 type=STREAM 2023-10-16T12:25:51.719 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 9u unix 0xffff9dcc0bf43f00 0t0 32085 type=DGRAM 2023-10-16T12:25:51.719 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 11w FIFO 0,24 0t0 30136 /run/systemd/sessions/4.ref 2023-10-16T12:25:51.719 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1782 root 12u unix 0xffff9dcc0bf45580 0t0 32089 type=STREAM 2023-10-16T12:25:51.720 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.720 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.720 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.720 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.721 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.721 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.721 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T12:25:51.722 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T12:25:51.722 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.722 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.722 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.723 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.723 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T12:25:51.723 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.723 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T12:25:51.724 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.724 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.724 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.725 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.725 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.725 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.725 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T12:25:51.726 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T12:25:51.726 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.726 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.727 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.727 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.727 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.727 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.728 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.728 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.728 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.729 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.729 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.729 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.729 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.730 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.730 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.730 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.731 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.731 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.731 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.731 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.732 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.732 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.732 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.733 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.733 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.733 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.733 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.734 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.734 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.734 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.735 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.735 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.735 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.735 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.736 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.736 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.736 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.736 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.737 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.737 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.737 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.737 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.738 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.738 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.738 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.739 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.739 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 3u unix 0xffff9dd16262e300 0t0 28241 type=STREAM 2023-10-16T12:25:51.739 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 4r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.739 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 5u IPv4 32063 0t0 TCP smithi094:ssh->teuthology.front.sepia.ceph.com:49380 (ESTABLISHED) 2023-10-16T12:25:51.740 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 6r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.740 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 7r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.740 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 8u unix 0xffff9dd1633a8000 0t0 29097 type=STREAM 2023-10-16T12:25:51.740 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 9u unix 0xffff9dd162628480 0t0 28244 type=DGRAM 2023-10-16T12:25:51.741 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 10u unix 0xffff9dd16262d580 0t0 28247 type=STREAM 2023-10-16T12:25:51.741 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 11w FIFO 0,24 0t0 30130 /run/systemd/sessions/3.ref 2023-10-16T12:25:51.741 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 12r FIFO 0,13 0t0 32829 pipe 2023-10-16T12:25:51.741 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1787 ubuntu 13w FIFO 0,13 0t0 32829 pipe 2023-10-16T12:25:51.742 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T12:25:51.742 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.742 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-10-16T12:25:51.743 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.743 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.743 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.743 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-10-16T12:25:51.744 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-10-16T12:25:51.744 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.744 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.744 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.745 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.745 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-10-16T12:25:51.745 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.746 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-10-16T12:25:51.746 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-10-16T12:25:51.746 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-10-16T12:25:51.746 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.747 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.747 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.747 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.748 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-10-16T12:25:51.748 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-10-16T12:25:51.748 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.748 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.749 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.750 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.750 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.750 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.751 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.751 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.751 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.751 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-16T12:25:51.752 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.752 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.752 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.753 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.753 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.753 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.753 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.754 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-16T12:25:51.754 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.754 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.755 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-16T12:25:51.755 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-16T12:25:51.755 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.755 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.756 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.756 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.756 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.757 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.757 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.757 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.758 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.758 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.758 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.758 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.759 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.759 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.759 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-10-16T12:25:51.760 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.760 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.760 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.760 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 0u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.761 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 1u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.761 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 2u CHR 1,3 0t0 2051 /dev/null 2023-10-16T12:25:51.761 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 3u unix 0xffff9dcc0b1a0d80 0t0 27526 type=STREAM 2023-10-16T12:25:51.761 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 4r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.762 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 5u IPv4 32067 0t0 TCP smithi094:ssh->teuthology.front.sepia.ceph.com:49388 (ESTABLISHED) 2023-10-16T12:25:51.762 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 6r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.762 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 7r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.763 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 8u unix 0xffff9dcc0b1a5100 0t0 27504 type=STREAM 2023-10-16T12:25:51.763 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 9u unix 0xffff9dcc0bf43f00 0t0 32085 type=DGRAM 2023-10-16T12:25:51.763 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 10u unix 0xffff9dcc0bf44800 0t0 32088 type=STREAM 2023-10-16T12:25:51.763 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 11w FIFO 0,24 0t0 30136 /run/systemd/sessions/4.ref 2023-10-16T12:25:51.764 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 12r FIFO 0,13 0t0 29158 pipe 2023-10-16T12:25:51.764 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 13w FIFO 0,13 0t0 29158 pipe 2023-10-16T12:25:51.764 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 18r FIFO 0,13 0t0 35857 pipe 2023-10-16T12:25:51.765 INFO:teuthology.orchestra.run.smithi094.stdout:sshd 1788 ubuntu 20r FIFO 0,13 0t0 35858 pipe 2023-10-16T12:25:51.765 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T12:25:51.765 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.765 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-10-16T12:25:51.766 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.766 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.766 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.767 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-16T12:25:51.767 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.767 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.767 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.768 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.768 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.768 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.768 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.769 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.769 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.769 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.770 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.770 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.770 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.770 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu 0r FIFO 0,13 0t0 35856 pipe 2023-10-16T12:25:51.771 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu 1w FIFO 0,13 0t0 35857 pipe 2023-10-16T12:25:51.771 INFO:teuthology.orchestra.run.smithi094.stdout:bash 2268 ubuntu 2w FIFO 0,13 0t0 35858 pipe 2023-10-16T12:25:51.771 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T12:25:51.772 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.772 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root txt REG 8,1 165528 9884 /usr/bin/sudo 2023-10-16T12:25:51.772 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-10-16T12:25:51.772 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T12:25:51.773 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-10-16T12:25:51.773 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-10-16T12:25:51.773 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-10-16T12:25:51.773 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-10-16T12:25:51.774 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T12:25:51.774 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-10-16T12:25:51.774 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-10-16T12:25:51.774 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-10-16T12:25:51.775 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-10-16T12:25:51.775 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.775 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-10-16T12:25:51.776 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-10-16T12:25:51.776 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-10-16T12:25:51.776 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-10-16T12:25:51.776 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-10-16T12:25:51.777 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-10-16T12:25:51.777 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.777 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-16T12:25:51.777 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-16T12:25:51.778 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-16T12:25:51.778 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-16T12:25:51.778 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-16T12:25:51.778 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-16T12:25:51.779 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-10-16T12:25:51.779 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.779 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-10-16T12:25:51.780 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.780 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.780 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.780 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.781 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.781 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.781 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-10-16T12:25:51.781 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.782 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-16T12:25:51.782 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T12:25:51.782 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.782 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.783 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-10-16T12:25:51.783 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-10-16T12:25:51.783 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-16T12:25:51.783 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 432960 47003 /usr/libexec/sudo/sudoers.so 2023-10-16T12:25:51.784 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.784 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-10-16T12:25:51.784 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T12:25:51.785 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.785 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T12:25:51.785 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.785 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.786 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.786 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 104520 47000 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-10-16T12:25:51.786 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-10-16T12:25:51.786 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.787 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-16T12:25:51.787 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.787 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.788 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T12:25:51.788 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T12:25:51.788 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T12:25:51.788 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.789 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T12:25:51.789 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T12:25:51.789 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T12:25:51.789 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T12:25:51.790 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T12:25:51.790 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T12:25:51.790 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T12:25:51.790 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 0r FIFO 0,13 0t0 35856 pipe 2023-10-16T12:25:51.791 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 1w FIFO 0,13 0t0 35857 pipe 2023-10-16T12:25:51.791 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 2w FIFO 0,13 0t0 35858 pipe 2023-10-16T12:25:51.791 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 3r REG 8,1 9253600 68649 /var/lib/sss/mc/passwd 2023-10-16T12:25:51.792 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 4u unix 0xffff9dd16262ba80 0t0 33948 type=STREAM 2023-10-16T12:25:51.792 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 5u netlink 0t0 33956 AUDIT 2023-10-16T12:25:51.792 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 6r REG 8,1 11567160 68651 /var/lib/sss/mc/initgroups 2023-10-16T12:25:51.792 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 7r REG 8,1 6940392 68650 /var/lib/sss/mc/group 2023-10-16T12:25:51.793 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 9u unix 0xffff9dd16262f500 0t0 33958 type=DGRAM 2023-10-16T12:25:51.793 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 10r FIFO 0,13 0t0 33961 pipe 2023-10-16T12:25:51.793 INFO:teuthology.orchestra.run.smithi094.stdout:sudo 2287 root 11w FIFO 0,13 0t0 33961 pipe 2023-10-16T12:25:51.793 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T12:25:51.794 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.794 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-10-16T12:25:51.794 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.795 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.795 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.795 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.795 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.796 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.796 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.796 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.796 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.797 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.797 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.797 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.798 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.798 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.798 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.798 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.799 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.799 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.799 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 0r FIFO 0,13 0t0 35856 pipe 2023-10-16T12:25:51.800 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 1w FIFO 0,13 0t0 35857 pipe 2023-10-16T12:25:51.800 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 2w FIFO 0,13 0t0 35858 pipe 2023-10-16T12:25:51.800 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 3r DIR 0,5 0 1 /proc 2023-10-16T12:25:51.801 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 4r DIR 0,5 0 35890 /proc/2289/fd 2023-10-16T12:25:51.801 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 5w FIFO 0,13 0t0 35900 pipe 2023-10-16T12:25:51.801 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2289 root 6r FIFO 0,13 0t0 35901 pipe 2023-10-16T12:25:51.801 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-16T12:25:51.802 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root rtd DIR 8,1 4096 2 / 2023-10-16T12:25:51.802 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-10-16T12:25:51.802 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-16T12:25:51.803 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-16T12:25:51.803 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-16T12:25:51.803 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-16T12:25:51.803 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-16T12:25:51.804 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-16T12:25:51.804 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-16T12:25:51.804 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-16T12:25:51.805 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-16T12:25:51.805 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T12:25:51.805 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-16T12:25:51.805 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-16T12:25:51.806 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-16T12:25:51.806 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T12:25:51.806 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-16T12:25:51.807 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-16T12:25:51.807 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-16T12:25:51.807 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T12:25:51.807 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root 4r FIFO 0,13 0t0 35900 pipe 2023-10-16T12:25:51.808 INFO:teuthology.orchestra.run.smithi094.stdout:lsof 2290 root 7w FIFO 0,13 0t0 35901 pipe 2023-10-16T12:25:51.808 INFO:teuthology.orchestra.run.smithi094.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-10-16T12:25:51.808 INFO:teuthology.orchestra.run.smithi094.stdout:root 2 0.0 0.0 0 0 ? S 12:24 0:00 [kthreadd] 2023-10-16T12:25:51.808 INFO:teuthology.orchestra.run.smithi094.stdout:root 3 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [rcu_gp] 2023-10-16T12:25:51.809 INFO:teuthology.orchestra.run.smithi094.stdout:root 4 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [rcu_par_gp] 2023-10-16T12:25:51.809 INFO:teuthology.orchestra.run.smithi094.stdout:root 5 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/0:0-cgroup_pidlist_destroy] 2023-10-16T12:25:51.809 INFO:teuthology.orchestra.run.smithi094.stdout:root 6 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/0:0H-events_highpri] 2023-10-16T12:25:51.810 INFO:teuthology.orchestra.run.smithi094.stdout:root 7 0.5 0.0 0 0 ? I 12:24 0:00 \_ [kworker/0:1-events] 2023-10-16T12:25:51.810 INFO:teuthology.orchestra.run.smithi094.stdout:root 8 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:0-events_unbound] 2023-10-16T12:25:51.810 INFO:teuthology.orchestra.run.smithi094.stdout:root 9 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [mm_percpu_wq] 2023-10-16T12:25:51.810 INFO:teuthology.orchestra.run.smithi094.stdout:root 10 0.0 0.0 0 0 ? S 12:24 0:00 \_ [rcu_tasks_rude_] 2023-10-16T12:25:51.811 INFO:teuthology.orchestra.run.smithi094.stdout:root 11 0.0 0.0 0 0 ? S 12:24 0:00 \_ [rcu_tasks_trace] 2023-10-16T12:25:51.811 INFO:teuthology.orchestra.run.smithi094.stdout:root 12 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/0] 2023-10-16T12:25:51.811 INFO:teuthology.orchestra.run.smithi094.stdout:root 13 0.0 0.0 0 0 ? I 12:24 0:00 \_ [rcu_sched] 2023-10-16T12:25:51.811 INFO:teuthology.orchestra.run.smithi094.stdout:root 14 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/0] 2023-10-16T12:25:51.812 INFO:teuthology.orchestra.run.smithi094.stdout:root 15 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/0] 2023-10-16T12:25:51.812 INFO:teuthology.orchestra.run.smithi094.stdout:root 16 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/0] 2023-10-16T12:25:51.812 INFO:teuthology.orchestra.run.smithi094.stdout:root 17 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/1] 2023-10-16T12:25:51.812 INFO:teuthology.orchestra.run.smithi094.stdout:root 18 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/1] 2023-10-16T12:25:51.813 INFO:teuthology.orchestra.run.smithi094.stdout:root 19 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/1] 2023-10-16T12:25:51.813 INFO:teuthology.orchestra.run.smithi094.stdout:root 20 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/1] 2023-10-16T12:25:51.813 INFO:teuthology.orchestra.run.smithi094.stdout:root 21 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/1:0-mm_percpu_wq] 2023-10-16T12:25:51.814 INFO:teuthology.orchestra.run.smithi094.stdout:root 22 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/1:0H-events_highpri] 2023-10-16T12:25:51.814 INFO:teuthology.orchestra.run.smithi094.stdout:root 23 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/2] 2023-10-16T12:25:51.814 INFO:teuthology.orchestra.run.smithi094.stdout:root 24 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/2] 2023-10-16T12:25:51.814 INFO:teuthology.orchestra.run.smithi094.stdout:root 25 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/2] 2023-10-16T12:25:51.815 INFO:teuthology.orchestra.run.smithi094.stdout:root 26 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/2] 2023-10-16T12:25:51.815 INFO:teuthology.orchestra.run.smithi094.stdout:root 27 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/2:0-cgroup_pidlist_destroy] 2023-10-16T12:25:51.815 INFO:teuthology.orchestra.run.smithi094.stdout:root 28 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/2:0H-events_highpri] 2023-10-16T12:25:51.815 INFO:teuthology.orchestra.run.smithi094.stdout:root 29 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/3] 2023-10-16T12:25:51.816 INFO:teuthology.orchestra.run.smithi094.stdout:root 30 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/3] 2023-10-16T12:25:51.816 INFO:teuthology.orchestra.run.smithi094.stdout:root 31 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/3] 2023-10-16T12:25:51.816 INFO:teuthology.orchestra.run.smithi094.stdout:root 32 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/3] 2023-10-16T12:25:51.816 INFO:teuthology.orchestra.run.smithi094.stdout:root 33 0.2 0.0 0 0 ? I 12:24 0:00 \_ [kworker/3:0-cgroup_destroy] 2023-10-16T12:25:51.817 INFO:teuthology.orchestra.run.smithi094.stdout:root 34 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/3:0H-events_highpri] 2023-10-16T12:25:51.817 INFO:teuthology.orchestra.run.smithi094.stdout:root 35 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/4] 2023-10-16T12:25:51.817 INFO:teuthology.orchestra.run.smithi094.stdout:root 36 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/4] 2023-10-16T12:25:51.817 INFO:teuthology.orchestra.run.smithi094.stdout:root 37 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/4] 2023-10-16T12:25:51.818 INFO:teuthology.orchestra.run.smithi094.stdout:root 38 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/4] 2023-10-16T12:25:51.818 INFO:teuthology.orchestra.run.smithi094.stdout:root 39 0.8 0.0 0 0 ? I 12:24 0:00 \_ [kworker/4:0-events] 2023-10-16T12:25:51.818 INFO:teuthology.orchestra.run.smithi094.stdout:root 40 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/4:0H-events_highpri] 2023-10-16T12:25:51.819 INFO:teuthology.orchestra.run.smithi094.stdout:root 41 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/5] 2023-10-16T12:25:51.819 INFO:teuthology.orchestra.run.smithi094.stdout:root 42 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/5] 2023-10-16T12:25:51.819 INFO:teuthology.orchestra.run.smithi094.stdout:root 43 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/5] 2023-10-16T12:25:51.819 INFO:teuthology.orchestra.run.smithi094.stdout:root 44 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/5] 2023-10-16T12:25:51.820 INFO:teuthology.orchestra.run.smithi094.stdout:root 45 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/5:0-cgroup_pidlist_destroy] 2023-10-16T12:25:51.820 INFO:teuthology.orchestra.run.smithi094.stdout:root 46 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/5:0H-events_highpri] 2023-10-16T12:25:51.820 INFO:teuthology.orchestra.run.smithi094.stdout:root 47 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/6] 2023-10-16T12:25:51.820 INFO:teuthology.orchestra.run.smithi094.stdout:root 48 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/6] 2023-10-16T12:25:51.821 INFO:teuthology.orchestra.run.smithi094.stdout:root 49 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/6] 2023-10-16T12:25:51.821 INFO:teuthology.orchestra.run.smithi094.stdout:root 50 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/6] 2023-10-16T12:25:51.821 INFO:teuthology.orchestra.run.smithi094.stdout:root 51 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/6:0-events] 2023-10-16T12:25:51.821 INFO:teuthology.orchestra.run.smithi094.stdout:root 52 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/6:0H-events_highpri] 2023-10-16T12:25:51.822 INFO:teuthology.orchestra.run.smithi094.stdout:root 53 0.0 0.0 0 0 ? S 12:24 0:00 \_ [cpuhp/7] 2023-10-16T12:25:51.822 INFO:teuthology.orchestra.run.smithi094.stdout:root 54 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdog/7] 2023-10-16T12:25:51.822 INFO:teuthology.orchestra.run.smithi094.stdout:root 55 0.0 0.0 0 0 ? S 12:24 0:00 \_ [migration/7] 2023-10-16T12:25:51.823 INFO:teuthology.orchestra.run.smithi094.stdout:root 56 0.0 0.0 0 0 ? S 12:24 0:00 \_ [ksoftirqd/7] 2023-10-16T12:25:51.823 INFO:teuthology.orchestra.run.smithi094.stdout:root 57 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/7:0-cgroup_pidlist_destroy] 2023-10-16T12:25:51.823 INFO:teuthology.orchestra.run.smithi094.stdout:root 58 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/7:0H-events_highpri] 2023-10-16T12:25:51.823 INFO:teuthology.orchestra.run.smithi094.stdout:root 60 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:1-events_unbound] 2023-10-16T12:25:51.824 INFO:teuthology.orchestra.run.smithi094.stdout:root 61 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:2-events_unbound] 2023-10-16T12:25:51.824 INFO:teuthology.orchestra.run.smithi094.stdout:root 62 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:3-events_unbound] 2023-10-16T12:25:51.824 INFO:teuthology.orchestra.run.smithi094.stdout:root 63 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:4-events_unbound] 2023-10-16T12:25:51.824 INFO:teuthology.orchestra.run.smithi094.stdout:root 64 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:5-events_unbound] 2023-10-16T12:25:51.825 INFO:teuthology.orchestra.run.smithi094.stdout:root 65 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:6-events_unbound] 2023-10-16T12:25:51.825 INFO:teuthology.orchestra.run.smithi094.stdout:root 66 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/u16:7-events_unbound] 2023-10-16T12:25:51.825 INFO:teuthology.orchestra.run.smithi094.stdout:root 67 0.0 0.0 0 0 ? S 12:24 0:00 \_ [kdevtmpfs] 2023-10-16T12:25:51.825 INFO:teuthology.orchestra.run.smithi094.stdout:root 68 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [netns] 2023-10-16T12:25:51.826 INFO:teuthology.orchestra.run.smithi094.stdout:root 69 0.0 0.0 0 0 ? S 12:24 0:00 \_ [kauditd] 2023-10-16T12:25:51.826 INFO:teuthology.orchestra.run.smithi094.stdout:root 70 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/4:1-events] 2023-10-16T12:25:51.826 INFO:teuthology.orchestra.run.smithi094.stdout:root 71 0.0 0.0 0 0 ? S 12:24 0:00 \_ [khungtaskd] 2023-10-16T12:25:51.827 INFO:teuthology.orchestra.run.smithi094.stdout:root 72 0.0 0.0 0 0 ? S 12:24 0:00 \_ [oom_reaper] 2023-10-16T12:25:51.827 INFO:teuthology.orchestra.run.smithi094.stdout:root 73 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [writeback] 2023-10-16T12:25:51.827 INFO:teuthology.orchestra.run.smithi094.stdout:root 74 0.0 0.0 0 0 ? S 12:24 0:00 \_ [kcompactd0] 2023-10-16T12:25:51.827 INFO:teuthology.orchestra.run.smithi094.stdout:root 75 0.0 0.0 0 0 ? SN 12:24 0:00 \_ [ksmd] 2023-10-16T12:25:51.828 INFO:teuthology.orchestra.run.smithi094.stdout:root 76 0.0 0.0 0 0 ? SN 12:24 0:00 \_ [khugepaged] 2023-10-16T12:25:51.828 INFO:teuthology.orchestra.run.smithi094.stdout:root 77 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [crypto] 2023-10-16T12:25:51.828 INFO:teuthology.orchestra.run.smithi094.stdout:root 78 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kintegrityd] 2023-10-16T12:25:51.828 INFO:teuthology.orchestra.run.smithi094.stdout:root 79 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kblockd] 2023-10-16T12:25:51.829 INFO:teuthology.orchestra.run.smithi094.stdout:root 80 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [blkcg_punt_bio] 2023-10-16T12:25:51.829 INFO:teuthology.orchestra.run.smithi094.stdout:root 81 0.3 0.0 0 0 ? I 12:24 0:00 \_ [kworker/1:1-events] 2023-10-16T12:25:51.829 INFO:teuthology.orchestra.run.smithi094.stdout:root 82 0.5 0.0 0 0 ? I 12:24 0:00 \_ [kworker/2:1-events] 2023-10-16T12:25:51.830 INFO:teuthology.orchestra.run.smithi094.stdout:root 83 0.5 0.0 0 0 ? I 12:24 0:00 \_ [kworker/3:1-events] 2023-10-16T12:25:51.830 INFO:teuthology.orchestra.run.smithi094.stdout:root 84 0.5 0.0 0 0 ? I 12:24 0:00 \_ [kworker/5:1-events] 2023-10-16T12:25:51.830 INFO:teuthology.orchestra.run.smithi094.stdout:root 85 0.3 0.0 0 0 ? I 12:24 0:00 \_ [kworker/7:1-events] 2023-10-16T12:25:51.830 INFO:teuthology.orchestra.run.smithi094.stdout:root 86 0.0 0.0 0 0 ? I 12:24 0:00 \_ [kworker/6:1-cgroup_pidlist_destroy] 2023-10-16T12:25:51.831 INFO:teuthology.orchestra.run.smithi094.stdout:root 87 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [tpm_dev_wq] 2023-10-16T12:25:51.831 INFO:teuthology.orchestra.run.smithi094.stdout:root 88 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [md] 2023-10-16T12:25:51.831 INFO:teuthology.orchestra.run.smithi094.stdout:root 89 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [edac-poller] 2023-10-16T12:25:51.832 INFO:teuthology.orchestra.run.smithi094.stdout:root 90 0.0 0.0 0 0 ? S 12:24 0:00 \_ [watchdogd] 2023-10-16T12:25:51.832 INFO:teuthology.orchestra.run.smithi094.stdout:root 91 0.0 0.0 0 0 ? I< 12:24 0:00 \_ [kworker/1:1H-kblockd] 2023-10-16T12:25:51.832 INFO:teuthology.orchestra.run.smithi094.stdout:root 124 0.0 0.0 0 0 ? S 12:24 0:00 \_ [kswapd0] 2023-10-16T12:25:51.832 INFO:teuthology.orchestra.run.smithi094.stdout:root 226 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kthrotld] 2023-10-16T12:25:51.833 INFO:teuthology.orchestra.run.smithi094.stdout:root 227 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [acpi_thermal_pm] 2023-10-16T12:25:51.833 INFO:teuthology.orchestra.run.smithi094.stdout:root 228 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/3:2-cgroup_pidlist_destroy] 2023-10-16T12:25:51.833 INFO:teuthology.orchestra.run.smithi094.stdout:root 229 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kmpath_rdacd] 2023-10-16T12:25:51.834 INFO:teuthology.orchestra.run.smithi094.stdout:root 230 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kaluad] 2023-10-16T12:25:51.834 INFO:teuthology.orchestra.run.smithi094.stdout:root 231 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/0:2-pm] 2023-10-16T12:25:51.834 INFO:teuthology.orchestra.run.smithi094.stdout:root 232 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/0:3-events] 2023-10-16T12:25:51.834 INFO:teuthology.orchestra.run.smithi094.stdout:root 233 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/4:1H-kblockd] 2023-10-16T12:25:51.835 INFO:teuthology.orchestra.run.smithi094.stdout:root 234 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [ipv6_addrconf] 2023-10-16T12:25:51.835 INFO:teuthology.orchestra.run.smithi094.stdout:root 235 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kstrp] 2023-10-16T12:25:51.835 INFO:teuthology.orchestra.run.smithi094.stdout:root 236 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/4:2-events] 2023-10-16T12:25:51.836 INFO:teuthology.orchestra.run.smithi094.stdout:root 316 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/5:1H-kblockd] 2023-10-16T12:25:51.836 INFO:teuthology.orchestra.run.smithi094.stdout:root 348 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/2:1H-kblockd] 2023-10-16T12:25:51.836 INFO:teuthology.orchestra.run.smithi094.stdout:root 349 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/6:1H-kblockd] 2023-10-16T12:25:51.836 INFO:teuthology.orchestra.run.smithi094.stdout:root 351 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/0:1H-kblockd] 2023-10-16T12:25:51.837 INFO:teuthology.orchestra.run.smithi094.stdout:root 353 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/5:2-cgroup_destroy] 2023-10-16T12:25:51.837 INFO:teuthology.orchestra.run.smithi094.stdout:root 355 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/7:1H-kblockd] 2023-10-16T12:25:51.837 INFO:teuthology.orchestra.run.smithi094.stdout:root 371 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/3:1H-kblockd] 2023-10-16T12:25:51.838 INFO:teuthology.orchestra.run.smithi094.stdout:root 380 0.9 0.0 0 0 ? I 12:25 0:00 \_ [kworker/6:2-events] 2023-10-16T12:25:51.838 INFO:teuthology.orchestra.run.smithi094.stdout:root 382 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/7:2-events] 2023-10-16T12:25:51.838 INFO:teuthology.orchestra.run.smithi094.stdout:root 383 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/7:3-events] 2023-10-16T12:25:51.838 INFO:teuthology.orchestra.run.smithi094.stdout:root 493 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/1:2-events] 2023-10-16T12:25:51.839 INFO:teuthology.orchestra.run.smithi094.stdout:root 495 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [nvme-wq] 2023-10-16T12:25:51.839 INFO:teuthology.orchestra.run.smithi094.stdout:root 496 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [nvme-reset-wq] 2023-10-16T12:25:51.839 INFO:teuthology.orchestra.run.smithi094.stdout:root 497 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [nvme-delete-wq] 2023-10-16T12:25:51.839 INFO:teuthology.orchestra.run.smithi094.stdout:root 505 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [ata_sff] 2023-10-16T12:25:51.840 INFO:teuthology.orchestra.run.smithi094.stdout:root 508 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [ixgbe] 2023-10-16T12:25:51.840 INFO:teuthology.orchestra.run.smithi094.stdout:root 512 0.1 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_0] 2023-10-16T12:25:51.840 INFO:teuthology.orchestra.run.smithi094.stdout:root 513 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_0] 2023-10-16T12:25:51.840 INFO:teuthology.orchestra.run.smithi094.stdout:root 514 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_1] 2023-10-16T12:25:51.841 INFO:teuthology.orchestra.run.smithi094.stdout:root 515 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_1] 2023-10-16T12:25:51.841 INFO:teuthology.orchestra.run.smithi094.stdout:root 518 0.1 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_2] 2023-10-16T12:25:51.841 INFO:teuthology.orchestra.run.smithi094.stdout:root 519 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_2] 2023-10-16T12:25:51.841 INFO:teuthology.orchestra.run.smithi094.stdout:root 520 0.1 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_3] 2023-10-16T12:25:51.842 INFO:teuthology.orchestra.run.smithi094.stdout:root 521 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_3] 2023-10-16T12:25:51.842 INFO:teuthology.orchestra.run.smithi094.stdout:root 522 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_4] 2023-10-16T12:25:51.842 INFO:teuthology.orchestra.run.smithi094.stdout:root 523 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_4] 2023-10-16T12:25:51.843 INFO:teuthology.orchestra.run.smithi094.stdout:root 524 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_5] 2023-10-16T12:25:51.843 INFO:teuthology.orchestra.run.smithi094.stdout:root 525 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_5] 2023-10-16T12:25:51.843 INFO:teuthology.orchestra.run.smithi094.stdout:root 526 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_6] 2023-10-16T12:25:51.843 INFO:teuthology.orchestra.run.smithi094.stdout:root 527 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_6] 2023-10-16T12:25:51.844 INFO:teuthology.orchestra.run.smithi094.stdout:root 528 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_7] 2023-10-16T12:25:51.844 INFO:teuthology.orchestra.run.smithi094.stdout:root 529 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_7] 2023-10-16T12:25:51.844 INFO:teuthology.orchestra.run.smithi094.stdout:root 530 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_8] 2023-10-16T12:25:51.844 INFO:teuthology.orchestra.run.smithi094.stdout:root 531 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_8] 2023-10-16T12:25:51.845 INFO:teuthology.orchestra.run.smithi094.stdout:root 532 0.0 0.0 0 0 ? S 12:25 0:00 \_ [scsi_eh_9] 2023-10-16T12:25:51.845 INFO:teuthology.orchestra.run.smithi094.stdout:root 533 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [scsi_tmf_9] 2023-10-16T12:25:51.845 INFO:teuthology.orchestra.run.smithi094.stdout:root 534 0.1 0.0 0 0 ? I 12:25 0:00 \_ [kworker/u16:8-writeback] 2023-10-16T12:25:51.845 INFO:teuthology.orchestra.run.smithi094.stdout:root 535 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/u16:9-writeback] 2023-10-16T12:25:51.846 INFO:teuthology.orchestra.run.smithi094.stdout:root 536 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/u16:10] 2023-10-16T12:25:51.846 INFO:teuthology.orchestra.run.smithi094.stdout:root 545 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/2:2-cgroup_pidlist_destroy] 2023-10-16T12:25:51.846 INFO:teuthology.orchestra.run.smithi094.stdout:root 562 0.0 0.0 0 0 ? S 12:25 0:00 \_ [jbd2/sda1-8] 2023-10-16T12:25:51.846 INFO:teuthology.orchestra.run.smithi094.stdout:root 563 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [ext4-rsv-conver] 2023-10-16T12:25:51.847 INFO:teuthology.orchestra.run.smithi094.stdout:root 665 0.0 0.0 0 0 ? S 12:25 0:00 \_ [ext4lazyinit] 2023-10-16T12:25:51.847 INFO:teuthology.orchestra.run.smithi094.stdout:root 686 0.1 0.0 0 0 ? I 12:25 0:00 \_ [kworker/6:3-events] 2023-10-16T12:25:51.847 INFO:teuthology.orchestra.run.smithi094.stdout:root 695 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/6:4] 2023-10-16T12:25:51.847 INFO:teuthology.orchestra.run.smithi094.stdout:root 712 0.2 0.0 0 0 ? I 12:25 0:00 \_ [kworker/2:3-cgroup_pidlist_destroy] 2023-10-16T12:25:51.848 INFO:teuthology.orchestra.run.smithi094.stdout:root 751 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [rpciod] 2023-10-16T12:25:51.848 INFO:teuthology.orchestra.run.smithi094.stdout:root 752 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kworker/u17:0] 2023-10-16T12:25:51.848 INFO:teuthology.orchestra.run.smithi094.stdout:root 753 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [xprtiod] 2023-10-16T12:25:51.848 INFO:teuthology.orchestra.run.smithi094.stdout:root 777 0.0 0.0 0 0 ? SN 12:25 0:00 \_ [kipmi0] 2023-10-16T12:25:51.849 INFO:teuthology.orchestra.run.smithi094.stdout:root 788 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kdmflush/253:0] 2023-10-16T12:25:51.849 INFO:teuthology.orchestra.run.smithi094.stdout:root 789 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kdmflush/253:1] 2023-10-16T12:25:51.849 INFO:teuthology.orchestra.run.smithi094.stdout:root 790 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kdmflush/253:2] 2023-10-16T12:25:51.849 INFO:teuthology.orchestra.run.smithi094.stdout:root 791 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kdmflush/253:3] 2023-10-16T12:25:51.850 INFO:teuthology.orchestra.run.smithi094.stdout:root 792 0.0 0.0 0 0 ? I< 12:25 0:00 \_ [kdmflush/253:4] 2023-10-16T12:25:51.850 INFO:teuthology.orchestra.run.smithi094.stdout:root 829 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/1:3-events] 2023-10-16T12:25:51.850 INFO:teuthology.orchestra.run.smithi094.stdout:root 1032 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/5:3-events] 2023-10-16T12:25:51.851 INFO:teuthology.orchestra.run.smithi094.stdout:root 1644 0.0 0.0 0 0 ? I 12:25 0:00 \_ [kworker/3:3-events] 2023-10-16T12:25:51.851 INFO:teuthology.orchestra.run.smithi094.stdout:root 1 4.4 0.0 241340 14344 ? Ss 12:24 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 17 2023-10-16T12:25:51.851 INFO:teuthology.orchestra.run.smithi094.stdout:root 657 0.4 0.0 89500 12052 ? Ss 12:25 0:00 /usr/lib/systemd/systemd-journald 2023-10-16T12:25:51.851 INFO:teuthology.orchestra.run.smithi094.stdout:root 699 1.6 0.0 119832 14028 ? Ss 12:25 0:00 /usr/lib/systemd/systemd-udevd 2023-10-16T12:25:51.852 INFO:teuthology.orchestra.run.smithi094.stdout:rpc 748 0.0 0.0 67220 5576 ? Ss 12:25 0:00 /usr/bin/rpcbind -w -f 2023-10-16T12:25:51.852 INFO:teuthology.orchestra.run.smithi094.stdout:root 749 0.0 0.0 141952 2676 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T12:25:51.866 DEBUG:teuthology.orchestra.run.smithi130:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T12:25:51.900 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T12:25:51.902 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T12:25:51.909 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T12:25:51.911 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933/remote/smithi094/crash 2023-10-16T12:25:51.912 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T12:25:51.983 INFO:teuthology.orchestra.run.smithi094.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-16T12:25:51.983 INFO:teuthology.orchestra.run.smithi094.stderr:tar: Error is not recoverable: exiting now 2023-10-16T12:25:51.985 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933/remote/smithi130/crash 2023-10-16T12:25:51.987 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T12:25:52.034 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-16T12:25:52.034 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2023-10-16T12:25:52.035 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T12:25:52.036 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T12:25:52.052 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T12:25:52.062 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T12:25:52.068 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T12:25:52.069 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T12:25:52.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T12:25:52.149 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T12:25:52.157 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T12:25:52.158 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T12:25:52.160 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T12:25:52.173 INFO:teuthology.orchestra.run.smithi094.stderr:bash: ntpq: command not found 2023-10-16T12:25:52.176 INFO:teuthology.orchestra.run.smithi130.stderr:bash: ntpq: command not found 2023-10-16T12:25:52.178 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T12:25:52.178 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2023-10-16T12:25:52.179 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv01.front.sepia.ceph.com 2 6 17 1 +1063us[+1059us] +/- 77ms 2023-10-16T12:25:52.179 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv02.front.sepia.ceph.com 3 6 17 1 -1048us[-1052us] +/- 49ms 2023-10-16T12:25:52.179 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 17 1 +555us[ +555us] +/- 71ms 2023-10-16T12:25:52.179 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:25:52.180 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T12:25:52.180 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-10-16T12:25:52.181 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv01.front.sepia.ceph.com 2 6 17 1 +1080us[+1082us] +/- 77ms 2023-10-16T12:25:52.181 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv02.front.sepia.ceph.com 3 6 17 1 -1041us[-1039us] +/- 49ms 2023-10-16T12:25:52.181 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 17 1 +546us[ +546us] +/- 71ms 2023-10-16T12:25:52.181 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T12:25:52.182 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T12:25:52.191 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T12:25:52.192 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T12:25:52.200 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T12:25:52.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:52.238 INFO:teuthology.orchestra.run.smithi094.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/archive/audit’: No such file or directory 2023-10-16T12:25:52.238 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2023-10-16T12:25:52.246 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T12:25:52.255 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T12:25:52.264 INFO:teuthology.task.internal:Duration was 13658.606775 seconds 2023-10-16T12:25:52.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T12:25:52.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T12:25:52.275 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T12:25:52.284 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T12:25:52.339 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:25:52.355 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T12:25:52.433 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T12:25:52.434 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2023-10-16T12:25:52.434 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T12:25:52.452 INFO:teuthology.orchestra.run.smithi094.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-16T12:25:52.455 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2023-10-16T12:25:52.456 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T12:25:52.476 INFO:teuthology.orchestra.run.smithi130.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-16T12:25:52.479 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T12:25:52.480 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T12:25:52.497 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T12:25:52.511 INFO:teuthology.orchestra.run.smithi094.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-16T12:25:52.535 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-16T12:25:52.546 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T12:25:52.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T12:25:52.564 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T12:25:52.577 INFO:teuthology.orchestra.run.smithi094.stderr:bash: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-16T12:25:52.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:52.591 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/syslog.py", line 185, in syslog run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz' 2023-10-16T12:25:52.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T12:25:52.621 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T12:25:52.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T12:25:52.628 INFO:teuthology.orchestra.run.smithi130.stderr:bash: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-16T12:25:52.672 INFO:teuthology.orchestra.run.smithi094.stderr:mv: cannot stat '/etc/sudoers.orig.teuthology': No such file or directory 2023-10-16T12:25:52.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:52.674 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2023-10-16T12:25:52.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T12:25:52.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T12:25:52.717 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T12:25:52.743 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2023-10-16T12:25:52.747 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2023-10-16T12:25:52.755 INFO:teuthology.orchestra.run.smithi094.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-16T12:25:52.760 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-16T12:25:52.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:52.761 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-16T12:25:52.761 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 491, in coredump run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2023-10-16T12:25:52.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T12:25:52.790 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T12:25:52.791 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi/7428933/remote/smithi094 2023-10-16T12:25:52.791 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T12:25:52.798 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-16T12:25:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2023-10-16T12:25:52.826 INFO:teuthology.orchestra.run.smithi094.stderr:tar: Error is not recoverable: exiting now 2023-10-16T12:25:52.827 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/tarfile.py", line 2318, in next tarinfo = self.tarinfo.fromtarfile(self) File "/usr/lib/python3.8/tarfile.py", line 1105, in fromtarfile obj = cls.frombuf(buf, tarfile.encoding, tarfile.errors) File "/usr/lib/python3.8/tarfile.py", line 1041, in frombuf raise EmptyHeaderError("empty header") tarfile.EmptyHeaderError: empty header During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 749, in pull_directory tar = tarfile.open(mode='r|', fileobj=r.stdout) File "/usr/lib/python3.8/tarfile.py", line 1633, in open t = cls(name, filemode, stream, **kwargs) File "/usr/lib/python3.8/tarfile.py", line 1514, in __init__ self.firstmember = self.next() File "/usr/lib/python3.8/tarfile.py", line 2333, in next raise ReadError("empty file") tarfile.ReadError: empty file 2023-10-16T12:25:52.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T12:25:52.859 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T12:25:52.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T12:25:52.920 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T12:25:52.921 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T12:25:52.930 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T12:25:52.943 INFO:teuthology.orchestra.run.smithi094.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-16T12:25:52.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T12:25:52.945 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-16T12:25:52.945 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_75071e9ab3c3bca3308a5f42b10f82d632c58444/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T12:25:52.963 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T12:25:52.974 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T12:25:53.053 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi094 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T12:25:53.053 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T12:25:53.063 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-16T12:25:53.063 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-16T12:25:53.083 INFO:teuthology.nuke:Not nuking smithi094.front.sepia.ceph.com because description doesn't match: rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi != /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427546 2023-10-16T12:25:53.104 INFO:teuthology.nuke:Not nuking smithi130.front.sepia.ceph.com because description doesn't match: rishabh-2023-10-16_06:54:33-fs-rishabh-2023oct13-testing-default-smithi != /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427546 2023-10-16T12:25:53.105 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIDtYanxnZnQdiajc3h0gVfF4mqA/1udBJaONh8NTFWOPU1JM8j9veTPKdwjiQCKSwhOrQS6WtwZ2GAYpdCT++k= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4sMmDYQziwGjqS8rNGBmMLOo3oot4NX7CXQRSRiZOXLdDk1CTLJQklvl1jjFI2/BRSjMjrEzA6emJN69JuwT8= 2023-10-16T12:25:53.115 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 13658.606775045395 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 mon.b-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b3343bbeba2a4e07a99f88a68122fdb2 status: fail success: false 2023-10-16T12:25:53.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:25:53.200 INFO:teuthology.run:FAIL